-- Logs begin at Tue 2022-07-05 20:19:02 UTC, end at Tue 2022-07-05 21:44:52 UTC. -- Jul 05 21:08:27.609167 dv-cinder-847335-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 05 21:08:27.618131 dv-cinder-847335-3-smb devstack@keystone.service[80235]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 05 21:08:27.620365 dv-cinder-847335-3-smb devstack@keystone.service[80235]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 5 21:08:27 2022] *** Jul 05 21:08:27.620365 dv-cinder-847335-3-smb devstack@keystone.service[80235]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 05 21:08:27.620365 dv-cinder-847335-3-smb devstack@keystone.service[80235]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 05 21:08:27.620365 dv-cinder-847335-3-smb devstack@keystone.service[80235]: nodename: dv-cinder-847335-3-smb Jul 05 21:08:27.620365 dv-cinder-847335-3-smb devstack@keystone.service[80235]: machine: x86_64 Jul 05 21:08:27.620365 dv-cinder-847335-3-smb devstack@keystone.service[80235]: clock source: unix Jul 05 21:08:27.620365 dv-cinder-847335-3-smb devstack@keystone.service[80235]: pcre jit disabled Jul 05 21:08:27.620365 dv-cinder-847335-3-smb devstack@keystone.service[80235]: detected number of CPU cores: 4 Jul 05 21:08:27.620365 dv-cinder-847335-3-smb devstack@keystone.service[80235]: current working directory: / Jul 05 21:08:27.620365 dv-cinder-847335-3-smb devstack@keystone.service[80235]: detected binary path: /usr/bin/uwsgi-core Jul 05 21:08:27.620365 dv-cinder-847335-3-smb devstack@keystone.service[80235]: your processes number limit is 47680 Jul 05 21:08:27.620365 dv-cinder-847335-3-smb devstack@keystone.service[80235]: your memory page size is 4096 bytes Jul 05 21:08:27.620365 dv-cinder-847335-3-smb devstack@keystone.service[80235]: detected max file descriptor number: 2048 Jul 05 21:08:27.620365 dv-cinder-847335-3-smb devstack@keystone.service[80235]: lock engine: pthread robust mutexes Jul 05 21:08:27.621163 dv-cinder-847335-3-smb devstack@keystone.service[80235]: thunder lock: enabled Jul 05 21:08:27.621163 dv-cinder-847335-3-smb devstack@keystone.service[80235]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 05 21:08:27.621163 dv-cinder-847335-3-smb devstack@keystone.service[80235]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 05 21:08:27.665736 dv-cinder-847335-3-smb devstack@keystone.service[80235]: Python main interpreter initialized at 0x555a4c4659c0 Jul 05 21:08:27.665736 dv-cinder-847335-3-smb devstack@keystone.service[80235]: python threads support enabled Jul 05 21:08:27.665736 dv-cinder-847335-3-smb devstack@keystone.service[80235]: your server socket listen backlog is limited to 100 connections Jul 05 21:08:27.665736 dv-cinder-847335-3-smb devstack@keystone.service[80235]: your mercy for graceful operations on workers is 90 seconds Jul 05 21:08:27.666098 dv-cinder-847335-3-smb devstack@keystone.service[80235]: mapped 403077 bytes (393 KB) for 2 cores Jul 05 21:08:27.666208 dv-cinder-847335-3-smb devstack@keystone.service[80235]: *** Operational MODE: preforking *** Jul 05 21:08:27.666448 dv-cinder-847335-3-smb devstack@keystone.service[80235]: *** uWSGI is running in multiple interpreter mode *** Jul 05 21:08:27.666448 dv-cinder-847335-3-smb devstack@keystone.service[80235]: spawned uWSGI master process (pid: 80235) Jul 05 21:08:27.666648 dv-cinder-847335-3-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 05 21:08:27.668104 dv-cinder-847335-3-smb devstack@keystone.service[80235]: spawned uWSGI worker 1 (pid: 80246, cores: 1) Jul 05 21:08:27.668104 dv-cinder-847335-3-smb devstack@keystone.service[80235]: spawned uWSGI worker 2 (pid: 80247, cores: 1) Jul 05 21:08:27.668104 dv-cinder-847335-3-smb devstack@keystone.service[80235]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 05 21:08:33.208992 dv-cinder-847335-3-smb devstack@keystone.service[80247]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 21:08:33.208992 dv-cinder-847335-3-smb devstack@keystone.service[80247]: from cryptography.utils import int_from_bytes Jul 05 21:08:33.209803 dv-cinder-847335-3-smb devstack@keystone.service[80247]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 21:08:33.209803 dv-cinder-847335-3-smb devstack@keystone.service[80247]: from cryptography.utils import int_from_bytes Jul 05 21:08:33.209920 dv-cinder-847335-3-smb devstack@keystone.service[80246]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 21:08:33.209920 dv-cinder-847335-3-smb devstack@keystone.service[80246]: from cryptography.utils import int_from_bytes Jul 05 21:08:33.210376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 21:08:33.210376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: from cryptography.utils import int_from_bytes Jul 05 21:08:33.258523 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 21:08:33.258714 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 21:08:33.258867 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 21:08:33.258967 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] command line args: [] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 21:08:33.259071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 21:08:33.259225 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 21:08:33.259317 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] command line args: [] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 21:08:33.259423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ================================================================================ {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 21:08:33.259533 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 21:08:33.259725 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] admin_token = **** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.259810 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ================================================================================ {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 21:08:33.259996 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] admin_token = **** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.260084 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] config_dir = [] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.260213 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.260296 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] config_dir = [] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.260397 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] config_source = [] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.260473 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.260581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] debug = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.260667 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] config_source = [] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.260761 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] debug = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.260843 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.261038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.261164 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.261233 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.261298 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.261360 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.261548 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.261632 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.261787 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.261868 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.262009 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] list_limit = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.262095 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] list_limit = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.262234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] log_config_append = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.262318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] log_config_append = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.262395 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.262459 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.262571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] log_dir = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.262643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] log_dir = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.262714 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] log_file = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.262777 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] log_file = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.262928 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.263054 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.263173 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.263290 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.263403 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.263514 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.263623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.263727 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.263853 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.263964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.264086 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.264208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.264328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.264443 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.264556 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.264668 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.264786 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.264906 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.265021 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.265140 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.265259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.265371 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.265483 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.265612 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.265726 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.265849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.265968 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.266082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.266461 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.266594 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.267365 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.267833 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.267833 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] publish_errors = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.268116 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] publish_errors = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.268229 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.268341 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.268465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.268465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.268683 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.268683 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.268892 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.269019 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.269146 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.269267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.269386 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] standard_threads = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.269490 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] standard_threads = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.269600 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.269723 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.269837 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.269837 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.270045 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.270173 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] use_journal = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.270299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.270422 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] use_json = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.270535 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] use_journal = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.270648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] use_stderr = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.270766 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] use_json = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.270885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] use_syslog = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.270998 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] use_stderr = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.270998 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] use_syslog = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.271299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.271418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:08:33.271537 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.271650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.271777 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.271899 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.272018 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.272131 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.272243 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.272356 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.272468 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.272588 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.272702 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.272819 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.272933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.273052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.273165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.273284 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.273399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.273517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.273637 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.273755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.273869 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.273991 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.274104 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.274241 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.274354 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.274476 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.274595 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.274727 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.274848 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.274961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.275073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.275192 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.275314 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.275428 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.275541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.275658 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.275772 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.275883 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.276004 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.276123 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.276242 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.276360 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.276474 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.276587 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.276775 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.276895 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.277015 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.277133 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.277248 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.277397 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.277522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.277637 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.277749 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.277867 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.277986 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.278099 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.278251 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.278372 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.278491 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.278605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.278723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.278840 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.278961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.279079 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.279192 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.279304 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.279416 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.279526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.279647 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.279761 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.279873 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.279985 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.280097 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.280208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.280329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.280448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.280567 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.280686 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.280830 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.280952 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.281074 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.281188 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.281301 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.281413 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.281531 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.281635 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.281737 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.281851 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.281964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.282076 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.282215 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.283011 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.283468 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.283578 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.283687 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.283807 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.283924 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.284040 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.284154 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.284281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.284281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.284778 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.284893 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.285007 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.285007 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.285217 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.285331 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.285444 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.285564 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.285678 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.285800 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.285912 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.286026 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.286190 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.286308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.286413 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.286524 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.286654 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.286771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.286884 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.286997 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.287111 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.287232 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.287347 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.287460 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.287582 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.287696 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.287809 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.287922 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.288036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.288156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.288270 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.288384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.288503 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.288617 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.288742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.288863 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.288987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.289110 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.289224 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.289338 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.289527 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.289645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.289763 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.289877 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.289990 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.290104 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.290248 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.290364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.290478 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.290591 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.290694 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.290806 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.290932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.291058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.291174 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.291288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.291402 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.291515 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.291628 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.291751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.291866 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.291980 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.292099 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.292214 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.292329 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.292451 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.292571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.292687 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.292800 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.292914 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.293033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.293159 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.293274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.293394 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.293508 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.293622 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.293735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.293856 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.293971 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.294085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.294244 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.294360 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.294474 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.294599 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.294715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.294828 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.294941 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.295055 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.295168 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.295289 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.295405 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.295405 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.295619 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.295738 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.295853 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.295974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.296089 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.296202 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.296315 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.296435 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.296555 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.296678 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.296798 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.296913 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.297026 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.297140 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.297253 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.297375 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] auth.external = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.297491 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] auth.external = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.297604 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.297718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.297837 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.297980 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.298334 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.298482 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.298610 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] auth.password = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.298733 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] auth.password = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.298853 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] auth.token = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.298973 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] auth.token = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.299091 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.299209 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.299382 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.299503 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.299623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.299741 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.299858 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.299975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.300101 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.300221 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.300339 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.300456 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.300581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.300709 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.300837 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] credential.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.300957 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] credential.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.301083 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.301201 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.301319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.301442 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.301570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.301690 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.301814 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.301933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.302050 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.302181 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.302314 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.302434 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.302557 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.302675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.302793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.302919 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.303038 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.303156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.303273 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.303391 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.303514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.303715 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.303838 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.303956 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.304073 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.304190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.304330 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.304459 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.304578 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.304696 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.304848 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] federation.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.304968 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] federation.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.305085 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.305211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.305330 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.305448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.305555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.305653 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.305775 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.305903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.306028 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.306173 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.306304 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.306430 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.306549 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.306675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.306794 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.306912 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.307030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.307147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.307265 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.307390 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.307515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.307634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.307752 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.307869 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.307996 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.308123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.308245 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.308362 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.308480 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.308597 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.308714 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.308839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.308964 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.309084 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.309200 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.309317 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.309442 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.309569 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.309692 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.309809 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.309927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.310043 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.310176 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.310307 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.310426 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.310543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.310660 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.310777 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.310895 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.311024 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.311149 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.311268 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.311385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.311502 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.311619 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.311745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.311864 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.311987 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.312105 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.312223 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.312349 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.312467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.312585 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.312701 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.312819 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.312935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.313061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.313180 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.313298 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.313415 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.313532 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.313671 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.313801 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.313920 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.314037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.314169 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.314290 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.314406 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.314539 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.314659 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.314776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.314892 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.315016 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.315134 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.315259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.315379 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.315496 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.315613 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.315718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.315833 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.315959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.316089 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.316208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.316325 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.316444 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.316560 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.316686 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.316805 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.316922 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.317045 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.317171 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.317289 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.317419 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.317539 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.317656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.317773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.317890 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.318007 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.318182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.318182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.318482 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.318613 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.318733 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.318851 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.318977 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.319095 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.319212 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.319329 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.319447 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.319565 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.319690 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.319810 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.319927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.320043 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.320160 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.320277 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.320402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.320521 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.320639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.320755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.320878 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.320997 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.321122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.321242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.321358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.321475 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.321591 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.321708 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.321834 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.321952 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.322069 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.322208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.322326 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.322444 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.322573 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.322694 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.322811 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.322927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.323044 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.323161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.323286 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.323405 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.323522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.323639 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.323757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.323874 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.323999 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.324118 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.324236 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.324352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.324469 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.324586 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.324712 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.324832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.324950 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.325067 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.325183 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.325300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.325425 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.325544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.325661 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.325778 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.325895 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.326012 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.326156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.326278 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.326396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.326513 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.326629 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.326821 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.326821 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.327046 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.327164 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.327281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.327405 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.327535 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.327654 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.327771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.327889 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.328006 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.328126 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.328252 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.328371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.328488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.328605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.328722 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.328839 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] resource.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.328966 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.329085 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.329704 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.329825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.329942 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] resource.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.330059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.330257 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.330378 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.330496 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.330614 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.330787 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.330906 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.331026 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.331133 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.331249 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.331366 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.331483 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.331600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.331726 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.331844 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] role.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.331961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.332078 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] role.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.332196 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.332312 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.332441 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] role.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.332561 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.332678 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] role.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.332795 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.332912 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.333029 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.333155 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.333274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.333391 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.333508 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.333630 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.333748 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.333874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.333992 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.334109 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.334248 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.334375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.334494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.334619 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.334743 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.334861 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.334977 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.335094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.335210 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.335336 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.335454 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.335570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.335687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.335805 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.335930 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.336048 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.336171 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.336291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.336408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.336525 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.336651 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.336769 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.336887 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.336887 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.337106 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.337224 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.337351 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.337787 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.337908 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.338029 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.338202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.338316 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.338429 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.338530 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.338628 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.338725 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.338822 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.338928 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.339035 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.339135 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.339232 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.339329 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.339434 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.339532 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.339637 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.339737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.339839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.339936 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.340047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.340167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] token.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.340293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.340412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.340531 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.340648 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.340765 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.340882 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.341009 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] token.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.341127 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.341245 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.341362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.341479 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.341597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.341723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.341841 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.341959 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.342076 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.342207 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.342326 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.342456 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.342576 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.342694 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.342811 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.342934 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.343053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.343179 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.343298 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.343415 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.343533 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.343651 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.343768 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.343894 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.344013 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.344130 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.344247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.344364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.344481 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.connection = **** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.344612 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.344743 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.344901 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.345538 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.345661 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.345779 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.345921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.connection = **** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.346103 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.346265 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.346385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.346501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.346617 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.346734 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.346852 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.347046 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.347166 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.347283 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.347398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.347514 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.347631 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.347755 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.347873 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.347994 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.348111 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.348227 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.348343 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.348468 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.348585 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.348701 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.348816 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.348934 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.349050 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.349174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.349291 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.349407 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.349523 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.349523 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 21:08:33.349741 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.349741 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.349741 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.349741 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:08:33.349741 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 21:08:33.373542 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.373770 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.373998 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.374190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.374417 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.374642 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.382555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.383036 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.411639 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.411863 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.412058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.412290 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.554249 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.554549 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.603434 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.603670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.603872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.604107 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.668398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.668629 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.668757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.668849 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.668951 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.669032 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.669109 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.669244 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.669331 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.669456 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.669543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.669677 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.694711 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.694853 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.694954 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.695035 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.695142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.695264 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.695350 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.695486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.695581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.695705 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.695790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.695921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.696006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.696138 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.707889 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.708531 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.720759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.720967 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.721081 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.721195 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.721280 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.721414 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.721496 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.721626 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.721725 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.721833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.721914 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.722040 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.722140 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80246) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.722279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:08:33.739332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.739542 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 21:08:33.739785 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.739869 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.739995 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 21:08:33.740079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 21:08:33.740322 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.740403 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.740517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 21:08:33.740598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.740780 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.740863 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.741034 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.741115 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.741286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.741535 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.752449 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.752722 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.752987 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.753071 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.753264 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.753360 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.753528 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.753801 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.761512 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.762002 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.764810 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.765087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.765273 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.765361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.765550 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.765648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.765828 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.765911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.766100 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.766456 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.766665 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.767813 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.767813 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.768043 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.768152 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.768231 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.768316 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.768393 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.768467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.768541 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.768707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.768970 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.794702 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.795382 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.796303 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.796576 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.796982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.797254 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.802380 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.802659 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.803024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.803109 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.803299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.803688 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.810367 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.810603 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.810939 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.811216 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.815842 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.816120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.816204 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.816397 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.816481 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.816675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.816759 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.816946 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.817030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.817217 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.817310 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.817483 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.817566 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.817742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.817824 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.818004 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.836586 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.836687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.836853 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.836936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.841385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.841552 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.845132 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.845364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.845468 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.845659 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.850527 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.850795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.854069 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.854431 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.857691 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.857984 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.858071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.858297 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.858382 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.858592 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.858689 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.858864 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.858949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.859134 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.859229 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.859449 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.879587 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.879688 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.879862 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.879962 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.880127 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.880261 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.880382 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.880468 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.888234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.888340 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.889921 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.890007 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.890211 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.890299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.893789 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.893886 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.894059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.894163 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.894359 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.894456 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.894634 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.894718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.894903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.894987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.908137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.908249 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.908409 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.908495 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.908682 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.908765 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.908955 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.909039 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.909227 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.909310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.910768 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.910890 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.911058 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.911152 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.929453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.929550 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.932716 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.932866 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.935998 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.936179 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.937725 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.937920 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.940002 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.940188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.940276 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.940468 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.940552 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.940754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.947791 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.948037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.949384 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.949635 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.952603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.952888 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.952975 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.953185 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.953270 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.953532 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.953614 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.953832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.962701 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.962980 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.963078 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.963255 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.963340 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.963567 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.971175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.971448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.971567 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80246) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:08:33.971718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.971844 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.971984 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.972121 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.972244 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.972399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.972613 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.972695 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.972885 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.973026 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.973164 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.973299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.973432 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.973575 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.973707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.973845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.973981 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.974147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.974264 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.974420 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.974516 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.974689 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.974772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.974954 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:33.975218 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80246) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:08:34.013189 dv-cinder-847335-3-smb devstack@keystone.service[80247]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x555a4c4659c0 pid: 80247 (default app) Jul 05 21:08:34.013846 dv-cinder-847335-3-smb devstack@keystone.service[80246]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x555a4c4659c0 pid: 80246 (default app) Jul 05 21:08:34.016824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57f30b-1a5a-437d-85cd-7387b6ee06d7 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:34.017140 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57f30b-1a5a-437d-85cd-7387b6ee06d7 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:34.017425 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57f30b-1a5a-437d-85cd-7387b6ee06d7 None None] PATH_INFO: `/v3` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:34.021565 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Tue Jul 5 21:08:34 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:42.624160 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66a8ea-3268-48d5-b80d-55d0d896f0ab None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:42.624662 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66a8ea-3268-48d5-b80d-55d0d896f0ab None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:42.624755 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66a8ea-3268-48d5-b80d-55d0d896f0ab None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:42.629711 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:08:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:08:42.635232 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d154e-db37-47d3-9231-3f6061e5c6a7 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:42.635676 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d154e-db37-47d3-9231-3f6061e5c6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:42.635798 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d154e-db37-47d3-9231-3f6061e5c6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:42.705710 dv-cinder-847335-3-smb devstack@keystone.service[80247]: INFO dbcounter [None req-360d154e-db37-47d3-9231-3f6061e5c6a7 None None] Registered counter for database keystone Jul 05 21:08:42.726595 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG oslo_db.sqlalchemy.engines [None req-360d154e-db37-47d3-9231-3f6061e5c6a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80247) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 21:08:42.732687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writer thread running {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 21:08:42.909965 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG passlib.handlers.bcrypt [None req-360d154e-db37-47d3-9231-3f6061e5c6a7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80247) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 05 21:08:42.910332 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG passlib.handlers.bcrypt [None req-360d154e-db37-47d3-9231-3f6061e5c6a7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80247) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 05 21:08:42.964640 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-360d154e-db37-47d3-9231-3f6061e5c6a7 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:42.966344 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-360d154e-db37-47d3-9231-3f6061e5c6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:43.086061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 05 21:08:43.256211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66a8ea-3268-48d5-b80d-55d0d896f0ab None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:43.326775 dv-cinder-847335-3-smb devstack@keystone.service[80246]: INFO dbcounter [None req-5f66a8ea-3268-48d5-b80d-55d0d896f0ab None None] Registered counter for database keystone Jul 05 21:08:43.346306 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG oslo_db.sqlalchemy.engines [None req-5f66a8ea-3268-48d5-b80d-55d0d896f0ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80246) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 21:08:43.352465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writer thread running {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 21:08:43.469178 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66a8ea-3268-48d5-b80d-55d0d896f0ab None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:43.474165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf9a31-3b21-46f0-adcc-0eeb9b9aa9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:43.474835 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf9a31-3b21-46f0-adcc-0eeb9b9aa9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:43.475126 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf9a31-3b21-46f0-adcc-0eeb9b9aa9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:43.475406 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf9a31-3b21-46f0-adcc-0eeb9b9aa9a0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:43.483637 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf9a31-3b21-46f0-adcc-0eeb9b9aa9a0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:43.535856 dv-cinder-847335-3-smb devstack@keystone.service[80246]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e3cf9a31-3b21-46f0-adcc-0eeb9b9aa9a0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 05 21:08:43.536197 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf9a31-3b21-46f0-adcc-0eeb9b9aa9a0 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:43.545718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1324 bytes} [Tue Jul 5 21:08:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 21:08:43.552521 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d154e-db37-47d3-9231-3f6061e5c6a7 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:43.567087 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d154e-db37-47d3-9231-3f6061e5c6a7 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:43.571529 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6244f9-2c1e-4ce9-b20d-03b12844c4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:43.572684 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6244f9-2c1e-4ce9-b20d-03b12844c4da admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:43.572971 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6244f9-2c1e-4ce9-b20d-03b12844c4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:43.573252 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6244f9-2c1e-4ce9-b20d-03b12844c4da admin admin] PATH_INFO: `/v3/projects/c475db16707f46ecb5780cbec2330b6e` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:43.577347 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6244f9-2c1e-4ce9-b20d-03b12844c4da admin admin] RBAC: Authorizing `identity:get_project(project_id=c475db16707f46ecb5780cbec2330b6e)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:43.628713 dv-cinder-847335-3-smb devstack@keystone.service[80247]: WARNING keystone.common.rbac_enforcer.enforcer [None req-eb6244f9-2c1e-4ce9-b20d-03b12844c4da admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 05 21:08:43.629058 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6244f9-2c1e-4ce9-b20d-03b12844c4da admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:43.633660 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 3/5] 10.222.0.13 () {56 vars in 1207 bytes} [Tue Jul 5 21:08:43 2022] GET /identity/v3/projects/c475db16707f46ecb5780cbec2330b6e => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:45.631067 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063ea4d-8a65-4da3-9d06-5d0e96377a63 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:45.631534 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063ea4d-8a65-4da3-9d06-5d0e96377a63 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:45.631622 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063ea4d-8a65-4da3-9d06-5d0e96377a63 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:45.635688 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 3/6] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:08:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:45.640903 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b5fdc-e064-4f63-a96e-0083c5f8fb94 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:45.641308 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b5fdc-e064-4f63-a96e-0083c5f8fb94 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:45.641471 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b5fdc-e064-4f63-a96e-0083c5f8fb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:45.660760 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-c17b5fdc-e064-4f63-a96e-0083c5f8fb94 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:45.662326 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c17b5fdc-e064-4f63-a96e-0083c5f8fb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:45.670133 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 05 21:08:45.692554 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063ea4d-8a65-4da3-9d06-5d0e96377a63 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:45.704478 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063ea4d-8a65-4da3-9d06-5d0e96377a63 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:45.708703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0043a3f-a95d-4f63-a77c-982faef6d388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:45.709321 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0043a3f-a95d-4f63-a77c-982faef6d388 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:45.709603 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0043a3f-a95d-4f63-a77c-982faef6d388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:45.709875 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0043a3f-a95d-4f63-a77c-982faef6d388 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:45.717439 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0043a3f-a95d-4f63-a77c-982faef6d388 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:45.719230 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0043a3f-a95d-4f63-a77c-982faef6d388 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:45.728449 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1324 bytes} [Tue Jul 5 21:08:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 21:08:45.733625 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b5fdc-e064-4f63-a96e-0083c5f8fb94 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:45.743361 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b5fdc-e064-4f63-a96e-0083c5f8fb94 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:45.747751 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4cafc0-b1ff-49af-98cd-3d0d3734f056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:45.748609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4cafc0-b1ff-49af-98cd-3d0d3734f056 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:45.748893 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4cafc0-b1ff-49af-98cd-3d0d3734f056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:45.749171 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4cafc0-b1ff-49af-98cd-3d0d3734f056 admin admin] PATH_INFO: `/v3/users/01e24880ba10472b96df6cd13c234ba0` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:45.750585 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4cafc0-b1ff-49af-98cd-3d0d3734f056 admin admin] RBAC: Authorizing `identity:get_user(user_id=01e24880ba10472b96df6cd13c234ba0)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:45.752440 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4cafc0-b1ff-49af-98cd-3d0d3734f056 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:45.753992 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 5/9] 10.222.0.13 () {56 vars in 1198 bytes} [Tue Jul 5 21:08:45 2022] GET /identity/v3/users/01e24880ba10472b96df6cd13c234ba0 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:47.814357 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e69586-46ee-4a9e-9f4d-021cea4ba519 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:47.814906 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e69586-46ee-4a9e-9f4d-021cea4ba519 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:47.814906 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e69586-46ee-4a9e-9f4d-021cea4ba519 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:47.816236 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:08:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:47.821271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a122765-4b0b-420d-a31a-8255d5e47f10 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:47.821690 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a122765-4b0b-420d-a31a-8255d5e47f10 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:47.821841 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a122765-4b0b-420d-a31a-8255d5e47f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:47.839043 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-2a122765-4b0b-420d-a31a-8255d5e47f10 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:47.840238 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2a122765-4b0b-420d-a31a-8255d5e47f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:47.858900 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0b70a-3ec7-42d2-923f-6a9489ef15a5 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:47.859117 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0b70a-3ec7-42d2-923f-6a9489ef15a5 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:47.859389 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0b70a-3ec7-42d2-923f-6a9489ef15a5 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:47.860763 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 6/11] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:47.865671 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde228c8-a373-49f1-9d5e-d7cff03ec5d9 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:47.865961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde228c8-a373-49f1-9d5e-d7cff03ec5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:47.866272 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde228c8-a373-49f1-9d5e-d7cff03ec5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:47.905840 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG passlib.handlers.bcrypt [None req-cde228c8-a373-49f1-9d5e-d7cff03ec5d9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80246) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 05 21:08:47.906283 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG passlib.handlers.bcrypt [None req-cde228c8-a373-49f1-9d5e-d7cff03ec5d9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80246) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 05 21:08:47.921874 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 6/12] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:47.945427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a122765-4b0b-420d-a31a-8255d5e47f10 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:47.951979 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-cde228c8-a373-49f1-9d5e-d7cff03ec5d9 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:47.953575 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-cde228c8-a373-49f1-9d5e-d7cff03ec5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:47.968980 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:48.048929 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a122765-4b0b-420d-a31a-8255d5e47f10 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:48.052900 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 7/13] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:48.075587 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde228c8-a373-49f1-9d5e-d7cff03ec5d9 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:48.082922 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd84a00-7be7-4f85-be00-f0a8eb030df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:48.083745 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd84a00-7be7-4f85-be00-f0a8eb030df6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:48.084033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd84a00-7be7-4f85-be00-f0a8eb030df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:48.084318 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd84a00-7be7-4f85-be00-f0a8eb030df6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:48.095747 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd84a00-7be7-4f85-be00-f0a8eb030df6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:48.107113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-4cd84a00-7be7-4f85-be00-f0a8eb030df6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:08:48.107113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:48.107113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:48.107113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:48.107113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:48.107113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:48.107113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:48.107113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:48.107113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:48.107113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:48.107113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:48.107113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:48.107113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:48.107113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:48.107113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:48.107113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:48.108036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:48.108036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:48.108036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:48.108036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:48.108036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:48.108036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:48.108036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:48.108036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:48.108036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:48.108036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:48.108036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:48.108036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:48.108036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:48.108036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:48.108036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:48.108036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:48.108987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:48.108987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:48.108987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:48.108987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:48.108987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:48.108987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:48.108987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:48.108987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:48.108987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:48.108987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:48.108987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:08:48.108987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:08:48.108987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 7/14] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:08:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:08:48.114571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd84a00-7be7-4f85-be00-f0a8eb030df6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:48.173874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde228c8-a373-49f1-9d5e-d7cff03ec5d9 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:48.176154 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:48.195676 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:48.210490 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040b940-55e0-4817-b9f5-368f91f1c8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:48.211381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040b940-55e0-4817-b9f5-368f91f1c8db None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:48.211667 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040b940-55e0-4817-b9f5-368f91f1c8db None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:48.211944 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040b940-55e0-4817-b9f5-368f91f1c8db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:48.212968 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd84a00-7be7-4f85-be00-f0a8eb030df6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:48.247102 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67def8c-a178-4a58-b246-6cb9b7fabee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:48.247870 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67def8c-a178-4a58-b246-6cb9b7fabee1 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:48.248158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67def8c-a178-4a58-b246-6cb9b7fabee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:48.248435 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67def8c-a178-4a58-b246-6cb9b7fabee1 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:48.249184 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67def8c-a178-4a58-b246-6cb9b7fabee1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:48.249492 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67def8c-a178-4a58-b246-6cb9b7fabee1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:48.250940 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67def8c-a178-4a58-b246-6cb9b7fabee1 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:48.264295 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 8/15] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:08:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:48.270109 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67def8c-a178-4a58-b246-6cb9b7fabee1 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:48.283988 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040b940-55e0-4817-b9f5-368f91f1c8db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:48.285519 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040b940-55e0-4817-b9f5-368f91f1c8db None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:48.366176 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67def8c-a178-4a58-b246-6cb9b7fabee1 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:48.384618 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 8/16] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:08:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 21:08:48.390107 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040b940-55e0-4817-b9f5-368f91f1c8db None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:48.393135 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:48.400498 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed4ed7-a11b-40bc-a50c-e2422dac38b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:48.401372 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed4ed7-a11b-40bc-a50c-e2422dac38b5 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:48.401664 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed4ed7-a11b-40bc-a50c-e2422dac38b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:48.401943 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed4ed7-a11b-40bc-a50c-e2422dac38b5 None admin] PATH_INFO: `/v3/users/01e24880ba10472b96df6cd13c234ba0` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:48.403198 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed4ed7-a11b-40bc-a50c-e2422dac38b5 None admin] RBAC: Authorizing `identity:get_user(user_id=01e24880ba10472b96df6cd13c234ba0)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:48.405410 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed4ed7-a11b-40bc-a50c-e2422dac38b5 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:48.406286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 9/17] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:08:48 2022] GET /identity/v3/users/01e24880ba10472b96df6cd13c234ba0 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:48.412429 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed4ed7-a11b-40bc-a50c-e2422dac38b5 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:48.427572 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:48.491714 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040b940-55e0-4817-b9f5-368f91f1c8db None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:48.510977 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed4ed7-a11b-40bc-a50c-e2422dac38b5 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:48.525155 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1f4e0-33b3-47e9-b6c8-c66957bbec7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:48.525951 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1f4e0-33b3-47e9-b6c8-c66957bbec7a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:48.526265 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1f4e0-33b3-47e9-b6c8-c66957bbec7a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:48.526549 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1f4e0-33b3-47e9-b6c8-c66957bbec7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:48.545311 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a44012-82ad-4a0f-9a60-a6d529d0db3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:48.546105 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a44012-82ad-4a0f-9a60-a6d529d0db3c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:48.546417 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a44012-82ad-4a0f-9a60-a6d529d0db3c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:48.546693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a44012-82ad-4a0f-9a60-a6d529d0db3c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:48.547325 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb1f4e0-33b3-47e9-b6c8-c66957bbec7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:48.547924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a44012-82ad-4a0f-9a60-a6d529d0db3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:48.549415 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb1f4e0-33b3-47e9-b6c8-c66957bbec7a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:48.549931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a44012-82ad-4a0f-9a60-a6d529d0db3c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:48.551597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 10/18] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:48.557388 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a44012-82ad-4a0f-9a60-a6d529d0db3c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:48.570080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-dbb1f4e0-33b3-47e9-b6c8-c66957bbec7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:48.570080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:48.570080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:48.570080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:48.570080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:48.570080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:48.570080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:48.570080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:48.570080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:48.570080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:48.570080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:48.570080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:48.570080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:48.570080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:48.570080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:48.571115 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:48.571115 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:48.571115 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:48.571115 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:48.571115 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:48.571115 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:48.571115 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:48.571115 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:48.571115 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:48.571115 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:48.571115 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:48.571115 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:48.571115 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:48.571115 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:48.571115 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:48.571115 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:48.571115 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:48.571933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:48.571933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:48.571933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:48.571933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:08:48.571933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 9/19] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:08:48.578053 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1f4e0-33b3-47e9-b6c8-c66957bbec7a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:48.639398 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:48.640404 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:48.659579 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a44012-82ad-4a0f-9a60-a6d529d0db3c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:48.683854 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1f4e0-33b3-47e9-b6c8-c66957bbec7a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:48.693192 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d521f51-cb11-4174-8d21-1a6304a360b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:48.693845 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d521f51-cb11-4174-8d21-1a6304a360b7 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:48.694141 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d521f51-cb11-4174-8d21-1a6304a360b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:48.694437 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d521f51-cb11-4174-8d21-1a6304a360b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:48.695278 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d521f51-cb11-4174-8d21-1a6304a360b7 None admin] RBAC: Adding query filter params (role.id=15cf04fec8c6477088a33bf286f1bbdb, scope.domain.id=default, user.id=01e24880ba10472b96df6cd13c234ba0) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:48.695588 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d521f51-cb11-4174-8d21-1a6304a360b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:48.697040 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d521f51-cb11-4174-8d21-1a6304a360b7 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:48.706396 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 11/20] 10.222.0.13 () {56 vars in 1322 bytes} [Tue Jul 5 21:08:48 2022] GET /identity/v3/role_assignments?user.id=01e24880ba10472b96df6cd13c234ba0&scope.domain.id=default&role.id=15cf04fec8c6477088a33bf286f1bbdb => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:48.720580 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4d521-79ac-44ba-955b-23b3dfad6af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:48.721535 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4d521-79ac-44ba-955b-23b3dfad6af2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:48.721821 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4d521-79ac-44ba-955b-23b3dfad6af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:48.722098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4d521-79ac-44ba-955b-23b3dfad6af2 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:48.722879 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4d521-79ac-44ba-955b-23b3dfad6af2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:48.723188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4d521-79ac-44ba-955b-23b3dfad6af2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:48.724626 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4d521-79ac-44ba-955b-23b3dfad6af2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:48.747221 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 10/21] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:51.092045 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbae4c-02ab-4179-babf-b718fda6839f None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:51.092558 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbae4c-02ab-4179-babf-b718fda6839f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:51.092631 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbae4c-02ab-4179-babf-b718fda6839f None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:51.094257 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 12/22] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:51.099883 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3362ee-138b-4e05-b11c-2215bdd8956c None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:51.100720 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3362ee-138b-4e05-b11c-2215bdd8956c None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:51.101188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3362ee-138b-4e05-b11c-2215bdd8956c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:51.123174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-6a3362ee-138b-4e05-b11c-2215bdd8956c None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:51.124732 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6a3362ee-138b-4e05-b11c-2215bdd8956c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:51.187859 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645541df-ad49-449d-824f-3c7e2e9cb5ef None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:51.188544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645541df-ad49-449d-824f-3c7e2e9cb5ef None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:51.189213 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645541df-ad49-449d-824f-3c7e2e9cb5ef None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:51.191208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 13/23] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:08:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:51.202182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67393cb3-5f06-4ae8-ae9b-cbc84489c73b None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:51.202770 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67393cb3-5f06-4ae8-ae9b-cbc84489c73b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:51.203261 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67393cb3-5f06-4ae8-ae9b-cbc84489c73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:51.208689 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 11/24] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:51.234079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3362ee-138b-4e05-b11c-2215bdd8956c None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:51.243138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-67393cb3-5f06-4ae8-ae9b-cbc84489c73b None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:51.244340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-67393cb3-5f06-4ae8-ae9b-cbc84489c73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:51.302597 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:51.349555 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3362ee-138b-4e05-b11c-2215bdd8956c None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:51.386068 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63917de4-a405-4167-a6e1-8df316b4aee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:51.387276 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63917de4-a405-4167-a6e1-8df316b4aee7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:51.387752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63917de4-a405-4167-a6e1-8df316b4aee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:51.388215 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63917de4-a405-4167-a6e1-8df316b4aee7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:51.388832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 14/25] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 05 21:08:51.400461 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63917de4-a405-4167-a6e1-8df316b4aee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:51.402239 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63917de4-a405-4167-a6e1-8df316b4aee7 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:51.421050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-63917de4-a405-4167-a6e1-8df316b4aee7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:51.421050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:51.421050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:51.421050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:51.421050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:51.421050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:51.421050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:51.421050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:51.421050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:51.421050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:51.421050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:51.421050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:51.421050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:51.421050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:51.421050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:51.421911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:51.421911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:51.421911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:51.421911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:51.421911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:51.421911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:51.421911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:51.421911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:51.421911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:51.421911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:51.421911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:51.421911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:51.421911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:51.421911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:51.421911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:51.421911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:51.421911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:51.422799 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:51.422799 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:51.422799 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:51.422799 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:08:51.423002 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67393cb3-5f06-4ae8-ae9b-cbc84489c73b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:51.424961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 12/26] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:08:51.431688 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63917de4-a405-4167-a6e1-8df316b4aee7 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:51.548539 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:51.592885 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67393cb3-5f06-4ae8-ae9b-cbc84489c73b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:51.603807 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63917de4-a405-4167-a6e1-8df316b4aee7 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:51.618491 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:51.639801 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c017a3-57ec-4a0d-a13b-177ee4849d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:51.640780 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c017a3-57ec-4a0d-a13b-177ee4849d91 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:51.641219 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c017a3-57ec-4a0d-a13b-177ee4849d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:51.642439 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c017a3-57ec-4a0d-a13b-177ee4849d91 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:51.643572 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c017a3-57ec-4a0d-a13b-177ee4849d91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:51.644223 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c017a3-57ec-4a0d-a13b-177ee4849d91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:51.645810 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c017a3-57ec-4a0d-a13b-177ee4849d91 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:51.659624 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 13/27] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:51.661220 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b283196-5091-4517-94df-d8b9ef39f654 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:51.661702 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b283196-5091-4517-94df-d8b9ef39f654 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:51.662211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b283196-5091-4517-94df-d8b9ef39f654 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:51.663633 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 14/28] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:51.663734 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9ed0a-3838-46cd-bf30-f5a903031f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:51.664546 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9ed0a-3838-46cd-bf30-f5a903031f7f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:51.664890 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9ed0a-3838-46cd-bf30-f5a903031f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:51.665356 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9ed0a-3838-46cd-bf30-f5a903031f7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:51.668131 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b283196-5091-4517-94df-d8b9ef39f654 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:51.687171 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd9ed0a-3838-46cd-bf30-f5a903031f7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:51.705063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-ebd9ed0a-3838-46cd-bf30-f5a903031f7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:08:51.705063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:51.705063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:51.705063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:51.705063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:51.705063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:51.705063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:51.705063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:51.705063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:51.705063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:51.705063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:51.705063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:51.705063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:51.705063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:51.705063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:51.705063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:51.706148 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:51.706148 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:51.706148 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:51.706148 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:51.706148 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:51.706148 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:51.706148 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:51.706148 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:51.706148 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:51.706148 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:51.706148 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:51.706148 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:51.706148 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:51.706148 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:51.706148 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:51.706148 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:51.706927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:51.706927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:51.706927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:51.706927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:51.706927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:51.706927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:51.706927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:51.706927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:51.706927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:51.706927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:51.706927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:08:51.706927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:08:51.706927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 15/29] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:08:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:08:51.708312 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c484ac-f345-42df-bd86-d967b6989eeb None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:51.708312 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c484ac-f345-42df-bd86-d967b6989eeb None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:51.708470 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c484ac-f345-42df-bd86-d967b6989eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:51.751737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d3c484ac-f345-42df-bd86-d967b6989eeb None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:51.753207 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d3c484ac-f345-42df-bd86-d967b6989eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:51.785486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b283196-5091-4517-94df-d8b9ef39f654 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:51.853164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81475c2d-7f7d-4d29-b109-98b40e9f2b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:51.853889 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81475c2d-7f7d-4d29-b109-98b40e9f2b7e None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:51.854174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81475c2d-7f7d-4d29-b109-98b40e9f2b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:51.854425 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81475c2d-7f7d-4d29-b109-98b40e9f2b7e None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:51.855391 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81475c2d-7f7d-4d29-b109-98b40e9f2b7e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:51.856839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81475c2d-7f7d-4d29-b109-98b40e9f2b7e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:51.869226 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 16/30] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:51.870668 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c484ac-f345-42df-bd86-d967b6989eeb None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:51.940512 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:51.986211 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c484ac-f345-42df-bd86-d967b6989eeb None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:52.025561 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74d1ee-0d63-423b-91f7-325924369116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:52.026328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74d1ee-0d63-423b-91f7-325924369116 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:52.026613 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74d1ee-0d63-423b-91f7-325924369116 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:52.026938 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74d1ee-0d63-423b-91f7-325924369116 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:52.027750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74d1ee-0d63-423b-91f7-325924369116 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:52.028156 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74d1ee-0d63-423b-91f7-325924369116 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:52.029704 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74d1ee-0d63-423b-91f7-325924369116 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:52.038893 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 17/31] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:08:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:52.040130 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c267327-c5b4-45b4-8d8f-7391b0a8521f None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:52.040423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c267327-c5b4-45b4-8d8f-7391b0a8521f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:52.040706 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c267327-c5b4-45b4-8d8f-7391b0a8521f None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:52.042091 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 18/32] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:52.042791 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c267327-c5b4-45b4-8d8f-7391b0a8521f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:52.090944 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 15/33] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Jul 5 21:08:51 2022] POST /identity/v3/projects => generated 301 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:08:52.092294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81475c2d-7f7d-4d29-b109-98b40e9f2b7e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:52.107437 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:52.176048 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c267327-c5b4-45b4-8d8f-7391b0a8521f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:52.208570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:52.217904 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e63e0-78cf-4720-9b3e-384aef364c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:52.218957 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e63e0-78cf-4720-9b3e-384aef364c68 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:52.219492 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e63e0-78cf-4720-9b3e-384aef364c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:52.220559 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e63e0-78cf-4720-9b3e-384aef364c68 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:52.221581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e63e0-78cf-4720-9b3e-384aef364c68 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:52.223524 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e63e0-78cf-4720-9b3e-384aef364c68 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:52.225872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81475c2d-7f7d-4d29-b109-98b40e9f2b7e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:52.265866 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4b893-0b24-4996-bfdf-19aaf9fb3755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:52.267127 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4b893-0b24-4996-bfdf-19aaf9fb3755 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:52.267500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4b893-0b24-4996-bfdf-19aaf9fb3755 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:52.267828 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4b893-0b24-4996-bfdf-19aaf9fb3755 None admin] PATH_INFO: `/v3/users/01e24880ba10472b96df6cd13c234ba0` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:52.269587 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4b893-0b24-4996-bfdf-19aaf9fb3755 None admin] RBAC: Authorizing `identity:get_user(user_id=01e24880ba10472b96df6cd13c234ba0)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:52.271229 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4b893-0b24-4996-bfdf-19aaf9fb3755 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:52.273119 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 16/34] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:08:52 2022] GET /identity/v3/users/01e24880ba10472b96df6cd13c234ba0 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:52.274464 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e35538-239a-4e38-93e1-f1e4407908bb None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:52.274753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e35538-239a-4e38-93e1-f1e4407908bb None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:52.275038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e35538-239a-4e38-93e1-f1e4407908bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:52.298412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-18e35538-239a-4e38-93e1-f1e4407908bb None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:52.300286 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-18e35538-239a-4e38-93e1-f1e4407908bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:52.386103 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 17/35] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:52.387456 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e35538-239a-4e38-93e1-f1e4407908bb None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:52.399541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:52.498525 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e35538-239a-4e38-93e1-f1e4407908bb None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:52.511247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 19/36] 10.222.0.13 () {60 vars in 1131 bytes} [Tue Jul 5 21:08:52 2022] POST /identity/v3/roles => generated 225 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:08:52.512235 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e63e0-78cf-4720-9b3e-384aef364c68 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:52.544105 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec730da0-c4c7-41e8-b479-f837d7dc87ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:52.545477 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec730da0-c4c7-41e8-b479-f837d7dc87ae None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:52.546142 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec730da0-c4c7-41e8-b479-f837d7dc87ae None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:52.546597 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec730da0-c4c7-41e8-b479-f837d7dc87ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:52.549227 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec730da0-c4c7-41e8-b479-f837d7dc87ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:52.551973 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec730da0-c4c7-41e8-b479-f837d7dc87ae None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:52.554575 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 18/37] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:52.559706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec730da0-c4c7-41e8-b479-f837d7dc87ae None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:52.642463 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e63e0-78cf-4720-9b3e-384aef364c68 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:52.677384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:52.690183 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e78085-09df-4ebc-9d40-96cd01234baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:52.691170 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e78085-09df-4ebc-9d40-96cd01234baa None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:52.691651 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e78085-09df-4ebc-9d40-96cd01234baa None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:52.692099 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e78085-09df-4ebc-9d40-96cd01234baa None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:52.693049 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e78085-09df-4ebc-9d40-96cd01234baa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:52.694869 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e78085-09df-4ebc-9d40-96cd01234baa None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:52.708597 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec730da0-c4c7-41e8-b479-f837d7dc87ae None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:52.746599 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65b0fd-a499-422a-bfed-537eb7f781b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:52.747810 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65b0fd-a499-422a-bfed-537eb7f781b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:52.748320 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65b0fd-a499-422a-bfed-537eb7f781b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:52.748831 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65b0fd-a499-422a-bfed-537eb7f781b8 None admin] PATH_INFO: `/v3/domains/default/users/01e24880ba10472b96df6cd13c234ba0/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:52.750935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65b0fd-a499-422a-bfed-537eb7f781b8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=01e24880ba10472b96df6cd13c234ba0, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:52.752496 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65b0fd-a499-422a-bfed-537eb7f781b8 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:52.795190 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 20/38] 10.222.0.13 () {60 vars in 1131 bytes} [Tue Jul 5 21:08:52 2022] POST /identity/v3/roles => generated 219 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:08:52.796551 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166daf8-7ff4-4a5d-a565-85955b06e102 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:52.796842 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166daf8-7ff4-4a5d-a565-85955b06e102 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:52.797119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166daf8-7ff4-4a5d-a565-85955b06e102 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:52.798399 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 21/39] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:52.799451 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9d4c0-57b0-4268-be53-60a4949dfb10 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:52.799745 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9d4c0-57b0-4268-be53-60a4949dfb10 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:52.800026 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9d4c0-57b0-4268-be53-60a4949dfb10 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:52.801419 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 22/40] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:08:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:52.804069 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379ab9b-3944-45d9-bf1d-774f981d2eef None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:52.804365 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379ab9b-3944-45d9-bf1d-774f981d2eef None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:52.804682 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379ab9b-3944-45d9-bf1d-774f981d2eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:52.823916 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-4379ab9b-3944-45d9-bf1d-774f981d2eef None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:52.825544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4379ab9b-3944-45d9-bf1d-774f981d2eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:52.862438 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 19/41] 10.222.0.13 () {58 vars in 1361 bytes} [Tue Jul 5 21:08:52 2022] PUT /identity/v3/domains/default/users/01e24880ba10472b96df6cd13c234ba0/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:08:52.862438 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737818c6-258c-4827-aaa5-1de4aa7ccd6f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:52.862438 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737818c6-258c-4827-aaa5-1de4aa7ccd6f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:52.862438 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737818c6-258c-4827-aaa5-1de4aa7ccd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:52.880645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-737818c6-258c-4827-aaa5-1de4aa7ccd6f None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:52.881982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-737818c6-258c-4827-aaa5-1de4aa7ccd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:52.887793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:52.920295 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 23/42] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:08:52.944506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379ab9b-3944-45d9-bf1d-774f981d2eef None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:52.976633 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 20/43] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:52.999913 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737818c6-258c-4827-aaa5-1de4aa7ccd6f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:53.075260 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379ab9b-3944-45d9-bf1d-774f981d2eef None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:53.077467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:53.111378 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b94c3-aa13-4a34-bcc7-ed4e9bdf87de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:53.112045 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b94c3-aa13-4a34-bcc7-ed4e9bdf87de None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:53.112333 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b94c3-aa13-4a34-bcc7-ed4e9bdf87de None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:53.112714 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b94c3-aa13-4a34-bcc7-ed4e9bdf87de None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:53.113353 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b94c3-aa13-4a34-bcc7-ed4e9bdf87de None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:53.114782 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b94c3-aa13-4a34-bcc7-ed4e9bdf87de None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:53.114880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737818c6-258c-4827-aaa5-1de4aa7ccd6f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:53.149589 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef2424-ed51-4125-bccd-270cf9ac16ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:53.150412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef2424-ed51-4125-bccd-270cf9ac16ff None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:53.150816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef2424-ed51-4125-bccd-270cf9ac16ff None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:53.151095 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef2424-ed51-4125-bccd-270cf9ac16ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:53.152266 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef2424-ed51-4125-bccd-270cf9ac16ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:53.153724 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef2424-ed51-4125-bccd-270cf9ac16ff None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:53.155584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 21/44] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:53.160868 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef2424-ed51-4125-bccd-270cf9ac16ff None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:53.221987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 24/45] 10.222.0.13 () {60 vars in 1131 bytes} [Tue Jul 5 21:08:52 2022] POST /identity/v3/roles => generated 223 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:08:53.269148 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef2424-ed51-4125-bccd-270cf9ac16ff None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:53.306233 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000189d3-d128-4134-b1f5-8a12713aca89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:53.307094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000189d3-d128-4134-b1f5-8a12713aca89 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:53.307474 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000189d3-d128-4134-b1f5-8a12713aca89 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:53.307845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000189d3-d128-4134-b1f5-8a12713aca89 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:53.308700 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000189d3-d128-4134-b1f5-8a12713aca89 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:53.310302 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000189d3-d128-4134-b1f5-8a12713aca89 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:53.314869 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:53.411293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 22/46] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Jul 5 21:08:53 2022] POST /identity/v3/projects => generated 312 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:08:54.946943 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8b269-2b32-40df-96d7-14f67af47030 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:54.947433 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8b269-2b32-40df-96d7-14f67af47030 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:54.947433 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8b269-2b32-40df-96d7-14f67af47030 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:54.948805 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 25/47] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:54.953945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bbda1-2020-4209-bcd0-aba30cef8d09 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:54.954793 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bbda1-2020-4209-bcd0-aba30cef8d09 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:54.954793 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bbda1-2020-4209-bcd0-aba30cef8d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:54.971450 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-fb5bbda1-2020-4209-bcd0-aba30cef8d09 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:54.972634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-fb5bbda1-2020-4209-bcd0-aba30cef8d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:55.143916 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 23/48] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:55.166683 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8b269-2b32-40df-96d7-14f67af47030 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:55.203649 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:55.373473 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8b269-2b32-40df-96d7-14f67af47030 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:55.408204 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0cf86-4338-4068-a49e-3a70caab52eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:55.408994 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0cf86-4338-4068-a49e-3a70caab52eb None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:55.409281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0cf86-4338-4068-a49e-3a70caab52eb None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:55.409563 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0cf86-4338-4068-a49e-3a70caab52eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:55.420038 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0cf86-4338-4068-a49e-3a70caab52eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:55.427832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-25d0cf86-4338-4068-a49e-3a70caab52eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:08:55.427832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:55.427832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:55.427832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:55.427832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:55.427832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:55.427832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:55.427832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:55.427832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:55.427832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:55.427832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:55.427832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:55.427832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:55.427832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:55.427832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:55.427832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:55.428822 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:55.428822 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:55.428822 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:55.428822 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:55.428822 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:55.428822 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:55.428822 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:55.428822 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:55.428822 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:55.428822 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:55.428822 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:55.428822 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:55.428822 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:55.428822 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:55.428822 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:55.428822 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:55.429785 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:55.429785 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:55.429785 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:55.429785 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:55.429785 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:55.429785 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:55.429785 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:55.429785 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:55.429785 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:55.429785 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:55.429785 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:08:55.429785 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:08:55.429785 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 26/49] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:08:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:55.434850 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bbda1-2020-4209-bcd0-aba30cef8d09 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:55.486217 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5791d-31a7-4575-a89b-b5d9768518d4 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:55.486443 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5791d-31a7-4575-a89b-b5d9768518d4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:55.486730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5791d-31a7-4575-a89b-b5d9768518d4 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:55.488246 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 27/50] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:08:55.492796 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8622af3-bc7e-4c75-ad00-df2d745b8b43 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:55.493086 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8622af3-bc7e-4c75-ad00-df2d745b8b43 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:55.493369 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8622af3-bc7e-4c75-ad00-df2d745b8b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:55.511241 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f8622af3-bc7e-4c75-ad00-df2d745b8b43 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:55.511465 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f8622af3-bc7e-4c75-ad00-df2d745b8b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:55.534070 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bbda1-2020-4209-bcd0-aba30cef8d09 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:55.552050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:55.570352 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b96c42-56ba-46e5-95af-69a5351fbb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:55.571027 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b96c42-56ba-46e5-95af-69a5351fbb56 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:55.571309 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b96c42-56ba-46e5-95af-69a5351fbb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:55.571588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b96c42-56ba-46e5-95af-69a5351fbb56 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:55.572339 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b96c42-56ba-46e5-95af-69a5351fbb56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:55.572653 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b96c42-56ba-46e5-95af-69a5351fbb56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:55.574140 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b96c42-56ba-46e5-95af-69a5351fbb56 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:55.580506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 28/51] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:08:55.588244 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 24/52] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:08:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:55.593950 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8622af3-bc7e-4c75-ad00-df2d745b8b43 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:55.604293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b96c42-56ba-46e5-95af-69a5351fbb56 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:55.622830 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:55.697799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8622af3-bc7e-4c75-ad00-df2d745b8b43 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:55.704774 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b96c42-56ba-46e5-95af-69a5351fbb56 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:55.731669 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffbad2f-5b62-4504-ae49-aa53ede88c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:55.732541 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbad2f-5b62-4504-ae49-aa53ede88c3e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:55.732825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbad2f-5b62-4504-ae49-aa53ede88c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:55.733101 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbad2f-5b62-4504-ae49-aa53ede88c3e None admin] PATH_INFO: `/v3/users/01e24880ba10472b96df6cd13c234ba0` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:55.734333 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffbad2f-5b62-4504-ae49-aa53ede88c3e None admin] RBAC: Authorizing `identity:get_user(user_id=01e24880ba10472b96df6cd13c234ba0)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:55.736439 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffbad2f-5b62-4504-ae49-aa53ede88c3e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:55.737932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 29/53] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:08:55 2022] GET /identity/v3/users/01e24880ba10472b96df6cd13c234ba0 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:55.740215 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff56be7-c4d2-4fb5-8385-d6b0593f497e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:55.746851 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff56be7-c4d2-4fb5-8385-d6b0593f497e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:55.746851 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff56be7-c4d2-4fb5-8385-d6b0593f497e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:55.746851 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff56be7-c4d2-4fb5-8385-d6b0593f497e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:55.746851 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff56be7-c4d2-4fb5-8385-d6b0593f497e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:55.747457 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffbad2f-5b62-4504-ae49-aa53ede88c3e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:55.747569 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff56be7-c4d2-4fb5-8385-d6b0593f497e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:55.747569 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 25/54] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:55.752034 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff56be7-c4d2-4fb5-8385-d6b0593f497e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:55.799989 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:55.835720 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:55.842219 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffbad2f-5b62-4504-ae49-aa53ede88c3e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:55.851943 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff56be7-c4d2-4fb5-8385-d6b0593f497e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:55.876654 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4be1e-84a2-444e-b171-59215074b35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:55.877454 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4be1e-84a2-444e-b171-59215074b35f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:55.877737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4be1e-84a2-444e-b171-59215074b35f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:55.878017 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4be1e-84a2-444e-b171-59215074b35f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:55.879285 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4be1e-84a2-444e-b171-59215074b35f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:55.880790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4be1e-84a2-444e-b171-59215074b35f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:55.882679 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 30/55] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:55.887319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702d174-d96b-44d0-971d-22a71f82b4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:55.887984 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702d174-d96b-44d0-971d-22a71f82b4dc None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:55.888094 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4be1e-84a2-444e-b171-59215074b35f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:55.888273 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702d174-d96b-44d0-971d-22a71f82b4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:55.888553 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702d174-d96b-44d0-971d-22a71f82b4dc None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:55.889266 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702d174-d96b-44d0-971d-22a71f82b4dc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:55.890844 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702d174-d96b-44d0-971d-22a71f82b4dc None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:55.966786 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 26/56] 10.222.0.13 () {60 vars in 1140 bytes} [Tue Jul 5 21:08:55 2022] POST /identity/v3/projects => generated 298 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:08:55.991659 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4be1e-84a2-444e-b171-59215074b35f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:56.028927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc5198-86e0-44bf-be39-5a6d3730da5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:56.029605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc5198-86e0-44bf-be39-5a6d3730da5b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:56.029891 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc5198-86e0-44bf-be39-5a6d3730da5b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:56.030203 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc5198-86e0-44bf-be39-5a6d3730da5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:56.031059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc5198-86e0-44bf-be39-5a6d3730da5b None admin] RBAC: Adding query filter params (role.id=15cf04fec8c6477088a33bf286f1bbdb, scope.domain.id=default, user.id=01e24880ba10472b96df6cd13c234ba0) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:56.031367 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc5198-86e0-44bf-be39-5a6d3730da5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:56.033531 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc5198-86e0-44bf-be39-5a6d3730da5b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:56.040177 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 31/57] 10.222.0.13 () {56 vars in 1322 bytes} [Tue Jul 5 21:08:55 2022] GET /identity/v3/role_assignments?user.id=01e24880ba10472b96df6cd13c234ba0&scope.domain.id=default&role.id=15cf04fec8c6477088a33bf286f1bbdb => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:57.993978 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3bd65-e66a-4243-a6cb-f9a97af0b666 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:57.994509 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3bd65-e66a-4243-a6cb-f9a97af0b666 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:57.994509 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3bd65-e66a-4243-a6cb-f9a97af0b666 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:57.995858 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 27/58] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:58.001378 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4670b-7251-4793-8548-1fdeccbd82c5 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:58.001828 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4670b-7251-4793-8548-1fdeccbd82c5 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:58.002134 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4670b-7251-4793-8548-1fdeccbd82c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:58.018800 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-17b4670b-7251-4793-8548-1fdeccbd82c5 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:58.019982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-17b4670b-7251-4793-8548-1fdeccbd82c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:58.039346 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:58.084339 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 32/59] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:58.108289 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3bd65-e66a-4243-a6cb-f9a97af0b666 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:58.203450 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:58.207798 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3bd65-e66a-4243-a6cb-f9a97af0b666 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:58.242222 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b57912-9877-4b51-af44-8da6e6189c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:58.242998 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b57912-9877-4b51-af44-8da6e6189c9d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:58.243285 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b57912-9877-4b51-af44-8da6e6189c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:58.243563 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b57912-9877-4b51-af44-8da6e6189c9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:58.244777 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b57912-9877-4b51-af44-8da6e6189c9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:58.246247 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b57912-9877-4b51-af44-8da6e6189c9d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:58.247833 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 28/60] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:58.253328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4670b-7251-4793-8548-1fdeccbd82c5 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:58.349726 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4670b-7251-4793-8548-1fdeccbd82c5 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:58.381931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247a2ad-482c-4e16-8c15-518c0c88655d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:58.382610 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247a2ad-482c-4e16-8c15-518c0c88655d None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:58.382896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247a2ad-482c-4e16-8c15-518c0c88655d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:58.383172 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247a2ad-482c-4e16-8c15-518c0c88655d None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:58.383873 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247a2ad-482c-4e16-8c15-518c0c88655d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:58.385313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247a2ad-482c-4e16-8c15-518c0c88655d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:58.477202 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 33/61] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 21:08:58 2022] POST /identity/v3/users => generated 275 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:09:01.942839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc411b2-2f2c-449c-8542-24d311678fab None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:01.943383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc411b2-2f2c-449c-8542-24d311678fab None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:01.943383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc411b2-2f2c-449c-8542-24d311678fab None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:01.944940 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 29/62] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:01.945316 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d18413-5ce2-4764-b4e4-dd98a160b76d None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:01.946175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d18413-5ce2-4764-b4e4-dd98a160b76d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:01.946744 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d18413-5ce2-4764-b4e4-dd98a160b76d None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:01.948924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 34/63] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:01.949585 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceeb63e-b42e-47cc-8653-0ed2b707296e None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:01.949876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceeb63e-b42e-47cc-8653-0ed2b707296e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:01.950174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceeb63e-b42e-47cc-8653-0ed2b707296e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:01.955599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219e121-0157-43cf-9559-9f3e7f1a7399 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:01.956164 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219e121-0157-43cf-9559-9f3e7f1a7399 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:01.956787 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219e121-0157-43cf-9559-9f3e7f1a7399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:01.970511 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-3ceeb63e-b42e-47cc-8653-0ed2b707296e None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:01.971724 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3ceeb63e-b42e-47cc-8653-0ed2b707296e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:01.977399 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f219e121-0157-43cf-9559-9f3e7f1a7399 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:01.978768 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f219e121-0157-43cf-9559-9f3e7f1a7399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:01.987611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:02.054237 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 35/64] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:02.056132 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286376c5-a9cb-47df-94f8-130f9dc4794c None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:02.056498 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286376c5-a9cb-47df-94f8-130f9dc4794c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:02.056858 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286376c5-a9cb-47df-94f8-130f9dc4794c None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:02.058217 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 36/65] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:02.059539 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209d89f-1fd6-4f4e-933f-91688745b464 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:02.059995 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209d89f-1fd6-4f4e-933f-91688745b464 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:02.060436 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209d89f-1fd6-4f4e-933f-91688745b464 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:02.062209 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 37/66] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:02.063969 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6ff12-f38d-4f98-8caa-377dd29eb3b3 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:02.064448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6ff12-f38d-4f98-8caa-377dd29eb3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:02.064931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6ff12-f38d-4f98-8caa-377dd29eb3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:02.068820 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 30/67] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:09:02.070557 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9921f9-1d37-41d1-841e-32176ce66146 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:02.070927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9921f9-1d37-41d1-841e-32176ce66146 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:02.071285 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9921f9-1d37-41d1-841e-32176ce66146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:02.094024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-1da6ff12-f38d-4f98-8caa-377dd29eb3b3 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:02.095817 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-1da6ff12-f38d-4f98-8caa-377dd29eb3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:02.100816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-2e9921f9-1d37-41d1-841e-32176ce66146 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:02.102169 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2e9921f9-1d37-41d1-841e-32176ce66146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:02.166366 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 38/68] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:02.167221 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6ff12-f38d-4f98-8caa-377dd29eb3b3 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:02.179763 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 31/69] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:02.180615 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9921f9-1d37-41d1-841e-32176ce66146 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:02.210443 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:02.241618 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:02.271457 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6ff12-f38d-4f98-8caa-377dd29eb3b3 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:02.284218 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9921f9-1d37-41d1-841e-32176ce66146 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:02.307629 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65127c06-75dc-4f74-b408-cb7b8ff3cf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:02.308430 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65127c06-75dc-4f74-b408-cb7b8ff3cf69 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:02.308741 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65127c06-75dc-4f74-b408-cb7b8ff3cf69 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:02.309026 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65127c06-75dc-4f74-b408-cb7b8ff3cf69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:02.318324 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20034ec7-51e7-498d-b21f-928b06a513a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:02.319132 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20034ec7-51e7-498d-b21f-928b06a513a7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:02.319421 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20034ec7-51e7-498d-b21f-928b06a513a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:02.319589 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65127c06-75dc-4f74-b408-cb7b8ff3cf69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:02.319703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20034ec7-51e7-498d-b21f-928b06a513a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:02.327364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-65127c06-75dc-4f74-b408-cb7b8ff3cf69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:02.327364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:02.327364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:02.327364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:02.327364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:02.327364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:02.327364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:02.327364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:02.327364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:02.327364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:02.327364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:02.327364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:02.327364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:02.327364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:02.327364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:02.327364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:02.328381 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:02.328381 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:02.328381 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:02.328381 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:02.328381 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:02.328381 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:02.328381 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:02.328381 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:02.328381 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:02.328381 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:02.328381 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:02.328381 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:02.328381 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:02.328381 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:02.328381 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:02.328381 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:02.329833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:02.329833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:02.329833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:02.329833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:02.329833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:02.329833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:02.329833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:02.329833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:02.329833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:02.329833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:02.329833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:02.329833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:02.329833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 39/70] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:02.330847 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c337f15-9302-4051-9630-8978efde2d33 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:02.330847 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c337f15-9302-4051-9630-8978efde2d33 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:02.330847 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c337f15-9302-4051-9630-8978efde2d33 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:02.332268 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 40/71] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:02.332369 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20034ec7-51e7-498d-b21f-928b06a513a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:02.332810 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c337f15-9302-4051-9630-8978efde2d33 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:02.341745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-20034ec7-51e7-498d-b21f-928b06a513a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:09:02.341745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:02.341745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:02.341745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:02.341745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:02.341745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:02.341745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:02.341745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:02.341745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:02.341745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:02.341745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:02.341745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:02.341745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:02.341745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:02.341745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:02.341745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:02.342752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:02.342752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:02.342752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:02.342752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:02.342752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:02.342752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:02.342752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:02.342752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:02.342752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:02.342752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:02.342752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:02.342752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:02.342752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:02.342752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:02.342752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:02.342752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:02.344002 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:02.344002 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:02.344002 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:02.344002 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:02.344002 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:02.344002 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:02.344002 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:02.344002 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:02.344002 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:02.344002 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:02.344002 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:09:02.344002 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:09:02.344002 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 32/72] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 21:09:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:02.344002 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20034ec7-51e7-498d-b21f-928b06a513a7 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:02.430092 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:02.439686 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c337f15-9302-4051-9630-8978efde2d33 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:02.445048 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20034ec7-51e7-498d-b21f-928b06a513a7 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:02.469124 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:02.473889 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e9c1e-d8d7-4273-8103-8b0e19d49375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:02.474714 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e9c1e-d8d7-4273-8103-8b0e19d49375 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:02.474999 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e9c1e-d8d7-4273-8103-8b0e19d49375 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:02.475280 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e9c1e-d8d7-4273-8103-8b0e19d49375 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:02.478383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf279673-aa34-4ef9-9bc9-601d7f47ffc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:02.479167 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf279673-aa34-4ef9-9bc9-601d7f47ffc2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:02.479451 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf279673-aa34-4ef9-9bc9-601d7f47ffc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:02.482101 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf279673-aa34-4ef9-9bc9-601d7f47ffc2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:02.486814 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e9c1e-d8d7-4273-8103-8b0e19d49375 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:02.490597 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf279673-aa34-4ef9-9bc9-601d7f47ffc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:02.494485 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-6e8e9c1e-d8d7-4273-8103-8b0e19d49375 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:09:02.494485 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:02.494485 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:02.494485 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:02.494485 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:02.494485 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:02.494485 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:02.494485 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:02.494485 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:02.494485 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:02.494485 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:02.494485 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:02.494485 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:02.494485 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:02.494485 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:02.494485 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:02.495446 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:02.495446 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:02.495446 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:02.495446 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:02.495446 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:02.495446 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:02.495446 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:02.495446 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:02.495446 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:02.495446 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:02.495446 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:02.495446 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:02.495446 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:02.495446 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:02.495446 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:02.495446 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:02.496242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:02.496242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:02.496242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:02.496242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:02.496242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:02.496242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:02.496242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:02.496242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:02.496242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:02.496242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:02.496242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:09:02.496242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:02.496242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 41/73] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:09:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:02.496915 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e9c1e-d8d7-4273-8103-8b0e19d49375 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:02.498493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-bf279673-aa34-4ef9-9bc9-601d7f47ffc2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:02.498493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:02.498493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:02.498493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:02.498493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:02.498493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:02.498493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:02.498493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:02.498493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:02.498493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:02.498493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:02.498493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:02.498493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:02.498493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:02.498493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:02.498493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:02.499412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:02.499412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:02.499412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:02.499412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:02.499412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:02.499412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:02.499412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:02.499412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:02.499412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:02.499412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:02.499412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:02.499412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:02.499412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:02.499412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:02.499412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:02.499412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:02.500185 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:02.500185 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:02.500185 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:02.500185 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:02.500185 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:02.500185 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:02.500185 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:02.500185 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:02.500185 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:02.500185 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:02.500185 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:02.500185 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:09:02.500185 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 33/74] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:02.503464 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01242d-7fcf-4565-a5be-e37f3cab5f05 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:02.503761 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01242d-7fcf-4565-a5be-e37f3cab5f05 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:02.504049 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01242d-7fcf-4565-a5be-e37f3cab5f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:02.520694 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-6a01242d-7fcf-4565-a5be-e37f3cab5f05 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:02.521893 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6a01242d-7fcf-4565-a5be-e37f3cab5f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:02.589137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 34/75] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:02.589997 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01242d-7fcf-4565-a5be-e37f3cab5f05 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:02.612431 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e9c1e-d8d7-4273-8103-8b0e19d49375 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:02.647940 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd98298-8713-41a8-b3be-8172e9a2f347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:02.648594 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd98298-8713-41a8-b3be-8172e9a2f347 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:02.648879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd98298-8713-41a8-b3be-8172e9a2f347 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:02.649160 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd98298-8713-41a8-b3be-8172e9a2f347 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:02.649893 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd98298-8713-41a8-b3be-8172e9a2f347 None admin] RBAC: Adding query filter params (name=member) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:02.650232 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd98298-8713-41a8-b3be-8172e9a2f347 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:02.651630 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd98298-8713-41a8-b3be-8172e9a2f347 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:02.660133 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 42/76] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 21:09:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:02.660909 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd98298-8713-41a8-b3be-8172e9a2f347 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:02.679910 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:02.701976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01242d-7fcf-4565-a5be-e37f3cab5f05 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:02.716785 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:02.736539 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd80f1b-d851-423d-8b0e-120cef05e156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:02.737148 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd80f1b-d851-423d-8b0e-120cef05e156 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:02.737442 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd80f1b-d851-423d-8b0e-120cef05e156 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:02.737729 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd80f1b-d851-423d-8b0e-120cef05e156 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:02.738517 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd80f1b-d851-423d-8b0e-120cef05e156 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:02.738832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd80f1b-d851-423d-8b0e-120cef05e156 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:02.740241 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd80f1b-d851-423d-8b0e-120cef05e156 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:02.748202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 35/77] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:09:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:02.748999 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd80f1b-d851-423d-8b0e-120cef05e156 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:02.762166 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd98298-8713-41a8-b3be-8172e9a2f347 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:02.796030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a64c78-017a-4ea2-b7b8-96afc60811c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:02.796700 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a64c78-017a-4ea2-b7b8-96afc60811c0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:02.796991 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a64c78-017a-4ea2-b7b8-96afc60811c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:02.797275 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a64c78-017a-4ea2-b7b8-96afc60811c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:02.799254 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a64c78-017a-4ea2-b7b8-96afc60811c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:02.799578 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a64c78-017a-4ea2-b7b8-96afc60811c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:02.800980 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a64c78-017a-4ea2-b7b8-96afc60811c0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:02.809039 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 43/78] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:02.810171 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a64c78-017a-4ea2-b7b8-96afc60811c0 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:02.850856 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd80f1b-d851-423d-8b0e-120cef05e156 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:02.883639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2e464-bba8-4787-b7ba-6adb8a39c4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:02.884308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2e464-bba8-4787-b7ba-6adb8a39c4cf None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:02.884604 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2e464-bba8-4787-b7ba-6adb8a39c4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:02.884888 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2e464-bba8-4787-b7ba-6adb8a39c4cf None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:02.885642 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2e464-bba8-4787-b7ba-6adb8a39c4cf None admin] RBAC: Adding query filter params (name=member) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:02.885955 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2e464-bba8-4787-b7ba-6adb8a39c4cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:02.887380 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2e464-bba8-4787-b7ba-6adb8a39c4cf None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:02.892954 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:02.896534 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 36/79] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 21:09:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:02.897353 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2e464-bba8-4787-b7ba-6adb8a39c4cf None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:02.912748 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a64c78-017a-4ea2-b7b8-96afc60811c0 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:02.929235 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:02.947592 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d055f-d21f-44ac-9815-c8cd4f748393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:02.948429 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d055f-d21f-44ac-9815-c8cd4f748393 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:02.948709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d055f-d21f-44ac-9815-c8cd4f748393 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:02.948985 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d055f-d21f-44ac-9815-c8cd4f748393 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:02.950191 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d055f-d21f-44ac-9815-c8cd4f748393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:02.951630 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d055f-d21f-44ac-9815-c8cd4f748393 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:02.953285 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 44/80] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:02.957852 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d055f-d21f-44ac-9815-c8cd4f748393 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:02.999741 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2e464-bba8-4787-b7ba-6adb8a39c4cf None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:03.035101 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c17623-b0ad-4b28-bbfc-d628306827af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:03.036038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c17623-b0ad-4b28-bbfc-d628306827af None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:03.036329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c17623-b0ad-4b28-bbfc-d628306827af None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:03.036640 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c17623-b0ad-4b28-bbfc-d628306827af None admin] PATH_INFO: `/v3/users/67b27485a57e48ea95c2f4ae108b5024` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:03.051892 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c17623-b0ad-4b28-bbfc-d628306827af None admin] RBAC: Authorizing `identity:get_user(user_id=67b27485a57e48ea95c2f4ae108b5024)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:03.053372 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c17623-b0ad-4b28-bbfc-d628306827af None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:03.054486 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d055f-d21f-44ac-9815-c8cd4f748393 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:03.055076 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 37/81] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:02 2022] GET /identity/v3/users/67b27485a57e48ea95c2f4ae108b5024 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:03.059920 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c17623-b0ad-4b28-bbfc-d628306827af None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:03.095115 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc2ce6-446b-4a3d-9800-fe3d1e5beb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:03.095993 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc2ce6-446b-4a3d-9800-fe3d1e5beb7f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:03.096280 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc2ce6-446b-4a3d-9800-fe3d1e5beb7f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:03.096562 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc2ce6-446b-4a3d-9800-fe3d1e5beb7f None admin] PATH_INFO: `/v3/users/67b27485a57e48ea95c2f4ae108b5024` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:03.097775 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc2ce6-446b-4a3d-9800-fe3d1e5beb7f None admin] RBAC: Authorizing `identity:get_user(user_id=67b27485a57e48ea95c2f4ae108b5024)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:03.099275 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc2ce6-446b-4a3d-9800-fe3d1e5beb7f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:03.100912 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 45/82] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:02 2022] GET /identity/v3/users/67b27485a57e48ea95c2f4ae108b5024 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:03.101675 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc2ce6-446b-4a3d-9800-fe3d1e5beb7f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:03.113408 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:03.153506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:03.155528 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c17623-b0ad-4b28-bbfc-d628306827af None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:03.190877 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498ecde-8462-4d01-b987-a1671440d24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:03.191765 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498ecde-8462-4d01-b987-a1671440d24f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:03.192102 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498ecde-8462-4d01-b987-a1671440d24f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:03.192390 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498ecde-8462-4d01-b987-a1671440d24f None admin] PATH_INFO: `/v3/users/01e24880ba10472b96df6cd13c234ba0` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:03.193591 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498ecde-8462-4d01-b987-a1671440d24f None admin] RBAC: Authorizing `identity:get_user(user_id=01e24880ba10472b96df6cd13c234ba0)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:03.195084 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498ecde-8462-4d01-b987-a1671440d24f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:03.196723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 38/83] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:03 2022] GET /identity/v3/users/01e24880ba10472b96df6cd13c234ba0 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:03.197492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498ecde-8462-4d01-b987-a1671440d24f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:03.202084 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc2ce6-446b-4a3d-9800-fe3d1e5beb7f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:03.236739 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2216c-3094-44b8-b482-47974079b6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:03.237613 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2216c-3094-44b8-b482-47974079b6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:03.237899 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2216c-3094-44b8-b482-47974079b6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:03.238213 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2216c-3094-44b8-b482-47974079b6b3 None admin] PATH_INFO: `/v3/users/67b27485a57e48ea95c2f4ae108b5024` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:03.239407 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2216c-3094-44b8-b482-47974079b6b3 None admin] RBAC: Authorizing `identity:get_user(user_id=67b27485a57e48ea95c2f4ae108b5024)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:03.240865 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2216c-3094-44b8-b482-47974079b6b3 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:03.242524 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 46/84] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:03 2022] GET /identity/v3/users/67b27485a57e48ea95c2f4ae108b5024 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:03.243285 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2216c-3094-44b8-b482-47974079b6b3 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:03.301454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498ecde-8462-4d01-b987-a1671440d24f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:03.326535 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:03.336145 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129801c-2119-4bcb-a077-edd6c37daafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:03.336822 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129801c-2119-4bcb-a077-edd6c37daafa None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:03.337113 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129801c-2119-4bcb-a077-edd6c37daafa None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:03.337400 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129801c-2119-4bcb-a077-edd6c37daafa None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:03.339801 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129801c-2119-4bcb-a077-edd6c37daafa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:03.339801 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129801c-2119-4bcb-a077-edd6c37daafa None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:03.343596 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2216c-3094-44b8-b482-47974079b6b3 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:03.363835 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:03.377421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb5644-94a9-4aa2-9f78-d84a4895d5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:03.378074 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb5644-94a9-4aa2-9f78-d84a4895d5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:03.378398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb5644-94a9-4aa2-9f78-d84a4895d5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:03.378683 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb5644-94a9-4aa2-9f78-d84a4895d5a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:03.414140 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 39/85] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 21:09:03 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:09:03.415175 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129801c-2119-4bcb-a077-edd6c37daafa None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:03.452175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb5644-94a9-4aa2-9f78-d84a4895d5a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:03.454564 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb5644-94a9-4aa2-9f78-d84a4895d5a0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:03.541764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129801c-2119-4bcb-a077-edd6c37daafa None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:03.572643 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 47/86] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:03.578165 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb5644-94a9-4aa2-9f78-d84a4895d5a0 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:03.581466 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4c698-31b0-4f69-9ea8-caf3b85abd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:03.582231 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4c698-31b0-4f69-9ea8-caf3b85abd3d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:03.582524 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4c698-31b0-4f69-9ea8-caf3b85abd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:03.582807 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4c698-31b0-4f69-9ea8-caf3b85abd3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:03.601216 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:03.645328 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:03.671553 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4c698-31b0-4f69-9ea8-caf3b85abd3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:03.673074 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4c698-31b0-4f69-9ea8-caf3b85abd3d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:03.693583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb5644-94a9-4aa2-9f78-d84a4895d5a0 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:03.759375 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764d294-61ef-492b-9a59-3f6af370dbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:03.760039 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764d294-61ef-492b-9a59-3f6af370dbac None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:03.760327 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764d294-61ef-492b-9a59-3f6af370dbac None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:03.760605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764d294-61ef-492b-9a59-3f6af370dbac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:03.836722 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764d294-61ef-492b-9a59-3f6af370dbac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:03.838399 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764d294-61ef-492b-9a59-3f6af370dbac None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:03.850073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 40/87] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:03.851389 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4c698-31b0-4f69-9ea8-caf3b85abd3d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:03.862041 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:03.949007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 48/88] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:03.950068 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764d294-61ef-492b-9a59-3f6af370dbac None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:03.976312 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:03.997982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4c698-31b0-4f69-9ea8-caf3b85abd3d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:04.044448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ac93f-6f48-4c95-95ff-d5842cdb24a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:04.045307 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ac93f-6f48-4c95-95ff-d5842cdb24a0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:04.045683 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ac93f-6f48-4c95-95ff-d5842cdb24a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:04.046035 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ac93f-6f48-4c95-95ff-d5842cdb24a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:04.077042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764d294-61ef-492b-9a59-3f6af370dbac None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:04.100436 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:04.115833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07057b6-dc40-4517-9f0f-b0eff0500298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:04.116713 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07057b6-dc40-4517-9f0f-b0eff0500298 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:04.116999 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07057b6-dc40-4517-9f0f-b0eff0500298 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:04.117283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07057b6-dc40-4517-9f0f-b0eff0500298 None admin] PATH_INFO: `/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:04.118525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07057b6-dc40-4517-9f0f-b0eff0500298 None admin] RBAC: Authorizing `identity:get_project(project_id=ce0639f1aa774369ae34b4a7e8f866fa)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:04.120207 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07057b6-dc40-4517-9f0f-b0eff0500298 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:04.121927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 49/89] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:03 2022] GET /identity/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:04.122188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ac93f-6f48-4c95-95ff-d5842cdb24a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:04.122856 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07057b6-dc40-4517-9f0f-b0eff0500298 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:04.123750 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ac93f-6f48-4c95-95ff-d5842cdb24a0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:04.209091 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:04.228476 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 41/90] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:04.229242 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ac93f-6f48-4c95-95ff-d5842cdb24a0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:04.229848 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07057b6-dc40-4517-9f0f-b0eff0500298 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:04.268126 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044ddb0-c7d9-4ef1-ade2-5a6375408b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:04.269000 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044ddb0-c7d9-4ef1-ade2-5a6375408b92 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:04.269286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044ddb0-c7d9-4ef1-ade2-5a6375408b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:04.269564 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044ddb0-c7d9-4ef1-ade2-5a6375408b92 None admin] PATH_INFO: `/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:04.270824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044ddb0-c7d9-4ef1-ade2-5a6375408b92 None admin] RBAC: Authorizing `identity:get_project(project_id=ce0639f1aa774369ae34b4a7e8f866fa)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:04.272407 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044ddb0-c7d9-4ef1-ade2-5a6375408b92 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:04.274153 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 50/91] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:04 2022] GET /identity/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:04.279062 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044ddb0-c7d9-4ef1-ade2-5a6375408b92 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:04.335465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ac93f-6f48-4c95-95ff-d5842cdb24a0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:04.346685 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:04.372734 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf08ee2-832f-4210-9ff4-c0641746c878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:04.373515 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf08ee2-832f-4210-9ff4-c0641746c878 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:04.373802 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf08ee2-832f-4210-9ff4-c0641746c878 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:04.374082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf08ee2-832f-4210-9ff4-c0641746c878 None admin] PATH_INFO: `/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:04.375341 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf08ee2-832f-4210-9ff4-c0641746c878 None admin] RBAC: Authorizing `identity:get_project(project_id=ce0639f1aa774369ae34b4a7e8f866fa)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:04.376993 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf08ee2-832f-4210-9ff4-c0641746c878 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:04.378738 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 42/92] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:04 2022] GET /identity/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:04.379662 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf08ee2-832f-4210-9ff4-c0641746c878 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:04.393581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044ddb0-c7d9-4ef1-ade2-5a6375408b92 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:04.431492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:04.432520 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60e9cb-0003-4a53-b344-4dd31170c197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:04.433542 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60e9cb-0003-4a53-b344-4dd31170c197 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:04.433972 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60e9cb-0003-4a53-b344-4dd31170c197 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:04.434500 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60e9cb-0003-4a53-b344-4dd31170c197 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:04.435472 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60e9cb-0003-4a53-b344-4dd31170c197 None admin] RBAC: Adding query filter params (role.id=a93b63d74444489ebd7f92fd096f7eaf, scope.project.id=ce0639f1aa774369ae34b4a7e8f866fa, user.id=67b27485a57e48ea95c2f4ae108b5024) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:04.435936 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60e9cb-0003-4a53-b344-4dd31170c197 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:04.437549 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60e9cb-0003-4a53-b344-4dd31170c197 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:04.443497 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 51/93] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:04 2022] GET /identity/v3/role_assignments?user.id=67b27485a57e48ea95c2f4ae108b5024&scope.project.id=ce0639f1aa774369ae34b4a7e8f866fa&role.id=a93b63d74444489ebd7f92fd096f7eaf => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:04.444498 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60e9cb-0003-4a53-b344-4dd31170c197 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:04.486863 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf08ee2-832f-4210-9ff4-c0641746c878 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:04.523442 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36275a7b-56a4-4d28-8063-209bc925caa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:04.524316 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36275a7b-56a4-4d28-8063-209bc925caa6 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:04.524602 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36275a7b-56a4-4d28-8063-209bc925caa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:04.524885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36275a7b-56a4-4d28-8063-209bc925caa6 None admin] PATH_INFO: `/v3/projects/5d1854b787844c87a6d64b9e715023bd` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:04.526147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36275a7b-56a4-4d28-8063-209bc925caa6 None admin] RBAC: Authorizing `identity:get_project(project_id=5d1854b787844c87a6d64b9e715023bd)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:04.527669 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36275a7b-56a4-4d28-8063-209bc925caa6 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:04.529781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 43/94] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:04 2022] GET /identity/v3/projects/5d1854b787844c87a6d64b9e715023bd => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:04.530743 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36275a7b-56a4-4d28-8063-209bc925caa6 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:04.634515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60e9cb-0003-4a53-b344-4dd31170c197 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:04.679203 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:04.704568 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d312964-0671-4fc0-b698-a6c2d87a4e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:04.705256 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d312964-0671-4fc0-b698-a6c2d87a4e98 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:04.705548 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d312964-0671-4fc0-b698-a6c2d87a4e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:04.705840 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d312964-0671-4fc0-b698-a6c2d87a4e98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:04.706740 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d312964-0671-4fc0-b698-a6c2d87a4e98 None admin] RBAC: Adding query filter params (role.id=d39f0a4f271f470490b67062462b2d74, scope.project.id=ce0639f1aa774369ae34b4a7e8f866fa, user.id=67b27485a57e48ea95c2f4ae108b5024) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:04.707086 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d312964-0671-4fc0-b698-a6c2d87a4e98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:04.708522 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d312964-0671-4fc0-b698-a6c2d87a4e98 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:04.719030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36275a7b-56a4-4d28-8063-209bc925caa6 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:04.729013 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 52/95] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:04 2022] GET /identity/v3/role_assignments?user.id=67b27485a57e48ea95c2f4ae108b5024&scope.project.id=ce0639f1aa774369ae34b4a7e8f866fa&role.id=d39f0a4f271f470490b67062462b2d74 => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:04.729887 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d312964-0671-4fc0-b698-a6c2d87a4e98 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:04.743797 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:04.765496 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6c06d-814d-4f4d-a19f-e975998d41ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:04.767816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6c06d-814d-4f4d-a19f-e975998d41ee None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:04.768413 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6c06d-814d-4f4d-a19f-e975998d41ee None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:04.768907 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6c06d-814d-4f4d-a19f-e975998d41ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:04.770370 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6c06d-814d-4f4d-a19f-e975998d41ee None admin] RBAC: Adding query filter params (role.id=15cf04fec8c6477088a33bf286f1bbdb, scope.project.id=ce0639f1aa774369ae34b4a7e8f866fa, user.id=01e24880ba10472b96df6cd13c234ba0) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:04.770905 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6c06d-814d-4f4d-a19f-e975998d41ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:04.772574 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6c06d-814d-4f4d-a19f-e975998d41ee None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:04.784377 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 44/96] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:04 2022] GET /identity/v3/role_assignments?user.id=01e24880ba10472b96df6cd13c234ba0&scope.project.id=ce0639f1aa774369ae34b4a7e8f866fa&role.id=15cf04fec8c6477088a33bf286f1bbdb => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:04.916078 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d312964-0671-4fc0-b698-a6c2d87a4e98 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:04.970969 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42405c-1e73-427a-b616-07c5193c0bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:04.971773 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42405c-1e73-427a-b616-07c5193c0bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:04.971963 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42405c-1e73-427a-b616-07c5193c0bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:04.972243 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42405c-1e73-427a-b616-07c5193c0bb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:04.973115 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42405c-1e73-427a-b616-07c5193c0bb2 None admin] RBAC: Adding query filter params (role.id=a93b63d74444489ebd7f92fd096f7eaf, scope.project.id=5d1854b787844c87a6d64b9e715023bd, user.id=67b27485a57e48ea95c2f4ae108b5024) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:04.973435 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42405c-1e73-427a-b616-07c5193c0bb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:04.974977 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42405c-1e73-427a-b616-07c5193c0bb2 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:04.981779 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 53/97] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:04 2022] GET /identity/v3/role_assignments?user.id=67b27485a57e48ea95c2f4ae108b5024&scope.project.id=5d1854b787844c87a6d64b9e715023bd&role.id=a93b63d74444489ebd7f92fd096f7eaf => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:06.048390 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9269def-94d4-48cf-af7f-38ae442c3826 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:06.049453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9269def-94d4-48cf-af7f-38ae442c3826 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:06.049959 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9269def-94d4-48cf-af7f-38ae442c3826 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:06.051860 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 45/98] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:06.056868 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbd289-5979-4695-8653-23fe6666c864 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:06.057668 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbd289-5979-4695-8653-23fe6666c864 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:06.058202 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbd289-5979-4695-8653-23fe6666c864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:06.079806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-70fbd289-5979-4695-8653-23fe6666c864 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:06.081050 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-70fbd289-5979-4695-8653-23fe6666c864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:06.103147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc07d7-e844-4174-9ffd-f86e767ebc88 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:06.104151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc07d7-e844-4174-9ffd-f86e767ebc88 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:06.104701 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc07d7-e844-4174-9ffd-f86e767ebc88 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:06.107324 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 46/99] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:06.111950 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0752cc-e617-4497-ac3a-7286c4d204d4 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:06.112473 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0752cc-e617-4497-ac3a-7286c4d204d4 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:06.112955 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0752cc-e617-4497-ac3a-7286c4d204d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:06.134633 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:06.147101 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-8c0752cc-e617-4497-ac3a-7286c4d204d4 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:06.148558 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8c0752cc-e617-4497-ac3a-7286c4d204d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:06.161840 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 54/100] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:06.223941 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbd289-5979-4695-8653-23fe6666c864 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:06.267798 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 47/101] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:06.319304 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0752cc-e617-4497-ac3a-7286c4d204d4 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:06.431841 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbd289-5979-4695-8653-23fe6666c864 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:06.513707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6348236-388e-42a3-b2e2-2ec7d494ac0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:06.514568 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6348236-388e-42a3-b2e2-2ec7d494ac0e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:06.514849 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6348236-388e-42a3-b2e2-2ec7d494ac0e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:06.515127 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6348236-388e-42a3-b2e2-2ec7d494ac0e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:06.533775 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6348236-388e-42a3-b2e2-2ec7d494ac0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:06.537866 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0752cc-e617-4497-ac3a-7286c4d204d4 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:06.541689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-c6348236-388e-42a3-b2e2-2ec7d494ac0e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:09:06.541689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:06.541689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:06.541689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:06.541689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:06.541689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:06.541689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:06.541689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:06.541689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:06.541689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:06.541689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:06.541689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:06.541689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:06.541689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:06.541689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:06.541689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:06.542597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:06.542597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:06.542597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:06.542597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:06.542597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:06.542597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:06.542597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:06.542597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:06.542597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:06.542597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:06.542597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:06.542597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:06.542597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:06.542597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:06.542597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:06.542597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:06.543374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:06.543374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:06.543374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:06.543374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:06.543374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:06.543374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:06.543374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:06.543374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:06.543374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:06.543374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:06.543374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:09:06.543374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:06.543374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 55/102] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:06.551214 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6348236-388e-42a3-b2e2-2ec7d494ac0e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:06.564257 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:06.627634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dbe54-0199-4f14-bd0c-0bd02019d4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:06.629085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dbe54-0199-4f14-bd0c-0bd02019d4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:06.629580 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dbe54-0199-4f14-bd0c-0bd02019d4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:06.630062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dbe54-0199-4f14-bd0c-0bd02019d4f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:06.634848 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720dbe54-0199-4f14-bd0c-0bd02019d4f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:06.637533 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720dbe54-0199-4f14-bd0c-0bd02019d4f9 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:06.639430 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 48/103] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:06.644003 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:06.646771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dbe54-0199-4f14-bd0c-0bd02019d4f9 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:06.832293 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6348236-388e-42a3-b2e2-2ec7d494ac0e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:06.896919 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dbe54-0199-4f14-bd0c-0bd02019d4f9 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:06.927010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e6018-2169-4a76-88e4-52e0298251b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:06.927720 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e6018-2169-4a76-88e4-52e0298251b7 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:06.928010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e6018-2169-4a76-88e4-52e0298251b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:06.928292 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e6018-2169-4a76-88e4-52e0298251b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:06.929079 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e6018-2169-4a76-88e4-52e0298251b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:06.929393 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e6018-2169-4a76-88e4-52e0298251b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:06.930886 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e6018-2169-4a76-88e4-52e0298251b7 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:06.945815 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 56/104] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 21:09:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:06.954514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e6018-2169-4a76-88e4-52e0298251b7 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:06.966612 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3594f-3a08-4483-b093-e31afee488c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:06.968086 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3594f-3a08-4483-b093-e31afee488c8 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:06.968544 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3594f-3a08-4483-b093-e31afee488c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:06.968989 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3594f-3a08-4483-b093-e31afee488c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:06.970713 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3594f-3a08-4483-b093-e31afee488c8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:06.972917 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3594f-3a08-4483-b093-e31afee488c8 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:07.086636 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 49/105] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Jul 5 21:09:06 2022] POST /identity/v3/projects => generated 302 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:09:07.114132 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:07.117324 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e6018-2169-4a76-88e4-52e0298251b7 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:07.162717 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625a67f-a3fd-4d31-a97c-f7edcfe947d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:07.163525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625a67f-a3fd-4d31-a97c-f7edcfe947d3 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:07.163814 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625a67f-a3fd-4d31-a97c-f7edcfe947d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:07.164098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625a67f-a3fd-4d31-a97c-f7edcfe947d3 None admin] PATH_INFO: `/v3/users/25d37054f7a04d86a770a4b7e95e1184` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:07.189301 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625a67f-a3fd-4d31-a97c-f7edcfe947d3 None admin] RBAC: Authorizing `identity:get_user(user_id=25d37054f7a04d86a770a4b7e95e1184)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:07.190837 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625a67f-a3fd-4d31-a97c-f7edcfe947d3 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:07.192918 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 57/106] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:06 2022] GET /identity/v3/users/25d37054f7a04d86a770a4b7e95e1184 => generated 289 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:07.198765 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3594f-3a08-4483-b093-e31afee488c8 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:07.246636 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1081a6-0b88-4228-8088-9c7fb3949623 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:07.246932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1081a6-0b88-4228-8088-9c7fb3949623 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:07.247224 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1081a6-0b88-4228-8088-9c7fb3949623 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:07.248809 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 58/107] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:09:07.249518 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:07.260466 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616e25b-0dde-4b57-b055-f1c61a0d5702 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:07.260764 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616e25b-0dde-4b57-b055-f1c61a0d5702 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:07.261054 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616e25b-0dde-4b57-b055-f1c61a0d5702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:07.300862 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-9616e25b-0dde-4b57-b055-f1c61a0d5702 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:07.302704 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-9616e25b-0dde-4b57-b055-f1c61a0d5702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:07.392999 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3594f-3a08-4483-b093-e31afee488c8 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:07.432139 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 59/108] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 05 21:09:07.460206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616e25b-0dde-4b57-b055-f1c61a0d5702 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:07.480793 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7632b-51ed-40df-8fd4-6860c2f2c2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:07.481463 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7632b-51ed-40df-8fd4-6860c2f2c2ab None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:07.481752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7632b-51ed-40df-8fd4-6860c2f2c2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:07.482036 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7632b-51ed-40df-8fd4-6860c2f2c2ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:07.579344 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:07.611473 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616e25b-0dde-4b57-b055-f1c61a0d5702 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:07.638537 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7632b-51ed-40df-8fd4-6860c2f2c2ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:07.640042 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7632b-51ed-40df-8fd4-6860c2f2c2ab None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:07.686212 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03ba76-98c0-45c3-9dcb-ba9991cf6c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:07.686981 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03ba76-98c0-45c3-9dcb-ba9991cf6c4d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:07.687277 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03ba76-98c0-45c3-9dcb-ba9991cf6c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:07.687560 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03ba76-98c0-45c3-9dcb-ba9991cf6c4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:07.706424 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:07.720543 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03ba76-98c0-45c3-9dcb-ba9991cf6c4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:07.728699 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-ba03ba76-98c0-45c3-9dcb-ba9991cf6c4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:07.728699 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:07.728699 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:07.728699 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:07.728699 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:07.728699 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:07.728699 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:07.728699 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:07.728699 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:07.728699 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:07.728699 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:07.728699 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:07.728699 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:07.728699 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:07.728699 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:07.728699 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:07.729582 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:07.729582 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:07.729582 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:07.729582 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:07.729582 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:07.729582 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:07.729582 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:07.729582 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:07.729582 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:07.729582 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:07.729582 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:07.729582 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:07.729582 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:07.729582 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:07.729582 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:07.729582 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:07.730385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:07.730385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:07.730385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:07.730385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:07.730385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:07.730385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:07.730385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:07.730385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:07.730385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:07.730385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:07.730385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:07.730385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:07.737447 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 60/109] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:07.760235 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03ba76-98c0-45c3-9dcb-ba9991cf6c4d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:07.823773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 50/110] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:07.825588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d07412-234d-48bd-aba0-0eea4b73a8b2 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:07.826077 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d07412-234d-48bd-aba0-0eea4b73a8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:07.826596 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d07412-234d-48bd-aba0-0eea4b73a8b2 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:07.828954 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 51/111] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:07.834494 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ade11-e176-49ce-9f53-ff9188755f6b None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:07.835470 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ade11-e176-49ce-9f53-ff9188755f6b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:07.835952 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ade11-e176-49ce-9f53-ff9188755f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:07.854553 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-4b2ade11-e176-49ce-9f53-ff9188755f6b None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:07.856521 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4b2ade11-e176-49ce-9f53-ff9188755f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:07.933927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 52/112] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:09:07.935210 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ade11-e176-49ce-9f53-ff9188755f6b None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:07.976067 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03ba76-98c0-45c3-9dcb-ba9991cf6c4d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:08.011085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:08.022854 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c164641-b8b5-4b96-92d9-1a9b3ad3e471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:08.028928 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c164641-b8b5-4b96-92d9-1a9b3ad3e471 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:08.028928 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c164641-b8b5-4b96-92d9-1a9b3ad3e471 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:08.028928 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c164641-b8b5-4b96-92d9-1a9b3ad3e471 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:08.028928 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c164641-b8b5-4b96-92d9-1a9b3ad3e471 None admin] RBAC: Adding query filter params (name=member) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:08.028928 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c164641-b8b5-4b96-92d9-1a9b3ad3e471 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:08.028928 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c164641-b8b5-4b96-92d9-1a9b3ad3e471 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:08.036546 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 61/113] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 21:09:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:08.038076 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54102e5c-77a8-471e-a530-b9a775c6d358 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:08.038577 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54102e5c-77a8-471e-a530-b9a775c6d358 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:08.038855 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54102e5c-77a8-471e-a530-b9a775c6d358 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:08.040229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 62/114] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:08.042247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54102e5c-77a8-471e-a530-b9a775c6d358 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:08.055758 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:08.063109 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ade11-e176-49ce-9f53-ff9188755f6b None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:08.104806 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca80e14-edca-4c14-9970-854fa5dba6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:08.105696 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca80e14-edca-4c14-9970-854fa5dba6da None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:08.105982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca80e14-edca-4c14-9970-854fa5dba6da None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:08.106289 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca80e14-edca-4c14-9970-854fa5dba6da None admin] PATH_INFO: `/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:08.107560 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca80e14-edca-4c14-9970-854fa5dba6da None admin] RBAC: Authorizing `identity:get_project(project_id=ce0639f1aa774369ae34b4a7e8f866fa)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:08.108932 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca80e14-edca-4c14-9970-854fa5dba6da None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:08.111652 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 53/115] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:07 2022] GET /identity/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:08.112669 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87d9cb-0f32-47f5-8828-30c8e6cbc0b6 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:08.112957 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87d9cb-0f32-47f5-8828-30c8e6cbc0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:08.113233 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87d9cb-0f32-47f5-8828-30c8e6cbc0b6 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:08.114621 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 54/116] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:08.115194 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87d9cb-0f32-47f5-8828-30c8e6cbc0b6 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:08.159332 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54102e5c-77a8-471e-a530-b9a775c6d358 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:08.195168 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949702b-24a7-4ac2-bd89-161c34d7f455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:08.195989 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949702b-24a7-4ac2-bd89-161c34d7f455 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:08.196278 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949702b-24a7-4ac2-bd89-161c34d7f455 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:08.196560 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949702b-24a7-4ac2-bd89-161c34d7f455 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:08.209429 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949702b-24a7-4ac2-bd89-161c34d7f455 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:08.217600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-5949702b-24a7-4ac2-bd89-161c34d7f455 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:09:08.217600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:08.217600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:08.217600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:08.217600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:08.217600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:08.217600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:08.217600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:08.217600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:08.217600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:08.217600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:08.217600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:08.217600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:08.217600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:08.217600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:08.217600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:08.218517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:08.218517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:08.218517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:08.218517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:08.218517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:08.218517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:08.218517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:08.218517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:08.218517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:08.218517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:08.218517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:08.218517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:08.218517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:08.218517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:08.218517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:08.218517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:08.219832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:08.219832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:08.219832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:08.219832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:08.219832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:08.219832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:08.219832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:08.219832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:08.219832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:08.219832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:08.219832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:09:08.219832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:08.219832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 63/117] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 21:09:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:08.221269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca2a72-3c46-428f-a327-35c0c50cdc0c None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:08.221269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca2a72-3c46-428f-a327-35c0c50cdc0c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:08.221269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca2a72-3c46-428f-a327-35c0c50cdc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:08.226231 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87d9cb-0f32-47f5-8828-30c8e6cbc0b6 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:08.238346 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-34ca2a72-3c46-428f-a327-35c0c50cdc0c None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:08.239568 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-34ca2a72-3c46-428f-a327-35c0c50cdc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:08.259414 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:08.265551 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51240d-ce34-43cf-86c5-7270bdef7f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:08.266537 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51240d-ce34-43cf-86c5-7270bdef7f75 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:08.266822 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51240d-ce34-43cf-86c5-7270bdef7f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:08.269027 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51240d-ce34-43cf-86c5-7270bdef7f75 None admin] PATH_INFO: `/v3/users/67b27485a57e48ea95c2f4ae108b5024` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:08.269027 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51240d-ce34-43cf-86c5-7270bdef7f75 None admin] RBAC: Authorizing `identity:get_user(user_id=67b27485a57e48ea95c2f4ae108b5024)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:08.270058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51240d-ce34-43cf-86c5-7270bdef7f75 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:08.271965 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 55/118] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:08 2022] GET /identity/v3/users/67b27485a57e48ea95c2f4ae108b5024 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:08.272537 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51240d-ce34-43cf-86c5-7270bdef7f75 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:08.310571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:08.315528 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 64/119] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:08.316667 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a52377-66ef-4b1a-81bc-c7b7e0c04e2a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:08.316970 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a52377-66ef-4b1a-81bc-c7b7e0c04e2a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:08.317254 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a52377-66ef-4b1a-81bc-c7b7e0c04e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:08.335062 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e0a52377-66ef-4b1a-81bc-c7b7e0c04e2a None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:08.336257 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e0a52377-66ef-4b1a-81bc-c7b7e0c04e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:08.392505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51240d-ce34-43cf-86c5-7270bdef7f75 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:08.422145 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 65/120] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:08.422145 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a52377-66ef-4b1a-81bc-c7b7e0c04e2a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:08.441860 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50cd21-6e7e-479e-b482-31a016b3a1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:08.442652 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50cd21-6e7e-479e-b482-31a016b3a1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:08.443010 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50cd21-6e7e-479e-b482-31a016b3a1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:08.443301 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50cd21-6e7e-479e-b482-31a016b3a1b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:08.444145 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea50cd21-6e7e-479e-b482-31a016b3a1b6 None admin] RBAC: Adding query filter params (role.id=92fb139a25ed41a09f3d5bceec3752fc, scope.project.id=ce0639f1aa774369ae34b4a7e8f866fa, user.id=25d37054f7a04d86a770a4b7e95e1184) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:08.444468 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea50cd21-6e7e-479e-b482-31a016b3a1b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:08.445941 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea50cd21-6e7e-479e-b482-31a016b3a1b6 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:08.451812 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 56/121] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:08 2022] GET /identity/v3/role_assignments?user.id=25d37054f7a04d86a770a4b7e95e1184&scope.project.id=ce0639f1aa774369ae34b4a7e8f866fa&role.id=92fb139a25ed41a09f3d5bceec3752fc => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:08.459300 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50cd21-6e7e-479e-b482-31a016b3a1b6 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:08.539109 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a52377-66ef-4b1a-81bc-c7b7e0c04e2a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:08.553537 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:08.579316 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:08.589437 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d7084-3431-4141-8646-d9b64dd0e83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:08.596356 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d7084-3431-4141-8646-d9b64dd0e83b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:08.596821 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d7084-3431-4141-8646-d9b64dd0e83b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:08.597254 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d7084-3431-4141-8646-d9b64dd0e83b None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:08.598622 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d7084-3431-4141-8646-d9b64dd0e83b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:08.599096 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d7084-3431-4141-8646-d9b64dd0e83b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:08.600754 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d7084-3431-4141-8646-d9b64dd0e83b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:08.609495 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50cd21-6e7e-479e-b482-31a016b3a1b6 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:08.611840 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 66/122] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:09:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:08.613017 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d7084-3431-4141-8646-d9b64dd0e83b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:08.655860 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf1d26-f137-412e-8b9a-b98299cf5f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:08.657448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf1d26-f137-412e-8b9a-b98299cf5f8d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:08.657741 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf1d26-f137-412e-8b9a-b98299cf5f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:08.658147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf1d26-f137-412e-8b9a-b98299cf5f8d None admin] PATH_INFO: `/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:08.659673 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf1d26-f137-412e-8b9a-b98299cf5f8d None admin] RBAC: Authorizing `identity:get_project(project_id=ce0639f1aa774369ae34b4a7e8f866fa)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:08.662089 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf1d26-f137-412e-8b9a-b98299cf5f8d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:08.663862 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 57/123] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:08 2022] GET /identity/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:08.664725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf1d26-f137-412e-8b9a-b98299cf5f8d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:08.736964 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d7084-3431-4141-8646-d9b64dd0e83b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:08.781292 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773268d3-65a3-4a2d-8f0c-a59467604569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:08.782631 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773268d3-65a3-4a2d-8f0c-a59467604569 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:08.782952 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773268d3-65a3-4a2d-8f0c-a59467604569 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:08.783240 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773268d3-65a3-4a2d-8f0c-a59467604569 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:08.794016 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf1d26-f137-412e-8b9a-b98299cf5f8d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:08.794187 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773268d3-65a3-4a2d-8f0c-a59467604569 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:08.802267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-773268d3-65a3-4a2d-8f0c-a59467604569 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:08.802267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:08.802267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:08.802267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:08.802267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:08.802267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:08.802267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:08.802267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:08.802267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:08.802267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:08.802267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:08.802267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:08.802267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:08.802267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:08.802267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:08.802267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:08.803180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:08.803180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:08.803180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:08.803180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:08.803180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:08.803180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:08.803180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:08.803180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:08.803180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:08.803180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:08.803180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:08.803180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:08.803180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:08.803180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:08.803180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:08.803180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:08.803991 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:08.803991 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:08.803991 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:08.803991 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:08.803991 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:08.803991 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:08.803991 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:08.803991 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:08.803991 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:08.803991 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:08.803991 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:08.803991 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:08.803991 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 67/124] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:08.804638 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773268d3-65a3-4a2d-8f0c-a59467604569 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:08.833038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be100853-8a16-4333-9a2f-4ffe8b03898f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:08.833851 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be100853-8a16-4333-9a2f-4ffe8b03898f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:08.834158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be100853-8a16-4333-9a2f-4ffe8b03898f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:08.834468 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be100853-8a16-4333-9a2f-4ffe8b03898f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:08.846834 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be100853-8a16-4333-9a2f-4ffe8b03898f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:08.855123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-be100853-8a16-4333-9a2f-4ffe8b03898f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:09:08.855123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:08.855123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:08.855123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:08.855123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:08.855123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:08.855123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:08.855123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:08.855123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:08.855123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:08.855123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:08.855123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:08.855123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:08.855123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:08.855123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:08.855123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:08.857260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:08.857260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:08.857260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:08.857260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:08.857260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:08.857260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:08.857260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:08.857260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:08.857260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:08.857260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:08.857260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:08.857260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:08.857260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:08.857260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:08.857260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:08.857260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:08.858846 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:08.858846 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:08.858846 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:08.858846 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:08.858846 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:08.858846 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:08.858846 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:08.858846 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:08.858846 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:08.858846 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:08.858846 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:09:08.858846 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:09:08.858846 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 58/125] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:09:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:08.858846 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be100853-8a16-4333-9a2f-4ffe8b03898f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:08.860257 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:08.872481 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:08.921635 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773268d3-65a3-4a2d-8f0c-a59467604569 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:08.957536 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9848795-8c21-44ed-8fb2-f68c6cbf1512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:08.958477 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9848795-8c21-44ed-8fb2-f68c6cbf1512 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:08.958772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9848795-8c21-44ed-8fb2-f68c6cbf1512 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:08.959046 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9848795-8c21-44ed-8fb2-f68c6cbf1512 None admin] PATH_INFO: `/v3/users/67b27485a57e48ea95c2f4ae108b5024` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:08.960270 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9848795-8c21-44ed-8fb2-f68c6cbf1512 None admin] RBAC: Authorizing `identity:get_user(user_id=67b27485a57e48ea95c2f4ae108b5024)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:08.961815 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9848795-8c21-44ed-8fb2-f68c6cbf1512 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:08.967870 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 68/126] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:08 2022] GET /identity/v3/users/67b27485a57e48ea95c2f4ae108b5024 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:08.968868 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9848795-8c21-44ed-8fb2-f68c6cbf1512 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:08.976120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be100853-8a16-4333-9a2f-4ffe8b03898f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:09.014091 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c687691-cbfa-4864-b7b8-a4f43ed5c386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:09.015356 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c687691-cbfa-4864-b7b8-a4f43ed5c386 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:09.016673 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c687691-cbfa-4864-b7b8-a4f43ed5c386 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:09.017661 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c687691-cbfa-4864-b7b8-a4f43ed5c386 None admin] PATH_INFO: `/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa/users/67b27485a57e48ea95c2f4ae108b5024/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:09.020245 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c687691-cbfa-4864-b7b8-a4f43ed5c386 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce0639f1aa774369ae34b4a7e8f866fa, user_id=67b27485a57e48ea95c2f4ae108b5024, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:09.022723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c687691-cbfa-4864-b7b8-a4f43ed5c386 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:09.074259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9848795-8c21-44ed-8fb2-f68c6cbf1512 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:09.093592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 59/127] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 21:09:08 2022] PUT /identity/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa/users/67b27485a57e48ea95c2f4ae108b5024/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:09:09.099214 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:09.099380 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c687691-cbfa-4864-b7b8-a4f43ed5c386 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:09.140509 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88e2a2-c62f-42d0-a2ea-927e09504965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:09.141687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88e2a2-c62f-42d0-a2ea-927e09504965 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:09.144028 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88e2a2-c62f-42d0-a2ea-927e09504965 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:09.144328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88e2a2-c62f-42d0-a2ea-927e09504965 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:09.145368 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88e2a2-c62f-42d0-a2ea-927e09504965 None admin] RBAC: Adding query filter params (name=member) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:09.146661 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88e2a2-c62f-42d0-a2ea-927e09504965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:09.149114 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88e2a2-c62f-42d0-a2ea-927e09504965 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:09.175912 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 69/128] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 21:09:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:09.178043 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88e2a2-c62f-42d0-a2ea-927e09504965 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:09.222808 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:09.278624 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c687691-cbfa-4864-b7b8-a4f43ed5c386 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:09.319142 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab9ccf-2b92-4719-9978-97b444f2eee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:09.320317 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab9ccf-2b92-4719-9978-97b444f2eee6 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:09.320810 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab9ccf-2b92-4719-9978-97b444f2eee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:09.321363 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab9ccf-2b92-4719-9978-97b444f2eee6 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:09.322391 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab9ccf-2b92-4719-9978-97b444f2eee6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:09.323089 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab9ccf-2b92-4719-9978-97b444f2eee6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:09.324970 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab9ccf-2b92-4719-9978-97b444f2eee6 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:09.331062 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88e2a2-c62f-42d0-a2ea-927e09504965 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:09.336024 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 60/129] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:09.337087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab9ccf-2b92-4719-9978-97b444f2eee6 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:09.377660 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ebf0c-2c76-4dc4-8c4c-785e47680a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:09.378616 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ebf0c-2c76-4dc4-8c4c-785e47680a45 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:09.378904 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ebf0c-2c76-4dc4-8c4c-785e47680a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:09.379182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ebf0c-2c76-4dc4-8c4c-785e47680a45 None admin] PATH_INFO: `/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:09.380497 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ebf0c-2c76-4dc4-8c4c-785e47680a45 None admin] RBAC: Authorizing `identity:get_project(project_id=ce0639f1aa774369ae34b4a7e8f866fa)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:09.381977 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ebf0c-2c76-4dc4-8c4c-785e47680a45 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:09.384114 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 70/130] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:09 2022] GET /identity/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:09.395034 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ebf0c-2c76-4dc4-8c4c-785e47680a45 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:09.450913 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:09.454495 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab9ccf-2b92-4719-9978-97b444f2eee6 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:09.468500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:09.492873 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebbc9f-8c3d-4e62-bfcb-d10b4c4da1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:09.494134 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebbc9f-8c3d-4e62-bfcb-d10b4c4da1d1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:09.494709 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebbc9f-8c3d-4e62-bfcb-d10b4c4da1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:09.495177 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebbc9f-8c3d-4e62-bfcb-d10b4c4da1d1 None admin] PATH_INFO: `/v3/users/67b27485a57e48ea95c2f4ae108b5024` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:09.496710 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebbc9f-8c3d-4e62-bfcb-d10b4c4da1d1 None admin] RBAC: Authorizing `identity:get_user(user_id=67b27485a57e48ea95c2f4ae108b5024)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:09.498640 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebbc9f-8c3d-4e62-bfcb-d10b4c4da1d1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:09.500599 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 61/131] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:09 2022] GET /identity/v3/users/67b27485a57e48ea95c2f4ae108b5024 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:09.501802 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebbc9f-8c3d-4e62-bfcb-d10b4c4da1d1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:09.507733 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ebf0c-2c76-4dc4-8c4c-785e47680a45 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:09.556592 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558388a7-08f2-421f-a451-1fe100231267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:09.557614 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558388a7-08f2-421f-a451-1fe100231267 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:09.557958 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558388a7-08f2-421f-a451-1fe100231267 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:09.558271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558388a7-08f2-421f-a451-1fe100231267 None admin] PATH_INFO: `/v3/users/01e24880ba10472b96df6cd13c234ba0` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:09.562147 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558388a7-08f2-421f-a451-1fe100231267 None admin] RBAC: Authorizing `identity:get_user(user_id=01e24880ba10472b96df6cd13c234ba0)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:09.563872 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558388a7-08f2-421f-a451-1fe100231267 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:09.566103 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 71/132] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:09 2022] GET /identity/v3/users/01e24880ba10472b96df6cd13c234ba0 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:09.566898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558388a7-08f2-421f-a451-1fe100231267 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:09.628548 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebbc9f-8c3d-4e62-bfcb-d10b4c4da1d1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:09.696332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d778a8-b8ba-4afe-b722-2ed6a75b4b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:09.697231 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d778a8-b8ba-4afe-b722-2ed6a75b4b94 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:09.697511 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d778a8-b8ba-4afe-b722-2ed6a75b4b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:09.697790 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d778a8-b8ba-4afe-b722-2ed6a75b4b94 None admin] PATH_INFO: `/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa/users/67b27485a57e48ea95c2f4ae108b5024/roles/d39f0a4f271f470490b67062462b2d74` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:09.704797 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d778a8-b8ba-4afe-b722-2ed6a75b4b94 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce0639f1aa774369ae34b4a7e8f866fa, user_id=67b27485a57e48ea95c2f4ae108b5024, role_id=d39f0a4f271f470490b67062462b2d74)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:09.706354 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d778a8-b8ba-4afe-b722-2ed6a75b4b94 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:09.745280 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558388a7-08f2-421f-a451-1fe100231267 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:09.774500 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:09.789964 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b7e44-007e-4699-88dd-36da0ec9b20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:09.791052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b7e44-007e-4699-88dd-36da0ec9b20b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:09.791404 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b7e44-007e-4699-88dd-36da0ec9b20b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:09.791690 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b7e44-007e-4699-88dd-36da0ec9b20b None admin] PATH_INFO: `/v3/projects/5d1854b787844c87a6d64b9e715023bd` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:09.793007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b7e44-007e-4699-88dd-36da0ec9b20b None admin] RBAC: Authorizing `identity:get_project(project_id=5d1854b787844c87a6d64b9e715023bd)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:09.794605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b7e44-007e-4699-88dd-36da0ec9b20b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:09.796651 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 72/133] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:09 2022] GET /identity/v3/projects/5d1854b787844c87a6d64b9e715023bd => generated 312 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:09.798032 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b7e44-007e-4699-88dd-36da0ec9b20b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:09.804351 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 62/134] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 21:09:09 2022] PUT /identity/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa/users/67b27485a57e48ea95c2f4ae108b5024/roles/d39f0a4f271f470490b67062462b2d74 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:09:09.805175 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d778a8-b8ba-4afe-b722-2ed6a75b4b94 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:09.872622 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:09.948767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d778a8-b8ba-4afe-b722-2ed6a75b4b94 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:09.991023 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8c80c-c7cf-4b6e-bdc1-01dc1f4ba9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:09.991976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8c80c-c7cf-4b6e-bdc1-01dc1f4ba9cf None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:09.992270 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8c80c-c7cf-4b6e-bdc1-01dc1f4ba9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:09.992551 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8c80c-c7cf-4b6e-bdc1-01dc1f4ba9cf None admin] PATH_INFO: `/v3/projects/5d1854b787844c87a6d64b9e715023bd/users/67b27485a57e48ea95c2f4ae108b5024/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:09.994755 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c8c80c-c7cf-4b6e-bdc1-01dc1f4ba9cf None admin] RBAC: Authorizing `identity:create_grant(project_id=5d1854b787844c87a6d64b9e715023bd, user_id=67b27485a57e48ea95c2f4ae108b5024, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:09.996863 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c8c80c-c7cf-4b6e-bdc1-01dc1f4ba9cf None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:10.027817 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b7e44-007e-4699-88dd-36da0ec9b20b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:10.064953 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f119f-d3cf-47ff-b233-91e423e73422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:10.066196 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f119f-d3cf-47ff-b233-91e423e73422 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:10.066683 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f119f-d3cf-47ff-b233-91e423e73422 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:10.067180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f119f-d3cf-47ff-b233-91e423e73422 None admin] PATH_INFO: `/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:10.068600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f119f-d3cf-47ff-b233-91e423e73422 None admin] RBAC: Authorizing `identity:get_project(project_id=ce0639f1aa774369ae34b4a7e8f866fa)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:10.070306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f119f-d3cf-47ff-b233-91e423e73422 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:10.072534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 73/135] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:09 2022] GET /identity/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:10.074042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e7ac0-4dc3-4a14-b5aa-f9400454caa6 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:10.074559 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e7ac0-4dc3-4a14-b5aa-f9400454caa6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:10.075056 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e7ac0-4dc3-4a14-b5aa-f9400454caa6 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:10.076506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 74/136] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:10.077994 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e7ac0-4dc3-4a14-b5aa-f9400454caa6 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:10.083988 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 63/137] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 21:09:09 2022] PUT /identity/v3/projects/5d1854b787844c87a6d64b9e715023bd/users/67b27485a57e48ea95c2f4ae108b5024/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:09:10.086862 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cb780-6602-4e5e-8547-cebd5794a089 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:10.094688 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cb780-6602-4e5e-8547-cebd5794a089 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:10.094688 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cb780-6602-4e5e-8547-cebd5794a089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:10.126966 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-b61cb780-6602-4e5e-8547-cebd5794a089 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:10.128453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b61cb780-6602-4e5e-8547-cebd5794a089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:10.190739 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:10.270149 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e7ac0-4dc3-4a14-b5aa-f9400454caa6 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:10.295554 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 64/138] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:10.305858 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f44e1-8610-4718-89df-4ff51fecb6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:10.306815 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f44e1-8610-4718-89df-4ff51fecb6e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:10.307097 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f44e1-8610-4718-89df-4ff51fecb6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:10.307372 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f44e1-8610-4718-89df-4ff51fecb6e8 None admin] PATH_INFO: `/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa/users/01e24880ba10472b96df6cd13c234ba0/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:10.309436 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f44e1-8610-4718-89df-4ff51fecb6e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce0639f1aa774369ae34b4a7e8f866fa, user_id=01e24880ba10472b96df6cd13c234ba0, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:10.310961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f44e1-8610-4718-89df-4ff51fecb6e8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:10.340256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61cb780-6602-4e5e-8547-cebd5794a089 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:10.382177 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:10.390881 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 75/139] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 21:09:10 2022] PUT /identity/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa/users/01e24880ba10472b96df6cd13c234ba0/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:09:10.470946 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61cb780-6602-4e5e-8547-cebd5794a089 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:10.515169 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b402a-6509-4ced-9e50-6b7d3f33e63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:10.516541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b402a-6509-4ced-9e50-6b7d3f33e63a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:10.516989 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b402a-6509-4ced-9e50-6b7d3f33e63a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:10.517731 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b402a-6509-4ced-9e50-6b7d3f33e63a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:10.519668 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b402a-6509-4ced-9e50-6b7d3f33e63a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:10.521126 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b402a-6509-4ced-9e50-6b7d3f33e63a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:10.523153 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 65/140] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:10.528596 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f44e1-8610-4718-89df-4ff51fecb6e8 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:10.665483 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f44e1-8610-4718-89df-4ff51fecb6e8 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:10.687379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:10.716124 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad753b0-37c1-469c-a16e-607742cdd8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:10.716920 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad753b0-37c1-469c-a16e-607742cdd8e2 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:10.717240 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad753b0-37c1-469c-a16e-607742cdd8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:10.717602 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad753b0-37c1-469c-a16e-607742cdd8e2 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:10.718384 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad753b0-37c1-469c-a16e-607742cdd8e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:10.720038 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad753b0-37c1-469c-a16e-607742cdd8e2 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:10.872377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 76/141] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 21:09:10 2022] POST /identity/v3/users => generated 283 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:09:10.904938 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38350b-c4dc-4117-87ea-0bd23f6230ff None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:10.905240 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38350b-c4dc-4117-87ea-0bd23f6230ff None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:10.905512 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38350b-c4dc-4117-87ea-0bd23f6230ff None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:10.907612 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 66/142] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:10.913211 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816faf9-26ab-49eb-a596-55d113157700 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:10.913516 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816faf9-26ab-49eb-a596-55d113157700 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:10.913803 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816faf9-26ab-49eb-a596-55d113157700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:10.939182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-2816faf9-26ab-49eb-a596-55d113157700 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:10.940396 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2816faf9-26ab-49eb-a596-55d113157700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:11.032061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 77/143] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:11.066708 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38350b-c4dc-4117-87ea-0bd23f6230ff None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:11.180526 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:11.185938 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38350b-c4dc-4117-87ea-0bd23f6230ff None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:11.227154 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a929fa-fa35-4551-9c14-d395f368b7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:11.227937 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a929fa-fa35-4551-9c14-d395f368b7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:11.228232 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a929fa-fa35-4551-9c14-d395f368b7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:11.228515 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a929fa-fa35-4551-9c14-d395f368b7c7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:11.241730 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a929fa-fa35-4551-9c14-d395f368b7c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:11.249759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-a6a929fa-fa35-4551-9c14-d395f368b7c7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:09:11.249759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:11.249759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:11.249759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:11.249759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:11.249759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:11.249759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:11.249759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:11.249759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:11.249759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:11.249759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:11.249759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:11.249759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:11.249759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:11.249759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:11.249759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:11.251156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:11.251156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:11.251156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:11.251156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:11.251156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:11.251156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:11.251156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:11.251156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:11.251156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:11.251156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:11.251156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:11.251156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:11.251156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:11.251156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:11.251156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:11.251156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:11.251959 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:11.251959 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:11.251959 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:11.251959 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:11.251959 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:11.251959 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:11.251959 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:11.251959 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:11.251959 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:11.251959 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:11.251959 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:09:11.251959 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:09:11.251959 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 67/144] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:11.258854 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816faf9-26ab-49eb-a596-55d113157700 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:11.376193 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:11.381785 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816faf9-26ab-49eb-a596-55d113157700 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:11.427489 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54193bab-27fc-417a-b3c4-fe3ebaa59a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:11.428232 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54193bab-27fc-417a-b3c4-fe3ebaa59a60 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:11.428518 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54193bab-27fc-417a-b3c4-fe3ebaa59a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:11.428793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54193bab-27fc-417a-b3c4-fe3ebaa59a60 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:11.429552 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54193bab-27fc-417a-b3c4-fe3ebaa59a60 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:11.429860 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54193bab-27fc-417a-b3c4-fe3ebaa59a60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:11.431322 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54193bab-27fc-417a-b3c4-fe3ebaa59a60 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:11.445448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 78/145] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 21:09:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:11.451170 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a929fa-fa35-4551-9c14-d395f368b7c7 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:11.570202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a929fa-fa35-4551-9c14-d395f368b7c7 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:11.631899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7508b-2adb-4f1f-a6d6-b26ae0e17709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:11.632808 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7508b-2adb-4f1f-a6d6-b26ae0e17709 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:11.633097 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7508b-2adb-4f1f-a6d6-b26ae0e17709 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:11.633383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7508b-2adb-4f1f-a6d6-b26ae0e17709 None admin] PATH_INFO: `/v3/users/25d37054f7a04d86a770a4b7e95e1184` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:11.634739 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba7508b-2adb-4f1f-a6d6-b26ae0e17709 None admin] RBAC: Authorizing `identity:get_user(user_id=25d37054f7a04d86a770a4b7e95e1184)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:11.636224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba7508b-2adb-4f1f-a6d6-b26ae0e17709 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:11.637888 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 68/146] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:11 2022] GET /identity/v3/users/25d37054f7a04d86a770a4b7e95e1184 => generated 289 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:11.644433 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54193bab-27fc-417a-b3c4-fe3ebaa59a60 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:11.763101 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54193bab-27fc-417a-b3c4-fe3ebaa59a60 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:11.805287 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bfb6e-6fae-47ec-91c1-350847117c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:11.806200 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bfb6e-6fae-47ec-91c1-350847117c25 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:11.806488 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bfb6e-6fae-47ec-91c1-350847117c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:11.806765 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bfb6e-6fae-47ec-91c1-350847117c25 None admin] PATH_INFO: `/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:11.807993 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bfb6e-6fae-47ec-91c1-350847117c25 None admin] RBAC: Authorizing `identity:get_project(project_id=ce0639f1aa774369ae34b4a7e8f866fa)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:11.809456 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bfb6e-6fae-47ec-91c1-350847117c25 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:11.811193 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 79/147] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:11 2022] GET /identity/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:11.819219 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7508b-2adb-4f1f-a6d6-b26ae0e17709 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:11.876282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:11.967192 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7508b-2adb-4f1f-a6d6-b26ae0e17709 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:12.012307 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8cf66-30fd-4885-bba1-a3b29caff364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:12.013311 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8cf66-30fd-4885-bba1-a3b29caff364 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:12.013606 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8cf66-30fd-4885-bba1-a3b29caff364 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:12.013891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8cf66-30fd-4885-bba1-a3b29caff364 None admin] PATH_INFO: `/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa/users/25d37054f7a04d86a770a4b7e95e1184/roles/92fb139a25ed41a09f3d5bceec3752fc` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:12.015976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8cf66-30fd-4885-bba1-a3b29caff364 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce0639f1aa774369ae34b4a7e8f866fa, user_id=25d37054f7a04d86a770a4b7e95e1184, role_id=92fb139a25ed41a09f3d5bceec3752fc)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:12.017723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8cf66-30fd-4885-bba1-a3b29caff364 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:12.106378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 69/148] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 21:09:11 2022] PUT /identity/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa/users/25d37054f7a04d86a770a4b7e95e1184/roles/92fb139a25ed41a09f3d5bceec3752fc => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:09:12.119716 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03ebc2-6a88-4471-90f1-be8c4dca117a None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:12.120060 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03ebc2-6a88-4471-90f1-be8c4dca117a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:12.120348 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03ebc2-6a88-4471-90f1-be8c4dca117a None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:12.121752 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 80/149] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:12.127822 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f211ea2-4724-450d-9776-deb997f4add5 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:12.128096 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f211ea2-4724-450d-9776-deb997f4add5 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:12.128331 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f211ea2-4724-450d-9776-deb997f4add5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:12.150914 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-4f211ea2-4724-450d-9776-deb997f4add5 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:12.152221 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4f211ea2-4724-450d-9776-deb997f4add5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:12.245762 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 70/150] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:12.287333 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03ebc2-6a88-4471-90f1-be8c4dca117a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:12.352960 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:12.435449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03ebc2-6a88-4471-90f1-be8c4dca117a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:12.472503 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547107f-a106-4e93-9333-0efd9c880061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:12.473310 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547107f-a106-4e93-9333-0efd9c880061 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:12.473589 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547107f-a106-4e93-9333-0efd9c880061 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:12.473884 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547107f-a106-4e93-9333-0efd9c880061 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:12.485750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547107f-a106-4e93-9333-0efd9c880061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:12.493623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-4547107f-a106-4e93-9333-0efd9c880061 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:12.493623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:12.493623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:12.493623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:12.493623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:12.493623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:12.493623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:12.493623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:12.493623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:12.493623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:12.493623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:12.493623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:12.493623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:12.493623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:12.493623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:12.493623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:12.494570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:12.494570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:12.494570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:12.494570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:12.494570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:12.494570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:12.494570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:12.494570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:12.494570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:12.494570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:12.494570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:12.494570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:12.494570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:12.494570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:12.494570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:12.494570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:12.495387 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:12.495387 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:12.495387 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:12.495387 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:12.495387 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:12.495387 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:12.495387 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:12.495387 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:12.495387 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:12.495387 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:12.495387 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:12.495387 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:12.495387 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 81/151] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:12.502996 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f211ea2-4724-450d-9776-deb997f4add5 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:12.528823 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:12.624407 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f211ea2-4724-450d-9776-deb997f4add5 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:12.666581 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ed5f0-070d-447f-90d7-2f131e86bf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:12.667270 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ed5f0-070d-447f-90d7-2f131e86bf79 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:12.667559 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ed5f0-070d-447f-90d7-2f131e86bf79 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:12.667846 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ed5f0-070d-447f-90d7-2f131e86bf79 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:12.668665 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ed5f0-070d-447f-90d7-2f131e86bf79 None admin] RBAC: Adding query filter params (name=member) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:12.668982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ed5f0-070d-447f-90d7-2f131e86bf79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:12.670418 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ed5f0-070d-447f-90d7-2f131e86bf79 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:12.679860 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 71/152] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 21:09:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:12.686844 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547107f-a106-4e93-9333-0efd9c880061 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:12.828998 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:12.841858 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547107f-a106-4e93-9333-0efd9c880061 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:12.890133 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86356a71-efed-477e-a9c8-24df714968db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:12.891079 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86356a71-efed-477e-a9c8-24df714968db None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:12.891424 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86356a71-efed-477e-a9c8-24df714968db None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:12.891646 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86356a71-efed-477e-a9c8-24df714968db None admin] PATH_INFO: `/v3/users/67b27485a57e48ea95c2f4ae108b5024` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:12.893174 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86356a71-efed-477e-a9c8-24df714968db None admin] RBAC: Authorizing `identity:get_user(user_id=67b27485a57e48ea95c2f4ae108b5024)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:12.894680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86356a71-efed-477e-a9c8-24df714968db None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:12.896337 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 82/153] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:12 2022] GET /identity/v3/users/67b27485a57e48ea95c2f4ae108b5024 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:12.901894 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ed5f0-070d-447f-90d7-2f131e86bf79 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:13.019212 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:13.032185 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ed5f0-070d-447f-90d7-2f131e86bf79 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:13.079795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05045c-a8f2-4443-856e-a03249773251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:13.080509 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05045c-a8f2-4443-856e-a03249773251 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:13.080936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05045c-a8f2-4443-856e-a03249773251 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:13.081282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05045c-a8f2-4443-856e-a03249773251 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:13.161306 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05045c-a8f2-4443-856e-a03249773251 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:13.162816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05045c-a8f2-4443-856e-a03249773251 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:13.244916 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:13.268346 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 72/154] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:13.275308 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86356a71-efed-477e-a9c8-24df714968db None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:13.421264 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86356a71-efed-477e-a9c8-24df714968db None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:13.435853 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d9b11-ab0b-4015-8aca-b307aa872e62 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:13.436498 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d9b11-ab0b-4015-8aca-b307aa872e62 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:13.436990 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d9b11-ab0b-4015-8aca-b307aa872e62 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:13.439024 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 73/155] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:13.444313 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dacac0-e804-4d92-ae1b-2212b1038d80 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:13.445183 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dacac0-e804-4d92-ae1b-2212b1038d80 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:13.445750 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dacac0-e804-4d92-ae1b-2212b1038d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:13.470952 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-82dacac0-e804-4d92-ae1b-2212b1038d80 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:13.473124 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-82dacac0-e804-4d92-ae1b-2212b1038d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:13.502853 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b7c41-d925-4c72-9ef7-668e208c418a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:13.504009 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b7c41-d925-4c72-9ef7-668e208c418a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:13.504440 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b7c41-d925-4c72-9ef7-668e208c418a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:13.504873 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b7c41-d925-4c72-9ef7-668e208c418a None admin] PATH_INFO: `/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:13.506321 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b7c41-d925-4c72-9ef7-668e208c418a None admin] RBAC: Authorizing `identity:get_project(project_id=ce0639f1aa774369ae34b4a7e8f866fa)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:13.507951 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b7c41-d925-4c72-9ef7-668e208c418a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:13.509819 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 83/156] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:13 2022] GET /identity/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:13.515514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b7c41-d925-4c72-9ef7-668e208c418a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:13.576866 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 74/157] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:09:13.584469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:13.613540 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b1451-46d5-4a31-9165-0d46aa36d2b4 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:13.614063 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b1451-46d5-4a31-9165-0d46aa36d2b4 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:13.614552 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b1451-46d5-4a31-9165-0d46aa36d2b4 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:13.616148 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 75/158] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:13.621970 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26e253-8d33-481e-8280-fe8f54a2a2af None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:13.622477 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26e253-8d33-481e-8280-fe8f54a2a2af None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:13.623381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26e253-8d33-481e-8280-fe8f54a2a2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:13.648714 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-cf26e253-8d33-481e-8280-fe8f54a2a2af None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:13.655730 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-cf26e253-8d33-481e-8280-fe8f54a2a2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:13.775971 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 76/159] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:13.777288 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b7c41-d925-4c72-9ef7-668e208c418a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:13.783360 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26e253-8d33-481e-8280-fe8f54a2a2af None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:13.841999 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:13.867624 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8948d8-dec8-4849-8ade-822785a8a82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:13.868544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8948d8-dec8-4849-8ade-822785a8a82e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:13.868975 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8948d8-dec8-4849-8ade-822785a8a82e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:13.869395 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8948d8-dec8-4849-8ade-822785a8a82e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:13.870423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8948d8-dec8-4849-8ade-822785a8a82e None admin] RBAC: Adding query filter params (role.id=a93b63d74444489ebd7f92fd096f7eaf, scope.project.id=ce0639f1aa774369ae34b4a7e8f866fa, user.id=67b27485a57e48ea95c2f4ae108b5024) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:13.870898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8948d8-dec8-4849-8ade-822785a8a82e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:13.872565 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8948d8-dec8-4849-8ade-822785a8a82e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:13.882979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 84/160] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:13 2022] GET /identity/v3/role_assignments?user.id=67b27485a57e48ea95c2f4ae108b5024&scope.project.id=ce0639f1aa774369ae34b4a7e8f866fa&role.id=a93b63d74444489ebd7f92fd096f7eaf => generated 608 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:13.883992 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8948d8-dec8-4849-8ade-822785a8a82e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:13.904991 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26e253-8d33-481e-8280-fe8f54a2a2af None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:13.946730 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91300148-f512-4a9d-9fdf-e663f15b202f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:13.947733 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91300148-f512-4a9d-9fdf-e663f15b202f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:13.948130 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91300148-f512-4a9d-9fdf-e663f15b202f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:13.948505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91300148-f512-4a9d-9fdf-e663f15b202f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:13.964951 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91300148-f512-4a9d-9fdf-e663f15b202f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:13.973981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-91300148-f512-4a9d-9fdf-e663f15b202f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:09:13.973981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:13.973981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:13.973981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:13.973981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:13.973981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:13.973981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:13.973981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:13.973981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:13.973981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:13.973981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:13.973981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:13.973981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:13.973981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:13.973981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:13.973981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:13.975147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:13.975147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:13.975147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:13.975147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:13.975147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:13.975147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:13.975147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:13.975147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:13.975147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:13.975147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:13.975147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:13.975147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:13.975147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:13.975147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:13.975147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:13.975147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:13.976105 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:13.976105 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:13.976105 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:13.976105 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:13.976105 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:13.976105 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:13.976105 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:13.976105 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:13.976105 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:13.976105 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:13.976105 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:09:13.976105 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:09:13.980151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 77/161] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 21:09:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:13.983104 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91300148-f512-4a9d-9fdf-e663f15b202f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:14.088651 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:14.090907 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91300148-f512-4a9d-9fdf-e663f15b202f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:14.113091 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:14.131240 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222621b-e209-4de1-b284-5eaf08d3c8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:14.136963 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222621b-e209-4de1-b284-5eaf08d3c8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:14.136963 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222621b-e209-4de1-b284-5eaf08d3c8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:14.136963 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222621b-e209-4de1-b284-5eaf08d3c8e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:14.136963 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222621b-e209-4de1-b284-5eaf08d3c8e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:14.136963 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222621b-e209-4de1-b284-5eaf08d3c8e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:14.136963 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222621b-e209-4de1-b284-5eaf08d3c8e6 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:14.137388 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8948d8-dec8-4849-8ade-822785a8a82e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:14.154049 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 78/162] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:09:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:14.154049 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f10ba-7274-4030-97a8-977ad5049d1c None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:14.154049 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f10ba-7274-4030-97a8-977ad5049d1c None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:14.154049 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f10ba-7274-4030-97a8-977ad5049d1c None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:14.154049 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 79/163] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:14.155094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f10ba-7274-4030-97a8-977ad5049d1c None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:14.238879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a516c70-4927-4a89-91f1-7cc75a8a6a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:14.240028 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a516c70-4927-4a89-91f1-7cc75a8a6a71 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:14.240513 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a516c70-4927-4a89-91f1-7cc75a8a6a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:14.240967 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a516c70-4927-4a89-91f1-7cc75a8a6a71 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:14.270740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f10ba-7274-4030-97a8-977ad5049d1c None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:14.271567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a516c70-4927-4a89-91f1-7cc75a8a6a71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:14.286142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-9a516c70-4927-4a89-91f1-7cc75a8a6a71 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:14.286142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:14.286142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:14.286142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:14.286142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:14.286142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:14.286142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:14.286142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:14.286142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:14.286142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:14.286142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:14.286142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:14.286142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:14.286142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:14.286142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:14.286142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:14.287123 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:14.287123 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:14.287123 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:14.287123 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:14.287123 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:14.287123 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:14.287123 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:14.287123 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:14.287123 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:14.287123 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:14.287123 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:14.287123 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:14.287123 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:14.287123 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:14.287123 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:14.287123 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:14.287917 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:14.287917 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:14.287917 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:14.287917 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:14.287917 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:14.287917 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:14.287917 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:14.287917 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:14.287917 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:14.287917 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:14.287917 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:14.287917 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:14.290250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 85/164] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:14.291768 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11ffca-1861-4e2e-8c02-fa346bede843 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:14.292197 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11ffca-1861-4e2e-8c02-fa346bede843 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:14.292604 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11ffca-1861-4e2e-8c02-fa346bede843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:14.324061 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7963a4-729f-4ce1-bfc0-08ceb3764c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:14.325214 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7963a4-729f-4ce1-bfc0-08ceb3764c18 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:14.325496 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7963a4-729f-4ce1-bfc0-08ceb3764c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:14.325754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7963a4-729f-4ce1-bfc0-08ceb3764c18 None admin] PATH_INFO: `/v3/users/67b27485a57e48ea95c2f4ae108b5024` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:14.326420 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-9f11ffca-1861-4e2e-8c02-fa346bede843 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:14.327172 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7963a4-729f-4ce1-bfc0-08ceb3764c18 None admin] RBAC: Authorizing `identity:get_user(user_id=67b27485a57e48ea95c2f4ae108b5024)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:14.330974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-9f11ffca-1861-4e2e-8c02-fa346bede843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:14.332073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7963a4-729f-4ce1-bfc0-08ceb3764c18 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:14.341390 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 80/165] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:14 2022] GET /identity/v3/users/67b27485a57e48ea95c2f4ae108b5024 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:14.342294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7963a4-729f-4ce1-bfc0-08ceb3764c18 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:14.408923 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:14.478941 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 86/166] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:14.479817 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11ffca-1861-4e2e-8c02-fa346bede843 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:14.545637 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7963a4-729f-4ce1-bfc0-08ceb3764c18 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:14.591430 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9447be-5cd0-4be5-ad0d-e90c2c9b0924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:14.592192 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9447be-5cd0-4be5-ad0d-e90c2c9b0924 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:14.592483 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9447be-5cd0-4be5-ad0d-e90c2c9b0924 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:14.598164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9447be-5cd0-4be5-ad0d-e90c2c9b0924 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:14.598164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9447be-5cd0-4be5-ad0d-e90c2c9b0924 None admin] RBAC: Adding query filter params (name=member) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:14.598164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9447be-5cd0-4be5-ad0d-e90c2c9b0924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:14.598164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9447be-5cd0-4be5-ad0d-e90c2c9b0924 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:14.606212 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 81/167] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 21:09:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:14.610736 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9447be-5cd0-4be5-ad0d-e90c2c9b0924 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:14.708310 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:14.718547 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:14.728710 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9447be-5cd0-4be5-ad0d-e90c2c9b0924 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:14.739668 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11ffca-1861-4e2e-8c02-fa346bede843 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:14.770618 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a731862-2303-4d18-8002-54629b17cbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:14.771419 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a731862-2303-4d18-8002-54629b17cbc0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:14.771697 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a731862-2303-4d18-8002-54629b17cbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:14.771971 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a731862-2303-4d18-8002-54629b17cbc0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:14.783731 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a731862-2303-4d18-8002-54629b17cbc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:14.791828 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-0a731862-2303-4d18-8002-54629b17cbc0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:09:14.791828 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:14.791828 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:14.791828 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:14.791828 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:14.791828 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:14.791828 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:14.791828 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:14.791828 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:14.791828 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:14.791828 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:14.791828 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:14.791828 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:14.791828 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:14.791828 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:14.791828 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:14.793837 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:14.793837 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:14.793837 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:14.793837 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:14.793837 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:14.793837 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:14.793837 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:14.793837 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:14.793837 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:14.793837 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:14.793837 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:14.793837 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:14.793837 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:14.793837 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:14.793837 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:14.793837 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:14.796199 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:14.796199 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:14.796199 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:14.796199 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:14.796199 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:14.796199 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:14.796199 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:14.796199 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:14.796199 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:14.796199 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:14.796199 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:09:14.796199 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:09:14.796199 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 82/168] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:09:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:14.796199 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a731862-2303-4d18-8002-54629b17cbc0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:14.806839 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516b64d-2266-4bd7-b8b5-c46703f9d773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:14.807529 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516b64d-2266-4bd7-b8b5-c46703f9d773 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:14.807819 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516b64d-2266-4bd7-b8b5-c46703f9d773 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:14.808104 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516b64d-2266-4bd7-b8b5-c46703f9d773 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:14.903970 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a731862-2303-4d18-8002-54629b17cbc0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:14.921713 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0516b64d-2266-4bd7-b8b5-c46703f9d773 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:14.924061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0516b64d-2266-4bd7-b8b5-c46703f9d773 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:14.940701 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f1ca3-0048-4705-abd7-665a1c57f69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:14.941886 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f1ca3-0048-4705-abd7-665a1c57f69f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:14.942508 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f1ca3-0048-4705-abd7-665a1c57f69f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:14.942971 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f1ca3-0048-4705-abd7-665a1c57f69f None admin] PATH_INFO: `/v3/users/67b27485a57e48ea95c2f4ae108b5024` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:14.944391 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f1ca3-0048-4705-abd7-665a1c57f69f None admin] RBAC: Authorizing `identity:get_user(user_id=67b27485a57e48ea95c2f4ae108b5024)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:14.945997 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f1ca3-0048-4705-abd7-665a1c57f69f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:14.947989 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 83/169] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:14 2022] GET /identity/v3/users/67b27485a57e48ea95c2f4ae108b5024 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:14.949033 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f1ca3-0048-4705-abd7-665a1c57f69f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:14.986592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:15.029371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:15.059752 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 87/170] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:15.063670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516b64d-2266-4bd7-b8b5-c46703f9d773 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:15.070892 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f1ca3-0048-4705-abd7-665a1c57f69f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:15.111449 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532bad2-a9ae-443f-bf17-0168116a43b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:15.112532 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532bad2-a9ae-443f-bf17-0168116a43b4 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:15.113014 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532bad2-a9ae-443f-bf17-0168116a43b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:15.113493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532bad2-a9ae-443f-bf17-0168116a43b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:15.114488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532bad2-a9ae-443f-bf17-0168116a43b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:15.114999 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532bad2-a9ae-443f-bf17-0168116a43b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:15.116575 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532bad2-a9ae-443f-bf17-0168116a43b4 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:15.126603 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 84/171] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:15.128042 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532bad2-a9ae-443f-bf17-0168116a43b4 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:15.218525 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:15.248512 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532bad2-a9ae-443f-bf17-0168116a43b4 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:15.266315 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516b64d-2266-4bd7-b8b5-c46703f9d773 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:15.316086 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfb550-6c69-406a-8335-9c77aa421b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:15.317073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfb550-6c69-406a-8335-9c77aa421b10 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:15.317362 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfb550-6c69-406a-8335-9c77aa421b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:15.317753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfb550-6c69-406a-8335-9c77aa421b10 None admin] PATH_INFO: `/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:15.318112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326aae0-aa85-4635-8f55-b66c300e6257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:15.318934 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326aae0-aa85-4635-8f55-b66c300e6257 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:15.319219 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326aae0-aa85-4635-8f55-b66c300e6257 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:15.319493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326aae0-aa85-4635-8f55-b66c300e6257 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:15.322857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfb550-6c69-406a-8335-9c77aa421b10 None admin] RBAC: Authorizing `identity:get_project(project_id=ce0639f1aa774369ae34b4a7e8f866fa)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:15.324356 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfb550-6c69-406a-8335-9c77aa421b10 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:15.326134 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 85/172] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:15 2022] GET /identity/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:15.326923 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfb550-6c69-406a-8335-9c77aa421b10 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:15.379348 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:15.400955 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326aae0-aa85-4635-8f55-b66c300e6257 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:15.402475 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326aae0-aa85-4635-8f55-b66c300e6257 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:15.510177 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 88/173] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:15.516136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462f022-5c54-4528-81cb-11e3e802c1fb None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:15.516546 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462f022-5c54-4528-81cb-11e3e802c1fb None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:15.517229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462f022-5c54-4528-81cb-11e3e802c1fb None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:15.518717 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 89/174] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:15.520281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462f022-5c54-4528-81cb-11e3e802c1fb None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:15.608120 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:15.608965 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfb550-6c69-406a-8335-9c77aa421b10 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:15.630201 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462f022-5c54-4528-81cb-11e3e802c1fb None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:15.666920 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e51f7c-0d85-4f34-9ef7-6c58c988c14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:15.667683 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e51f7c-0d85-4f34-9ef7-6c58c988c14d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:15.667962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e51f7c-0d85-4f34-9ef7-6c58c988c14d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:15.668235 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e51f7c-0d85-4f34-9ef7-6c58c988c14d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:15.669069 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e51f7c-0d85-4f34-9ef7-6c58c988c14d None admin] RBAC: Adding query filter params (role.id=d39f0a4f271f470490b67062462b2d74, scope.project.id=ce0639f1aa774369ae34b4a7e8f866fa, user.id=67b27485a57e48ea95c2f4ae108b5024) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:15.669376 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e51f7c-0d85-4f34-9ef7-6c58c988c14d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:15.671430 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e51f7c-0d85-4f34-9ef7-6c58c988c14d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:15.678937 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 90/175] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:15 2022] GET /identity/v3/role_assignments?user.id=67b27485a57e48ea95c2f4ae108b5024&scope.project.id=ce0639f1aa774369ae34b4a7e8f866fa&role.id=d39f0a4f271f470490b67062462b2d74 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:15.684496 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e51f7c-0d85-4f34-9ef7-6c58c988c14d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:15.723805 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4cb3d-8b73-49f0-b612-ad5cf451813b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:15.725120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4cb3d-8b73-49f0-b612-ad5cf451813b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:15.725514 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4cb3d-8b73-49f0-b612-ad5cf451813b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:15.725895 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4cb3d-8b73-49f0-b612-ad5cf451813b None admin] PATH_INFO: `/v3/users/01e24880ba10472b96df6cd13c234ba0` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:15.730987 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4cb3d-8b73-49f0-b612-ad5cf451813b None admin] RBAC: Authorizing `identity:get_user(user_id=01e24880ba10472b96df6cd13c234ba0)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:15.732845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4cb3d-8b73-49f0-b612-ad5cf451813b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:15.739159 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 86/176] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:15 2022] GET /identity/v3/users/01e24880ba10472b96df6cd13c234ba0 => generated 247 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:15.740470 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c82503-c1c3-47a5-9188-76f1ef9d5f35 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:15.740748 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c82503-c1c3-47a5-9188-76f1ef9d5f35 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:15.741030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c82503-c1c3-47a5-9188-76f1ef9d5f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:15.773159 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-21c82503-c1c3-47a5-9188-76f1ef9d5f35 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:15.774756 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-21c82503-c1c3-47a5-9188-76f1ef9d5f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:15.803969 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:15.866424 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e51f7c-0d85-4f34-9ef7-6c58c988c14d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:15.938914 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e30fd-1d1f-4d0e-8f00-7ba0dd533da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:15.940313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e30fd-1d1f-4d0e-8f00-7ba0dd533da0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:15.940607 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e30fd-1d1f-4d0e-8f00-7ba0dd533da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:15.941155 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e30fd-1d1f-4d0e-8f00-7ba0dd533da0 None admin] PATH_INFO: `/v3/projects/5d1854b787844c87a6d64b9e715023bd` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:15.942580 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e30fd-1d1f-4d0e-8f00-7ba0dd533da0 None admin] RBAC: Authorizing `identity:get_project(project_id=5d1854b787844c87a6d64b9e715023bd)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:15.944621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e30fd-1d1f-4d0e-8f00-7ba0dd533da0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:15.947326 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 91/177] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:15 2022] GET /identity/v3/projects/5d1854b787844c87a6d64b9e715023bd => generated 312 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:15.954550 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e30fd-1d1f-4d0e-8f00-7ba0dd533da0 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:15.957684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 87/178] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:15.960264 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c82503-c1c3-47a5-9188-76f1ef9d5f35 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:15.988275 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:16.124511 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e30fd-1d1f-4d0e-8f00-7ba0dd533da0 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:16.136063 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c82503-c1c3-47a5-9188-76f1ef9d5f35 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:16.166977 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd570f-5abd-4615-ae36-92cee1e4f171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:16.168006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd570f-5abd-4615-ae36-92cee1e4f171 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:16.168374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd570f-5abd-4615-ae36-92cee1e4f171 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:16.168734 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd570f-5abd-4615-ae36-92cee1e4f171 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:16.172854 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66125b7e-5be0-41a3-bb26-c30b68b06947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:16.173508 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66125b7e-5be0-41a3-bb26-c30b68b06947 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:16.173791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66125b7e-5be0-41a3-bb26-c30b68b06947 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:16.174067 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66125b7e-5be0-41a3-bb26-c30b68b06947 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:16.174936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66125b7e-5be0-41a3-bb26-c30b68b06947 None admin] RBAC: Adding query filter params (role.id=a93b63d74444489ebd7f92fd096f7eaf, scope.project.id=5d1854b787844c87a6d64b9e715023bd, user.id=67b27485a57e48ea95c2f4ae108b5024) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:16.175248 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66125b7e-5be0-41a3-bb26-c30b68b06947 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:16.176684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66125b7e-5be0-41a3-bb26-c30b68b06947 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:16.182618 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 88/179] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:15 2022] GET /identity/v3/role_assignments?user.id=67b27485a57e48ea95c2f4ae108b5024&scope.project.id=5d1854b787844c87a6d64b9e715023bd&role.id=a93b63d74444489ebd7f92fd096f7eaf => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:16.183411 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66125b7e-5be0-41a3-bb26-c30b68b06947 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:16.203363 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:16.265176 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd570f-5abd-4615-ae36-92cee1e4f171 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:16.266808 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd570f-5abd-4615-ae36-92cee1e4f171 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:16.283499 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:16.325234 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66125b7e-5be0-41a3-bb26-c30b68b06947 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:16.366800 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a8037-a9c4-4fb0-b77c-fb9925830f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:16.367602 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a8037-a9c4-4fb0-b77c-fb9925830f95 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:16.368475 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a8037-a9c4-4fb0-b77c-fb9925830f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:16.368475 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a8037-a9c4-4fb0-b77c-fb9925830f95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:16.380462 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a8037-a9c4-4fb0-b77c-fb9925830f95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:16.382314 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 92/180] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:16.383909 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ff3ea-564c-4401-92c9-8a9553e94074 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:16.383909 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ff3ea-564c-4401-92c9-8a9553e94074 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:16.383909 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ff3ea-564c-4401-92c9-8a9553e94074 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:16.384683 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 93/181] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:16.385737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc61f24-38dd-4beb-a8f9-eb2835a3adf5 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:16.386213 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc61f24-38dd-4beb-a8f9-eb2835a3adf5 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:16.386628 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc61f24-38dd-4beb-a8f9-eb2835a3adf5 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:16.387986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 94/182] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:16.388457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-745a8037-a9c4-4fb0-b77c-fb9925830f95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:09:16.388457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:16.388457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:16.388457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:16.388457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:16.388457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:16.388457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:16.388457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:16.388457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:16.388457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:16.388457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:16.388457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:16.388457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:16.388457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:16.388457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:16.388457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:16.389526 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:16.389526 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:16.389526 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:16.389526 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:16.389526 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:16.389526 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:16.389526 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:16.389526 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:16.389526 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:16.389526 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:16.389526 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:16.389526 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:16.389526 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:16.389526 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:16.389526 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:16.389526 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:16.390596 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:16.390596 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:16.390596 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:16.390596 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:16.390596 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:16.390596 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:16.390596 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:16.390596 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:16.390596 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:16.390596 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:16.390596 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:09:16.390596 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:09:16.391336 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 89/183] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:09:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:16.391756 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a8037-a9c4-4fb0-b77c-fb9925830f95 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:16.392732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1cf11-a3fd-41d8-b0f8-9c1125baf991 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:16.393174 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1cf11-a3fd-41d8-b0f8-9c1125baf991 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:16.393593 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1cf11-a3fd-41d8-b0f8-9c1125baf991 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:16.399984 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 95/184] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:16 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:16.400438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb5e33-82f6-42c6-b6be-bb04373dd59b None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:16.400730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb5e33-82f6-42c6-b6be-bb04373dd59b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:16.401012 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb5e33-82f6-42c6-b6be-bb04373dd59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:16.420751 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-3afb5e33-82f6-42c6-b6be-bb04373dd59b None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:16.422561 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3afb5e33-82f6-42c6-b6be-bb04373dd59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:16.469293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:16.491920 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 96/185] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:16.493394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adee47-c2f1-4a00-b086-8ea882e311ee None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:16.493686 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adee47-c2f1-4a00-b086-8ea882e311ee None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:16.493963 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adee47-c2f1-4a00-b086-8ea882e311ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:16.503655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a8037-a9c4-4fb0-b77c-fb9925830f95 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:16.509581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b1adee47-c2f1-4a00-b086-8ea882e311ee None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:16.510961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b1adee47-c2f1-4a00-b086-8ea882e311ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:16.539998 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943c39a-a6ff-45f3-935a-dc90113c8bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:16.540854 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943c39a-a6ff-45f3-935a-dc90113c8bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:16.541321 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943c39a-a6ff-45f3-935a-dc90113c8bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:16.541428 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943c39a-a6ff-45f3-935a-dc90113c8bb7 None admin] PATH_INFO: `/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:16.542639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943c39a-a6ff-45f3-935a-dc90113c8bb7 None admin] RBAC: Authorizing `identity:get_project(project_id=ce0639f1aa774369ae34b4a7e8f866fa)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:16.544041 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943c39a-a6ff-45f3-935a-dc90113c8bb7 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:16.545722 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 90/186] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:16 2022] GET /identity/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:16.546572 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943c39a-a6ff-45f3-935a-dc90113c8bb7 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:16.548561 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:16.581469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 97/187] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:16.582773 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefd0a9-46b4-4ec8-9438-ee465b492130 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:16.583059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefd0a9-46b4-4ec8-9438-ee465b492130 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:16.583332 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefd0a9-46b4-4ec8-9438-ee465b492130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:16.600293 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-fbefd0a9-46b4-4ec8-9438-ee465b492130 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:16.601506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-fbefd0a9-46b4-4ec8-9438-ee465b492130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:16.659205 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943c39a-a6ff-45f3-935a-dc90113c8bb7 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:16.668037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 98/188] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:16.668878 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefd0a9-46b4-4ec8-9438-ee465b492130 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:16.697213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35827463-ef48-4f73-aacb-ebbf753d986a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:16.697878 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35827463-ef48-4f73-aacb-ebbf753d986a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:16.698190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35827463-ef48-4f73-aacb-ebbf753d986a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:16.698472 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35827463-ef48-4f73-aacb-ebbf753d986a None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:16.699223 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35827463-ef48-4f73-aacb-ebbf753d986a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:16.699534 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35827463-ef48-4f73-aacb-ebbf753d986a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:16.700928 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35827463-ef48-4f73-aacb-ebbf753d986a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:16.706799 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:16.711500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 91/189] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:16.712134 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35827463-ef48-4f73-aacb-ebbf753d986a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:16.775439 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefd0a9-46b4-4ec8-9438-ee465b492130 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:16.776942 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:16.809774 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ed002-1cf1-41ac-a879-681a825527be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:16.810595 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ed002-1cf1-41ac-a879-681a825527be None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:16.810880 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ed002-1cf1-41ac-a879-681a825527be None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:16.811156 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ed002-1cf1-41ac-a879-681a825527be None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:16.811248 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35827463-ef48-4f73-aacb-ebbf753d986a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:16.821301 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ed002-1cf1-41ac-a879-681a825527be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:16.829742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-680ed002-1cf1-41ac-a879-681a825527be None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:09:16.829742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:16.829742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:16.829742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:16.829742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:16.829742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:16.829742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:16.829742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:16.829742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:16.829742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:16.829742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:16.829742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:16.829742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:16.829742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:16.829742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:16.829742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:16.830772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:16.830772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:16.830772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:16.830772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:16.830772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:16.830772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:16.830772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:16.830772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:16.830772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:16.830772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:16.830772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:16.830772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:16.830772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:16.830772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:16.830772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:16.830772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:16.831579 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:16.831579 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:16.831579 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:16.831579 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:16.831579 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:16.831579 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:16.831579 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:16.831579 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:16.831579 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:16.831579 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:16.831579 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:09:16.831579 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:16.831579 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 99/190] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:16.832251 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ed002-1cf1-41ac-a879-681a825527be None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:16.848272 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715d496-7bae-46ba-83ef-4cd0cbbbdd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:16.848928 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715d496-7bae-46ba-83ef-4cd0cbbbdd64 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:16.849208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715d496-7bae-46ba-83ef-4cd0cbbbdd64 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:16.849481 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715d496-7bae-46ba-83ef-4cd0cbbbdd64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:16.850343 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715d496-7bae-46ba-83ef-4cd0cbbbdd64 None admin] RBAC: Adding query filter params (role.id=15cf04fec8c6477088a33bf286f1bbdb, scope.project.id=ce0639f1aa774369ae34b4a7e8f866fa, user.id=01e24880ba10472b96df6cd13c234ba0) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:16.850656 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715d496-7bae-46ba-83ef-4cd0cbbbdd64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:16.852095 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715d496-7bae-46ba-83ef-4cd0cbbbdd64 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:16.857869 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 92/191] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:16 2022] GET /identity/v3/role_assignments?user.id=01e24880ba10472b96df6cd13c234ba0&scope.project.id=ce0639f1aa774369ae34b4a7e8f866fa&role.id=15cf04fec8c6477088a33bf286f1bbdb => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:16.858765 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715d496-7bae-46ba-83ef-4cd0cbbbdd64 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:16.931482 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:16.952685 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ed002-1cf1-41ac-a879-681a825527be None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:16.975134 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715d496-7bae-46ba-83ef-4cd0cbbbdd64 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:16.990712 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068ed74-b0fd-40cb-85ee-48984fdf80da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:16.991547 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068ed74-b0fd-40cb-85ee-48984fdf80da None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:16.991832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068ed74-b0fd-40cb-85ee-48984fdf80da None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:16.992109 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068ed74-b0fd-40cb-85ee-48984fdf80da None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:17.004055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068ed74-b0fd-40cb-85ee-48984fdf80da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:17.012229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-d068ed74-b0fd-40cb-85ee-48984fdf80da None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:09:17.012229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:17.012229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:17.012229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:17.012229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:17.012229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:17.012229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:17.012229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:17.012229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:17.012229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:17.012229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:17.012229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:17.012229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:17.012229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:17.012229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:17.012229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:17.014023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:17.014023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:17.014023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:17.014023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:17.014023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:17.014023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:17.014023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:17.014023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:17.014023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:17.014023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:17.014023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:17.014023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:17.014023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:17.014023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:17.014023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:17.014023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:17.014898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:17.014898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:17.014898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:17.014898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:17.014898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:17.014898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:17.014898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:17.014898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:17.014898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:17.014898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:17.014898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:09:17.014898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:17.014898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 100/192] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 21:09:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:17.016147 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068ed74-b0fd-40cb-85ee-48984fdf80da None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:17.021950 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e454c18-9708-41e4-bc53-c18084e6dd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:17.022794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e454c18-9708-41e4-bc53-c18084e6dd75 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:17.023082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e454c18-9708-41e4-bc53-c18084e6dd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:17.023361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e454c18-9708-41e4-bc53-c18084e6dd75 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:17.024550 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e454c18-9708-41e4-bc53-c18084e6dd75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:17.026010 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e454c18-9708-41e4-bc53-c18084e6dd75 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:17.027834 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 93/193] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:17.028536 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e454c18-9708-41e4-bc53-c18084e6dd75 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:17.046280 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:17.130675 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068ed74-b0fd-40cb-85ee-48984fdf80da None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:17.137829 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e454c18-9708-41e4-bc53-c18084e6dd75 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:17.163844 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c07e5-5cc5-4ad0-a574-6dc70be686ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:17.164965 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c07e5-5cc5-4ad0-a574-6dc70be686ca None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:17.165241 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c07e5-5cc5-4ad0-a574-6dc70be686ca None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:17.165516 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c07e5-5cc5-4ad0-a574-6dc70be686ca None admin] PATH_INFO: `/v3/users/b033f58dbd2944a0b1fa3df3e206af7f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:17.167250 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:17.171999 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a255c-542a-41ae-9d60-38b549f119c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:17.172731 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a255c-542a-41ae-9d60-38b549f119c7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:17.173082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a255c-542a-41ae-9d60-38b549f119c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:17.178025 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a255c-542a-41ae-9d60-38b549f119c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:17.178025 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a255c-542a-41ae-9d60-38b549f119c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:17.178025 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a255c-542a-41ae-9d60-38b549f119c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:17.178025 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a255c-542a-41ae-9d60-38b549f119c7 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:17.179446 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c07e5-5cc5-4ad0-a574-6dc70be686ca None admin] RBAC: Authorizing `identity:get_user(user_id=b033f58dbd2944a0b1fa3df3e206af7f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:17.180896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c07e5-5cc5-4ad0-a574-6dc70be686ca None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:17.182636 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 101/194] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:17 2022] GET /identity/v3/users/b033f58dbd2944a0b1fa3df3e206af7f => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:17.183340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c07e5-5cc5-4ad0-a574-6dc70be686ca None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:17.189462 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 94/195] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 21:09:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:17.189462 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a255c-542a-41ae-9d60-38b549f119c7 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:17.265251 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:17.283524 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a255c-542a-41ae-9d60-38b549f119c7 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:17.285089 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c07e5-5cc5-4ad0-a574-6dc70be686ca None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:17.317515 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab0b49-1f84-4af3-a691-987aa33ae6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:17.318207 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab0b49-1f84-4af3-a691-987aa33ae6c5 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:17.318489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab0b49-1f84-4af3-a691-987aa33ae6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:17.318761 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab0b49-1f84-4af3-a691-987aa33ae6c5 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:17.319463 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab0b49-1f84-4af3-a691-987aa33ae6c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:17.319756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217fbe2-7829-4f49-9121-beb482cc2da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:17.320477 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217fbe2-7829-4f49-9121-beb482cc2da3 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:17.320765 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217fbe2-7829-4f49-9121-beb482cc2da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:17.320919 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab0b49-1f84-4af3-a691-987aa33ae6c5 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:17.321066 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217fbe2-7829-4f49-9121-beb482cc2da3 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:17.321784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217fbe2-7829-4f49-9121-beb482cc2da3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:17.322093 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217fbe2-7829-4f49-9121-beb482cc2da3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:17.323510 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217fbe2-7829-4f49-9121-beb482cc2da3 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:17.332234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 102/196] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:09:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:17.333126 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217fbe2-7829-4f49-9121-beb482cc2da3 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:17.430180 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 95/197] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 21:09:17 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:09:17.430180 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab0b49-1f84-4af3-a691-987aa33ae6c5 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:17.432504 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217fbe2-7829-4f49-9121-beb482cc2da3 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:17.475018 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd9021-0eaf-4c13-a53d-fd3cd0d5437c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:17.475595 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd9021-0eaf-4c13-a53d-fd3cd0d5437c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:17.475883 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd9021-0eaf-4c13-a53d-fd3cd0d5437c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:17.476163 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd9021-0eaf-4c13-a53d-fd3cd0d5437c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:17.492695 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:17.493648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:17.549686 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab0b49-1f84-4af3-a691-987aa33ae6c5 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:17.555466 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd9021-0eaf-4c13-a53d-fd3cd0d5437c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:17.556983 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd9021-0eaf-4c13-a53d-fd3cd0d5437c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:17.589354 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5eefce-b412-492a-b266-146f768caccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:17.590772 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5eefce-b412-492a-b266-146f768caccf None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:17.591061 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5eefce-b412-492a-b266-146f768caccf None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:17.594016 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5eefce-b412-492a-b266-146f768caccf None admin] PATH_INFO: `/v3/users/25d37054f7a04d86a770a4b7e95e1184` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:17.595035 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5eefce-b412-492a-b266-146f768caccf None admin] RBAC: Authorizing `identity:get_user(user_id=25d37054f7a04d86a770a4b7e95e1184)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:17.596985 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5eefce-b412-492a-b266-146f768caccf None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:17.603736 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 96/198] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:17 2022] GET /identity/v3/users/25d37054f7a04d86a770a4b7e95e1184 => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:17.603736 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5eefce-b412-492a-b266-146f768caccf None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:17.680680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 103/199] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:17.681605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd9021-0eaf-4c13-a53d-fd3cd0d5437c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:17.730660 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5eefce-b412-492a-b266-146f768caccf None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:17.745249 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:17.749441 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:17.769033 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9da2cd-4221-4a71-bb2b-ef101fe6088b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:17.769911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9da2cd-4221-4a71-bb2b-ef101fe6088b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:17.770219 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9da2cd-4221-4a71-bb2b-ef101fe6088b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:17.770493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9da2cd-4221-4a71-bb2b-ef101fe6088b None admin] PATH_INFO: `/v3/users/b033f58dbd2944a0b1fa3df3e206af7f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:17.771703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9da2cd-4221-4a71-bb2b-ef101fe6088b None admin] RBAC: Authorizing `identity:get_user(user_id=b033f58dbd2944a0b1fa3df3e206af7f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:17.773254 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9da2cd-4221-4a71-bb2b-ef101fe6088b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:17.775244 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 97/200] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:17 2022] GET /identity/v3/users/b033f58dbd2944a0b1fa3df3e206af7f => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:17.776024 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9da2cd-4221-4a71-bb2b-ef101fe6088b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:17.809155 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd9021-0eaf-4c13-a53d-fd3cd0d5437c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:17.854896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33554b41-2a66-475b-867d-a737ccb57ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:17.855814 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33554b41-2a66-475b-867d-a737ccb57ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:17.856098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33554b41-2a66-475b-867d-a737ccb57ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:17.856620 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33554b41-2a66-475b-867d-a737ccb57ba0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:17.903837 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9da2cd-4221-4a71-bb2b-ef101fe6088b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:17.941870 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d48c5-139f-4b00-a5b1-c21f1621d5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:17.942783 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d48c5-139f-4b00-a5b1-c21f1621d5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:17.943061 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d48c5-139f-4b00-a5b1-c21f1621d5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:17.943335 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d48c5-139f-4b00-a5b1-c21f1621d5b5 None admin] PATH_INFO: `/v3/projects/c504b86211c0482394a54688bc1c6c04` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:17.944527 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d48c5-139f-4b00-a5b1-c21f1621d5b5 None admin] RBAC: Authorizing `identity:get_project(project_id=c504b86211c0482394a54688bc1c6c04)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:17.945972 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d48c5-139f-4b00-a5b1-c21f1621d5b5 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:17.947690 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 98/201] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:17 2022] GET /identity/v3/projects/c504b86211c0482394a54688bc1c6c04 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:17.948451 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d48c5-139f-4b00-a5b1-c21f1621d5b5 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:17.951705 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33554b41-2a66-475b-867d-a737ccb57ba0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:17.954797 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33554b41-2a66-475b-867d-a737ccb57ba0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:18.001090 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:18.028148 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:18.063739 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 104/202] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:18.064639 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33554b41-2a66-475b-867d-a737ccb57ba0 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:18.095337 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d48c5-139f-4b00-a5b1-c21f1621d5b5 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:18.140275 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb40166-2a4f-4a84-91b4-5a2353640897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:18.141499 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb40166-2a4f-4a84-91b4-5a2353640897 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:18.141783 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb40166-2a4f-4a84-91b4-5a2353640897 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:18.142360 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb40166-2a4f-4a84-91b4-5a2353640897 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:18.177372 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33554b41-2a66-475b-867d-a737ccb57ba0 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:18.220080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb40166-2a4f-4a84-91b4-5a2353640897 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:18.221683 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb40166-2a4f-4a84-91b4-5a2353640897 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:18.227323 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23ff23-58cf-4234-a5bb-0480c4a24cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:18.227981 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23ff23-58cf-4234-a5bb-0480c4a24cfe None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:18.228266 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23ff23-58cf-4234-a5bb-0480c4a24cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:18.228544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23ff23-58cf-4234-a5bb-0480c4a24cfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:18.229379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23ff23-58cf-4234-a5bb-0480c4a24cfe None admin] RBAC: Adding query filter params (role.id=15cf04fec8c6477088a33bf286f1bbdb, scope.project.id=c504b86211c0482394a54688bc1c6c04, user.id=b033f58dbd2944a0b1fa3df3e206af7f) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:18.229689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23ff23-58cf-4234-a5bb-0480c4a24cfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:18.231701 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23ff23-58cf-4234-a5bb-0480c4a24cfe None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:18.239745 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 105/203] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:18 2022] GET /identity/v3/role_assignments?user.id=b033f58dbd2944a0b1fa3df3e206af7f&scope.project.id=c504b86211c0482394a54688bc1c6c04&role.id=15cf04fec8c6477088a33bf286f1bbdb => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:18.243004 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23ff23-58cf-4234-a5bb-0480c4a24cfe None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:18.255781 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:18.321133 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:18.415540 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23ff23-58cf-4234-a5bb-0480c4a24cfe None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:18.433903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 99/204] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:18.440336 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb40166-2a4f-4a84-91b4-5a2353640897 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:18.460907 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbd153-6239-4cde-91d2-6ef971e12560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:18.463060 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbd153-6239-4cde-91d2-6ef971e12560 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:18.463351 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbd153-6239-4cde-91d2-6ef971e12560 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:18.463628 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbd153-6239-4cde-91d2-6ef971e12560 None admin] PATH_INFO: `/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:18.464990 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbd153-6239-4cde-91d2-6ef971e12560 None admin] RBAC: Authorizing `identity:get_project(project_id=ce0639f1aa774369ae34b4a7e8f866fa)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:18.468143 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbd153-6239-4cde-91d2-6ef971e12560 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:18.475314 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 106/205] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:18 2022] GET /identity/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:18.483170 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbd153-6239-4cde-91d2-6ef971e12560 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:18.565886 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:18.602147 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbd153-6239-4cde-91d2-6ef971e12560 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:18.635040 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ff321-1a2a-4a87-bdd8-5b905d99d326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:18.635708 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ff321-1a2a-4a87-bdd8-5b905d99d326 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:18.635989 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ff321-1a2a-4a87-bdd8-5b905d99d326 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:18.636265 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ff321-1a2a-4a87-bdd8-5b905d99d326 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:18.637097 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ff321-1a2a-4a87-bdd8-5b905d99d326 None admin] RBAC: Adding query filter params (role.id=92fb139a25ed41a09f3d5bceec3752fc, scope.project.id=ce0639f1aa774369ae34b4a7e8f866fa, user.id=25d37054f7a04d86a770a4b7e95e1184) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:18.637409 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ff321-1a2a-4a87-bdd8-5b905d99d326 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:18.638883 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ff321-1a2a-4a87-bdd8-5b905d99d326 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:18.651402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb40166-2a4f-4a84-91b4-5a2353640897 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:18.655870 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 107/206] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:18 2022] GET /identity/v3/role_assignments?user.id=25d37054f7a04d86a770a4b7e95e1184&scope.project.id=ce0639f1aa774369ae34b4a7e8f866fa&role.id=92fb139a25ed41a09f3d5bceec3752fc => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:18.719829 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5dac7a-baf8-4482-b15f-abc023eb9e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:18.720740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5dac7a-baf8-4482-b15f-abc023eb9e9f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:18.721029 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5dac7a-baf8-4482-b15f-abc023eb9e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:18.721292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5dac7a-baf8-4482-b15f-abc023eb9e9f None admin] PATH_INFO: `/v3/projects/c504b86211c0482394a54688bc1c6c04` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:18.722711 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5dac7a-baf8-4482-b15f-abc023eb9e9f None admin] RBAC: Authorizing `identity:get_project(project_id=c504b86211c0482394a54688bc1c6c04)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:18.724195 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5dac7a-baf8-4482-b15f-abc023eb9e9f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:18.726187 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 100/207] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:18 2022] GET /identity/v3/projects/c504b86211c0482394a54688bc1c6c04 => generated 302 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:18.732289 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ff321-1a2a-4a87-bdd8-5b905d99d326 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:18.885220 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ff321-1a2a-4a87-bdd8-5b905d99d326 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:18.922177 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599f460-074f-4fe4-b969-afa149872f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:18.922842 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599f460-074f-4fe4-b969-afa149872f66 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:18.923129 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599f460-074f-4fe4-b969-afa149872f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:18.923408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599f460-074f-4fe4-b969-afa149872f66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:18.924254 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599f460-074f-4fe4-b969-afa149872f66 None admin] RBAC: Adding query filter params (role.id=d39f0a4f271f470490b67062462b2d74, scope.project.id=c504b86211c0482394a54688bc1c6c04, user.id=b033f58dbd2944a0b1fa3df3e206af7f) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:18.924570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599f460-074f-4fe4-b969-afa149872f66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:18.926042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599f460-074f-4fe4-b969-afa149872f66 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:18.932640 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 108/208] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:18 2022] GET /identity/v3/role_assignments?user.id=b033f58dbd2944a0b1fa3df3e206af7f&scope.project.id=c504b86211c0482394a54688bc1c6c04&role.id=d39f0a4f271f470490b67062462b2d74 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:19.752012 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ad69d-1577-4ae4-8311-eeeeaaea0071 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:19.753018 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ad69d-1577-4ae4-8311-eeeeaaea0071 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:19.753533 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ad69d-1577-4ae4-8311-eeeeaaea0071 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:19.755384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 101/209] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:19.760898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff3d7d-519b-4253-b10f-9e1f67b728b7 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:19.761711 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff3d7d-519b-4253-b10f-9e1f67b728b7 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:19.762230 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff3d7d-519b-4253-b10f-9e1f67b728b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:19.768818 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:19.781729 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f4ff3d7d-519b-4253-b10f-9e1f67b728b7 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:19.783272 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f4ff3d7d-519b-4253-b10f-9e1f67b728b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:19.854608 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 109/210] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:09:19.877867 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ad69d-1577-4ae4-8311-eeeeaaea0071 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:19.908177 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:19.916227 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a4d89-0e81-44ff-b9a9-a57dd6195958 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:19.922920 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a4d89-0e81-44ff-b9a9-a57dd6195958 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:19.922920 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a4d89-0e81-44ff-b9a9-a57dd6195958 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:19.922920 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 110/211] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:19.924176 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db562325-eb04-4305-a6e6-69b44466df86 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:19.924678 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db562325-eb04-4305-a6e6-69b44466df86 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:19.925173 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db562325-eb04-4305-a6e6-69b44466df86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:19.942760 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-db562325-eb04-4305-a6e6-69b44466df86 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:19.944680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-db562325-eb04-4305-a6e6-69b44466df86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:19.988712 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ad69d-1577-4ae4-8311-eeeeaaea0071 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:20.019881 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 111/212] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:09:20.026317 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583ca34-9977-43d9-bec5-b5ff890963e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:20.026317 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583ca34-9977-43d9-bec5-b5ff890963e1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:20.026317 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583ca34-9977-43d9-bec5-b5ff890963e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:20.026317 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583ca34-9977-43d9-bec5-b5ff890963e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:20.036921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583ca34-9977-43d9-bec5-b5ff890963e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:20.044764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-5583ca34-9977-43d9-bec5-b5ff890963e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:20.044764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:20.044764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:20.044764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:20.044764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:20.044764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:20.044764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:20.044764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:20.044764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:20.044764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:20.044764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:20.044764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:20.044764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:20.044764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:20.044764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:20.044764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:20.045673 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:20.045673 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:20.045673 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:20.045673 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:20.045673 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:20.045673 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:20.045673 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:20.045673 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:20.045673 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:20.045673 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:20.045673 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:20.045673 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:20.045673 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:20.045673 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:20.045673 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:20.045673 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:20.047036 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:20.047036 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:20.047036 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:20.047036 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:20.047036 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:20.047036 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:20.047036 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:20.047036 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:20.047036 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:20.047036 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:20.047036 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:20.047036 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:09:20.047036 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 102/213] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:20.049911 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db562325-eb04-4305-a6e6-69b44466df86 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:20.052212 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583ca34-9977-43d9-bec5-b5ff890963e1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:20.126522 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:20.168657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:20.174475 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db562325-eb04-4305-a6e6-69b44466df86 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:20.193032 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583ca34-9977-43d9-bec5-b5ff890963e1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:20.217506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcaabc-d1cd-490f-8b28-f081e138f1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:20.218367 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcaabc-d1cd-490f-8b28-f081e138f1cc None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:20.218734 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcaabc-d1cd-490f-8b28-f081e138f1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:20.219098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcaabc-d1cd-490f-8b28-f081e138f1cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:20.220710 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcaabc-d1cd-490f-8b28-f081e138f1cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:20.222499 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcaabc-d1cd-490f-8b28-f081e138f1cc None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:20.229025 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 112/214] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:20.231405 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcaabc-d1cd-490f-8b28-f081e138f1cc None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:20.237767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c5a71-bd06-46a5-8b57-d240f9faa55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:20.238474 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c5a71-bd06-46a5-8b57-d240f9faa55b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:20.238756 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c5a71-bd06-46a5-8b57-d240f9faa55b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:20.239031 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c5a71-bd06-46a5-8b57-d240f9faa55b None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:20.239779 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c5a71-bd06-46a5-8b57-d240f9faa55b None admin] RBAC: Adding query filter params (name=member) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:20.240085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c5a71-bd06-46a5-8b57-d240f9faa55b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:20.241477 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c5a71-bd06-46a5-8b57-d240f9faa55b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:20.250616 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 103/215] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 21:09:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:20.255753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c5a71-bd06-46a5-8b57-d240f9faa55b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:20.346062 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcaabc-d1cd-490f-8b28-f081e138f1cc None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:20.357600 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c5a71-bd06-46a5-8b57-d240f9faa55b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:20.379626 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:20.386671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbd4db-bc50-4bcc-a94f-f8ab03c67253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:20.387712 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbd4db-bc50-4bcc-a94f-f8ab03c67253 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:20.388281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbd4db-bc50-4bcc-a94f-f8ab03c67253 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:20.388749 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbd4db-bc50-4bcc-a94f-f8ab03c67253 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:20.389651 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dbd4db-bc50-4bcc-a94f-f8ab03c67253 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:20.391629 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dbd4db-bc50-4bcc-a94f-f8ab03c67253 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:20.393050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80af3e-3a06-4a8d-83de-c5d333b6055d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:20.397025 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80af3e-3a06-4a8d-83de-c5d333b6055d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:20.397025 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80af3e-3a06-4a8d-83de-c5d333b6055d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:20.397025 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80af3e-3a06-4a8d-83de-c5d333b6055d None admin] PATH_INFO: `/v3/users/a4ff8a337018451a9242f5edd7dc5f8e` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:20.408839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80af3e-3a06-4a8d-83de-c5d333b6055d None admin] RBAC: Authorizing `identity:get_user(user_id=a4ff8a337018451a9242f5edd7dc5f8e)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:20.410401 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80af3e-3a06-4a8d-83de-c5d333b6055d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:20.412356 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 104/216] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:20 2022] GET /identity/v3/users/a4ff8a337018451a9242f5edd7dc5f8e => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:20.417596 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80af3e-3a06-4a8d-83de-c5d333b6055d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:20.420409 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:20.508037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 113/217] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 21:09:20 2022] POST /identity/v3/users => generated 297 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:09:20.508037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e4a1a-c36c-4068-8118-8f986ebb07b2 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:20.508037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e4a1a-c36c-4068-8118-8f986ebb07b2 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:20.508037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e4a1a-c36c-4068-8118-8f986ebb07b2 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:20.508037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 114/218] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:20.513994 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c4375-ec3c-4b00-8be6-58c4d5b888af None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:20.514312 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c4375-ec3c-4b00-8be6-58c4d5b888af None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:20.514600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c4375-ec3c-4b00-8be6-58c4d5b888af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:20.530675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80af3e-3a06-4a8d-83de-c5d333b6055d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:20.535913 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-111c4375-ec3c-4b00-8be6-58c4d5b888af None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:20.537188 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-111c4375-ec3c-4b00-8be6-58c4d5b888af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:20.574539 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97069e69-cf41-45b6-85b6-bb4d7510bd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:20.575210 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97069e69-cf41-45b6-85b6-bb4d7510bd23 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:20.575544 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97069e69-cf41-45b6-85b6-bb4d7510bd23 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:20.575832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97069e69-cf41-45b6-85b6-bb4d7510bd23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:20.639104 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 115/219] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:09:20.665355 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c4375-ec3c-4b00-8be6-58c4d5b888af None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:20.669909 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97069e69-cf41-45b6-85b6-bb4d7510bd23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:20.672062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97069e69-cf41-45b6-85b6-bb4d7510bd23 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:20.674567 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:20.808009 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c4375-ec3c-4b00-8be6-58c4d5b888af None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:20.818189 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 105/220] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:20.824109 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97069e69-cf41-45b6-85b6-bb4d7510bd23 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:20.829881 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:20.853109 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6dac99-b3f6-4049-9126-2844858b53f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:20.853109 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dac99-b3f6-4049-9126-2844858b53f4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:20.853515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dac99-b3f6-4049-9126-2844858b53f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:20.853693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dac99-b3f6-4049-9126-2844858b53f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:20.869652 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6dac99-b3f6-4049-9126-2844858b53f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:20.881750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-da6dac99-b3f6-4049-9126-2844858b53f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:09:20.881750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:20.881750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:20.881750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:20.881750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:20.881750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:20.881750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:20.881750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:20.881750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:20.881750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:20.881750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:20.881750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:20.881750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:20.881750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:20.881750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:20.881750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:20.882825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:20.882825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:20.882825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:20.882825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:20.882825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:20.882825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:20.882825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:20.882825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:20.882825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:20.882825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:20.882825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:20.882825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:20.882825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:20.882825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:20.882825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:20.882825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:20.883802 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:20.883802 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:20.883802 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:20.883802 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:20.883802 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:20.883802 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:20.883802 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:20.883802 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:20.883802 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:20.883802 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:20.883802 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:09:20.883802 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:20.883802 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 116/221] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:09:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:20.890481 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6dac99-b3f6-4049-9126-2844858b53f4 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:20.954192 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97069e69-cf41-45b6-85b6-bb4d7510bd23 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:20.958425 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:21.011358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79f6a1-ad83-4504-9243-7768165daa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:21.012317 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79f6a1-ad83-4504-9243-7768165daa07 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:21.012696 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79f6a1-ad83-4504-9243-7768165daa07 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:21.012977 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79f6a1-ad83-4504-9243-7768165daa07 None admin] PATH_INFO: `/v3/projects/c504b86211c0482394a54688bc1c6c04` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:21.014186 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae79f6a1-ad83-4504-9243-7768165daa07 None admin] RBAC: Authorizing `identity:get_project(project_id=c504b86211c0482394a54688bc1c6c04)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:21.015886 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae79f6a1-ad83-4504-9243-7768165daa07 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:21.022161 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 106/222] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:20 2022] GET /identity/v3/projects/c504b86211c0482394a54688bc1c6c04 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:21.022319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6dac99-b3f6-4049-9126-2844858b53f4 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:21.024937 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79f6a1-ad83-4504-9243-7768165daa07 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:21.055706 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c2cf7-6bd1-4870-980d-1d1939d5f559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:21.056383 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c2cf7-6bd1-4870-980d-1d1939d5f559 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:21.056674 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c2cf7-6bd1-4870-980d-1d1939d5f559 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:21.056988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c2cf7-6bd1-4870-980d-1d1939d5f559 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:21.057743 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c2cf7-6bd1-4870-980d-1d1939d5f559 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:21.058057 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c2cf7-6bd1-4870-980d-1d1939d5f559 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:21.059511 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c2cf7-6bd1-4870-980d-1d1939d5f559 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:21.070329 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 117/223] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:21.072696 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868232f9-51e1-4bb5-aa3d-1c2a21465e96 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:21.072991 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868232f9-51e1-4bb5-aa3d-1c2a21465e96 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:21.073277 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868232f9-51e1-4bb5-aa3d-1c2a21465e96 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:21.074882 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 118/224] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:09:21.075600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868232f9-51e1-4bb5-aa3d-1c2a21465e96 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:21.131004 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:21.159078 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79f6a1-ad83-4504-9243-7768165daa07 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:21.190478 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868232f9-51e1-4bb5-aa3d-1c2a21465e96 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:21.203419 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b9cf9-fab6-4e4f-a409-bb86280ec6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:21.204466 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b9cf9-fab6-4e4f-a409-bb86280ec6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:21.204934 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b9cf9-fab6-4e4f-a409-bb86280ec6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:21.205553 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b9cf9-fab6-4e4f-a409-bb86280ec6b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:21.207036 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b9cf9-fab6-4e4f-a409-bb86280ec6b8 None admin] RBAC: Adding query filter params (role.id=a93b63d74444489ebd7f92fd096f7eaf, scope.project.id=c504b86211c0482394a54688bc1c6c04, user.id=a4ff8a337018451a9242f5edd7dc5f8e) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:21.207546 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b9cf9-fab6-4e4f-a409-bb86280ec6b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:21.209603 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b9cf9-fab6-4e4f-a409-bb86280ec6b8 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:21.217311 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 107/225] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:21 2022] GET /identity/v3/role_assignments?user.id=a4ff8a337018451a9242f5edd7dc5f8e&scope.project.id=c504b86211c0482394a54688bc1c6c04&role.id=a93b63d74444489ebd7f92fd096f7eaf => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:21.220118 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dc64b-717c-459d-a3d4-36ad9b9f7efc None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:21.220939 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dc64b-717c-459d-a3d4-36ad9b9f7efc None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:21.221687 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dc64b-717c-459d-a3d4-36ad9b9f7efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:21.234152 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93072cc8-87bf-4b13-b142-3a1d10f0376b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:21.234152 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93072cc8-87bf-4b13-b142-3a1d10f0376b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:21.234152 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93072cc8-87bf-4b13-b142-3a1d10f0376b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:21.234152 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93072cc8-87bf-4b13-b142-3a1d10f0376b None admin] PATH_INFO: `/v3/users/b033f58dbd2944a0b1fa3df3e206af7f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:21.234577 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93072cc8-87bf-4b13-b142-3a1d10f0376b None admin] RBAC: Authorizing `identity:get_user(user_id=b033f58dbd2944a0b1fa3df3e206af7f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:21.234577 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93072cc8-87bf-4b13-b142-3a1d10f0376b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:21.235231 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 119/226] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:21 2022] GET /identity/v3/users/b033f58dbd2944a0b1fa3df3e206af7f => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:21.241155 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93072cc8-87bf-4b13-b142-3a1d10f0376b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:21.262692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-934dc64b-717c-459d-a3d4-36ad9b9f7efc None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:21.264032 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-934dc64b-717c-459d-a3d4-36ad9b9f7efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:21.335681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:21.406704 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 108/227] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:21.423694 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93072cc8-87bf-4b13-b142-3a1d10f0376b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:21.431162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934dc64b-717c-459d-a3d4-36ad9b9f7efc None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:21.440338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:21.530866 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b453db-d621-4903-a47a-9a1bffa2a528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:21.531735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b453db-d621-4903-a47a-9a1bffa2a528 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:21.532013 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b453db-d621-4903-a47a-9a1bffa2a528 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:21.532281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b453db-d621-4903-a47a-9a1bffa2a528 None admin] PATH_INFO: `/v3/projects/c504b86211c0482394a54688bc1c6c04` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:21.533496 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b453db-d621-4903-a47a-9a1bffa2a528 None admin] RBAC: Authorizing `identity:get_project(project_id=c504b86211c0482394a54688bc1c6c04)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:21.534969 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b453db-d621-4903-a47a-9a1bffa2a528 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:21.536664 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 120/228] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:21 2022] GET /identity/v3/projects/c504b86211c0482394a54688bc1c6c04 => generated 302 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:21.542214 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b453db-d621-4903-a47a-9a1bffa2a528 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:21.553135 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934dc64b-717c-459d-a3d4-36ad9b9f7efc None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:21.621162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0658a-83a1-4b66-84c4-3416b3b27d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:21.621985 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0658a-83a1-4b66-84c4-3416b3b27d61 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:21.622340 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0658a-83a1-4b66-84c4-3416b3b27d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:21.622614 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0658a-83a1-4b66-84c4-3416b3b27d61 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:21.644064 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0658a-83a1-4b66-84c4-3416b3b27d61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:21.652181 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-e4e0658a-83a1-4b66-84c4-3416b3b27d61 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:09:21.652181 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:21.652181 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:21.652181 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:21.652181 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:21.652181 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:21.652181 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:21.652181 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:21.652181 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:21.652181 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:21.652181 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:21.652181 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:21.652181 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:21.652181 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:21.652181 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:21.652181 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:21.653082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:21.653082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:21.653082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:21.653082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:21.653082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:21.653082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:21.653082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:21.653082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:21.653082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:21.653082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:21.653082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:21.653082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:21.653082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:21.653082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:21.653082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:21.653082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:21.653885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:21.653885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:21.653885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:21.653885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:21.653885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:21.653885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:21.653885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:21.653885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:21.653885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:21.653885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:21.653885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:09:21.653885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:09:21.653885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 109/229] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 21:09:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:21.665029 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0658a-83a1-4b66-84c4-3416b3b27d61 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:21.714570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:21.742247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b453db-d621-4903-a47a-9a1bffa2a528 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:21.784012 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a844461-2d2e-45a7-b8ec-049dce94d1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:21.784916 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a844461-2d2e-45a7-b8ec-049dce94d1a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:21.785204 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a844461-2d2e-45a7-b8ec-049dce94d1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:21.785486 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a844461-2d2e-45a7-b8ec-049dce94d1a8 None admin] PATH_INFO: `/v3/projects/c504b86211c0482394a54688bc1c6c04/users/b033f58dbd2944a0b1fa3df3e206af7f/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:21.787644 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a844461-2d2e-45a7-b8ec-049dce94d1a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c504b86211c0482394a54688bc1c6c04, user_id=b033f58dbd2944a0b1fa3df3e206af7f, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:21.789361 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a844461-2d2e-45a7-b8ec-049dce94d1a8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:21.832989 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0658a-83a1-4b66-84c4-3416b3b27d61 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:21.868870 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 121/230] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 21:09:21 2022] PUT /identity/v3/projects/c504b86211c0482394a54688bc1c6c04/users/b033f58dbd2944a0b1fa3df3e206af7f/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:09:21.886096 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277eaeb-4085-4c4b-a24b-96e83ffa78cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:21.886957 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277eaeb-4085-4c4b-a24b-96e83ffa78cb None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:21.887219 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277eaeb-4085-4c4b-a24b-96e83ffa78cb None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:21.887486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277eaeb-4085-4c4b-a24b-96e83ffa78cb None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:21.888293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277eaeb-4085-4c4b-a24b-96e83ffa78cb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:21.888662 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277eaeb-4085-4c4b-a24b-96e83ffa78cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:21.890248 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277eaeb-4085-4c4b-a24b-96e83ffa78cb None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:21.901355 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 110/231] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:09:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:21.907507 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a844461-2d2e-45a7-b8ec-049dce94d1a8 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:21.947177 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:22.017224 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a844461-2d2e-45a7-b8ec-049dce94d1a8 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:22.059600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9744f8-ff28-4d7a-8a1c-0da115e6ea57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:22.060507 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9744f8-ff28-4d7a-8a1c-0da115e6ea57 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:22.060795 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9744f8-ff28-4d7a-8a1c-0da115e6ea57 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:22.061078 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9744f8-ff28-4d7a-8a1c-0da115e6ea57 None admin] PATH_INFO: `/v3/users/b033f58dbd2944a0b1fa3df3e206af7f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:22.062422 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9744f8-ff28-4d7a-8a1c-0da115e6ea57 None admin] RBAC: Authorizing `identity:get_user(user_id=b033f58dbd2944a0b1fa3df3e206af7f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:22.063902 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9744f8-ff28-4d7a-8a1c-0da115e6ea57 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:22.065910 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 122/232] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:21 2022] GET /identity/v3/users/b033f58dbd2944a0b1fa3df3e206af7f => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:22.071792 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277eaeb-4085-4c4b-a24b-96e83ffa78cb None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:22.178935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:22.192849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277eaeb-4085-4c4b-a24b-96e83ffa78cb None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:22.230082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabce9d7-e9db-44e0-9014-37f82a3303ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:22.230971 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabce9d7-e9db-44e0-9014-37f82a3303ca None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:22.231249 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabce9d7-e9db-44e0-9014-37f82a3303ca None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:22.231521 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabce9d7-e9db-44e0-9014-37f82a3303ca None admin] PATH_INFO: `/v3/projects/c504b86211c0482394a54688bc1c6c04` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:22.232692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabce9d7-e9db-44e0-9014-37f82a3303ca None admin] RBAC: Authorizing `identity:get_project(project_id=c504b86211c0482394a54688bc1c6c04)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:22.234388 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabce9d7-e9db-44e0-9014-37f82a3303ca None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:22.236295 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 111/233] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:22 2022] GET /identity/v3/projects/c504b86211c0482394a54688bc1c6c04 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:22.241814 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9744f8-ff28-4d7a-8a1c-0da115e6ea57 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:22.417895 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9744f8-ff28-4d7a-8a1c-0da115e6ea57 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:22.419412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:22.465114 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec757e-dbdc-4e92-8ac0-2e98b42d3090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:22.466010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec757e-dbdc-4e92-8ac0-2e98b42d3090 None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:22.466315 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec757e-dbdc-4e92-8ac0-2e98b42d3090 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:22.466591 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec757e-dbdc-4e92-8ac0-2e98b42d3090 None admin] PATH_INFO: `/v3/projects/c504b86211c0482394a54688bc1c6c04/users/b033f58dbd2944a0b1fa3df3e206af7f/roles/d39f0a4f271f470490b67062462b2d74` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:22.469335 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec757e-dbdc-4e92-8ac0-2e98b42d3090 None admin] RBAC: Authorizing `identity:create_grant(project_id=c504b86211c0482394a54688bc1c6c04, user_id=b033f58dbd2944a0b1fa3df3e206af7f, role_id=d39f0a4f271f470490b67062462b2d74)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:22.470812 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec757e-dbdc-4e92-8ac0-2e98b42d3090 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:22.583610 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 123/234] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 21:09:22 2022] PUT /identity/v3/projects/c504b86211c0482394a54688bc1c6c04/users/b033f58dbd2944a0b1fa3df3e206af7f/roles/d39f0a4f271f470490b67062462b2d74 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:09:23.026354 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8d2ff-7f13-455c-a43b-1b1068e208af None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:23.026908 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8d2ff-7f13-455c-a43b-1b1068e208af None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:23.026908 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8d2ff-7f13-455c-a43b-1b1068e208af None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:23.028252 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 112/235] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:23.043508 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d1db6-63d2-40bb-a24a-d5bedfc267e2 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:23.043979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d1db6-63d2-40bb-a24a-d5bedfc267e2 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:23.044079 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d1db6-63d2-40bb-a24a-d5bedfc267e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:23.067195 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-af6d1db6-63d2-40bb-a24a-d5bedfc267e2 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:23.068411 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-af6d1db6-63d2-40bb-a24a-d5bedfc267e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:23.155506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 124/236] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:23.194608 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8d2ff-7f13-455c-a43b-1b1068e208af None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:23.221396 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3038d2b-b9a0-4735-8e3f-b7f93207136f None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:23.222005 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3038d2b-b9a0-4735-8e3f-b7f93207136f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:23.222507 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3038d2b-b9a0-4735-8e3f-b7f93207136f None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:23.224366 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 125/237] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:09:23.229801 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bd6f6-b3c9-4864-92f5-9e57b0814814 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:23.230344 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bd6f6-b3c9-4864-92f5-9e57b0814814 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:23.230850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bd6f6-b3c9-4864-92f5-9e57b0814814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:23.247841 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-717bd6f6-b3c9-4864-92f5-9e57b0814814 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:23.250102 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-717bd6f6-b3c9-4864-92f5-9e57b0814814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:23.318994 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8d2ff-7f13-455c-a43b-1b1068e208af None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:23.359620 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963282a8-387e-4101-8ade-55bb8a9dec2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:23.360417 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963282a8-387e-4101-8ade-55bb8a9dec2d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:23.360696 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963282a8-387e-4101-8ade-55bb8a9dec2d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:23.360964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963282a8-387e-4101-8ade-55bb8a9dec2d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:23.385282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963282a8-387e-4101-8ade-55bb8a9dec2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:23.395120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-963282a8-387e-4101-8ade-55bb8a9dec2d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:09:23.395120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:23.395120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:23.395120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:23.395120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:23.395120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:23.395120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:23.395120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:23.395120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:23.395120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:23.395120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:23.395120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:23.395120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:23.395120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:23.395120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:23.395120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:23.396059 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:23.396059 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:23.396059 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:23.396059 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:23.396059 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:23.396059 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:23.396059 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:23.396059 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:23.396059 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:23.396059 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:23.396059 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:23.396059 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:23.396059 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:23.396059 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:23.396059 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:23.396059 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:23.396982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:23.396982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:23.396982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:23.396982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:23.396982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:23.396982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:23.396982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:23.396982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:23.396982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:23.396982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:23.396982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:09:23.396982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:09:23.396982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 113/238] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:23.402508 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963282a8-387e-4101-8ade-55bb8a9dec2d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:23.420836 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 126/239] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:23.432677 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:23.455068 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717bd6f6-b3c9-4864-92f5-9e57b0814814 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:23.504912 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:23.575977 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963282a8-387e-4101-8ade-55bb8a9dec2d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:23.617590 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bdd1cd-7fe7-4382-9640-d9086ae3797d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:23.618401 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdd1cd-7fe7-4382-9640-d9086ae3797d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:23.618687 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdd1cd-7fe7-4382-9640-d9086ae3797d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:23.618963 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdd1cd-7fe7-4382-9640-d9086ae3797d None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:23.619730 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bdd1cd-7fe7-4382-9640-d9086ae3797d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:23.620041 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bdd1cd-7fe7-4382-9640-d9086ae3797d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:23.621630 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bdd1cd-7fe7-4382-9640-d9086ae3797d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:23.636168 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 114/240] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 21:09:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:23.636168 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adefef1-71a2-4671-bc19-e976c12cc55b None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:23.636168 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adefef1-71a2-4671-bc19-e976c12cc55b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:23.636168 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adefef1-71a2-4671-bc19-e976c12cc55b None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:23.636168 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 115/241] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:23.642187 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adefef1-71a2-4671-bc19-e976c12cc55b None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:23.655176 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717bd6f6-b3c9-4864-92f5-9e57b0814814 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:23.706866 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4affd-22bb-4f2e-b559-3ec4421a504d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:23.708457 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4affd-22bb-4f2e-b559-3ec4421a504d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:23.708846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4affd-22bb-4f2e-b559-3ec4421a504d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:23.709261 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4affd-22bb-4f2e-b559-3ec4421a504d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:23.711311 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4affd-22bb-4f2e-b559-3ec4421a504d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:23.713726 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4affd-22bb-4f2e-b559-3ec4421a504d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:23.721717 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 127/242] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:23.721717 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc4c69-8541-46a4-bf0a-31bf9a81c943 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:23.721717 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc4c69-8541-46a4-bf0a-31bf9a81c943 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:23.721717 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc4c69-8541-46a4-bf0a-31bf9a81c943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:23.741715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-dccc4c69-8541-46a4-bf0a-31bf9a81c943 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:23.743132 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-dccc4c69-8541-46a4-bf0a-31bf9a81c943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:23.744320 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:23.769963 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adefef1-71a2-4671-bc19-e976c12cc55b None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:23.807094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5d68b-52c0-4309-9fd3-988fec79f3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:23.808237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5d68b-52c0-4309-9fd3-988fec79f3ad None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:23.808703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5d68b-52c0-4309-9fd3-988fec79f3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:23.809152 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5d68b-52c0-4309-9fd3-988fec79f3ad None admin] PATH_INFO: `/v3/users/b423dde28e0844f1a8b7ac296d6eff61` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:23.823657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5d68b-52c0-4309-9fd3-988fec79f3ad None admin] RBAC: Authorizing `identity:get_user(user_id=b423dde28e0844f1a8b7ac296d6eff61)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:23.825461 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5d68b-52c0-4309-9fd3-988fec79f3ad None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:23.832084 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 116/243] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:23 2022] GET /identity/v3/users/b423dde28e0844f1a8b7ac296d6eff61 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:23.832208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 128/244] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:23.833798 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5d68b-52c0-4309-9fd3-988fec79f3ad None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:23.839067 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc4c69-8541-46a4-bf0a-31bf9a81c943 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:23.872729 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:23.969373 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc4c69-8541-46a4-bf0a-31bf9a81c943 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:23.972879 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5d68b-52c0-4309-9fd3-988fec79f3ad None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:24.007671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5c140-7ebd-4972-9c54-de947eb858ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:24.008565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993a970-34e0-47f8-a1bf-0ead6565cba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:24.008982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5c140-7ebd-4972-9c54-de947eb858ca None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:24.009218 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993a970-34e0-47f8-a1bf-0ead6565cba2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:24.009506 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993a970-34e0-47f8-a1bf-0ead6565cba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:24.009787 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993a970-34e0-47f8-a1bf-0ead6565cba2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:24.010059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5c140-7ebd-4972-9c54-de947eb858ca None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:24.010549 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5c140-7ebd-4972-9c54-de947eb858ca None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:24.011472 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5c140-7ebd-4972-9c54-de947eb858ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:24.012505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:24.014454 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5c140-7ebd-4972-9c54-de947eb858ca None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:24.083383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993a970-34e0-47f8-a1bf-0ead6565cba2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:24.084870 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993a970-34e0-47f8-a1bf-0ead6565cba2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:24.109074 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 129/245] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 21:09:23 2022] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:09:24.114147 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5c140-7ebd-4972-9c54-de947eb858ca None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:24.197718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 117/246] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 21:09:24.208983 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993a970-34e0-47f8-a1bf-0ead6565cba2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:24.258488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:24.280629 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:24.306601 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5c140-7ebd-4972-9c54-de947eb858ca None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:24.350974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e38cc9-af22-4e63-b293-a538ef130840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:24.352459 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e38cc9-af22-4e63-b293-a538ef130840 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:24.353744 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e38cc9-af22-4e63-b293-a538ef130840 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:24.354379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e38cc9-af22-4e63-b293-a538ef130840 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:24.376471 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e38cc9-af22-4e63-b293-a538ef130840 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:24.386491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-94e38cc9-af22-4e63-b293-a538ef130840 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:24.386491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:24.386491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:24.386491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:24.386491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:24.386491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:24.386491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:24.386491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:24.386491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:24.386491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:24.386491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:24.386491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:24.386491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:24.386491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:24.386491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:24.386491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:24.387466 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:24.387466 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:24.387466 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:24.387466 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:24.387466 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:24.387466 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:24.387466 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:24.387466 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:24.387466 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:24.387466 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:24.387466 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:24.387466 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:24.387466 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:24.387466 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:24.387466 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:24.387466 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:24.388290 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:24.388290 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:24.388290 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:24.388290 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:24.388290 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:24.388290 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:24.388290 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:24.388290 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:24.388290 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:24.388290 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:24.388290 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:24.388290 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:24.393522 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 130/247] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:24.401955 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e38cc9-af22-4e63-b293-a538ef130840 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:24.405364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993a970-34e0-47f8-a1bf-0ead6565cba2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:24.447255 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de012a32-91c8-4dc2-b8bc-0ea5aa616a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:24.448120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de012a32-91c8-4dc2-b8bc-0ea5aa616a10 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:24.448408 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de012a32-91c8-4dc2-b8bc-0ea5aa616a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:24.448682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de012a32-91c8-4dc2-b8bc-0ea5aa616a10 None admin] PATH_INFO: `/v3/projects/c504b86211c0482394a54688bc1c6c04` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:24.450144 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de012a32-91c8-4dc2-b8bc-0ea5aa616a10 None admin] RBAC: Authorizing `identity:get_project(project_id=c504b86211c0482394a54688bc1c6c04)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:24.451646 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de012a32-91c8-4dc2-b8bc-0ea5aa616a10 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:24.454102 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 118/248] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:24 2022] GET /identity/v3/projects/c504b86211c0482394a54688bc1c6c04 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:24.456885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a03fd-14af-45b0-8972-e56df87bc160 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:24.456885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a03fd-14af-45b0-8972-e56df87bc160 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:24.456885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a03fd-14af-45b0-8972-e56df87bc160 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:24.457394 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 119/249] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:24.464020 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d74a1-aae4-4b6a-989a-6763494edb72 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:24.464020 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d74a1-aae4-4b6a-989a-6763494edb72 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:24.464020 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d74a1-aae4-4b6a-989a-6763494edb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:24.483337 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-b24d74a1-aae4-4b6a-989a-6763494edb72 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:24.484670 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b24d74a1-aae4-4b6a-989a-6763494edb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:24.544398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e38cc9-af22-4e63-b293-a538ef130840 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:24.571941 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 120/250] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:09:24.572881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d74a1-aae4-4b6a-989a-6763494edb72 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:24.584033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81dd5d-ac3f-4708-a5c0-d17f9aef440e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:24.584709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81dd5d-ac3f-4708-a5c0-d17f9aef440e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:24.584997 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81dd5d-ac3f-4708-a5c0-d17f9aef440e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:24.585282 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81dd5d-ac3f-4708-a5c0-d17f9aef440e None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:24.586040 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81dd5d-ac3f-4708-a5c0-d17f9aef440e None admin] RBAC: Adding query filter params (name=member) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:24.586395 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81dd5d-ac3f-4708-a5c0-d17f9aef440e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:24.587817 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81dd5d-ac3f-4708-a5c0-d17f9aef440e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:24.596015 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:24.603103 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 131/251] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 21:09:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:24.608605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81dd5d-ac3f-4708-a5c0-d17f9aef440e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:24.632440 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:24.728960 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d74a1-aae4-4b6a-989a-6763494edb72 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:24.742113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81dd5d-ac3f-4708-a5c0-d17f9aef440e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:24.784789 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3594ae-67f8-4642-b806-0e9b5eec24c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:24.785449 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3594ae-67f8-4642-b806-0e9b5eec24c8 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:24.785733 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3594ae-67f8-4642-b806-0e9b5eec24c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:24.786007 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3594ae-67f8-4642-b806-0e9b5eec24c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:24.786876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3594ae-67f8-4642-b806-0e9b5eec24c8 None admin] RBAC: Adding query filter params (role.id=92fb139a25ed41a09f3d5bceec3752fc, scope.project.id=c504b86211c0482394a54688bc1c6c04, user.id=b423dde28e0844f1a8b7ac296d6eff61) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:24.787186 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3594ae-67f8-4642-b806-0e9b5eec24c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:24.788644 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3594ae-67f8-4642-b806-0e9b5eec24c8 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:24.794560 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18feb83a-4afc-4779-957f-4ea72ac44a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:24.795065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 121/252] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:24 2022] GET /identity/v3/role_assignments?user.id=b423dde28e0844f1a8b7ac296d6eff61&scope.project.id=c504b86211c0482394a54688bc1c6c04&role.id=92fb139a25ed41a09f3d5bceec3752fc => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:24.795910 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18feb83a-4afc-4779-957f-4ea72ac44a9e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:24.796016 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3594ae-67f8-4642-b806-0e9b5eec24c8 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:24.797378 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18feb83a-4afc-4779-957f-4ea72ac44a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:24.798061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18feb83a-4afc-4779-957f-4ea72ac44a9e None admin] PATH_INFO: `/v3/users/a4ff8a337018451a9242f5edd7dc5f8e` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:24.800328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18feb83a-4afc-4779-957f-4ea72ac44a9e None admin] RBAC: Authorizing `identity:get_user(user_id=a4ff8a337018451a9242f5edd7dc5f8e)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:24.802104 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18feb83a-4afc-4779-957f-4ea72ac44a9e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:24.804105 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 132/253] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:24 2022] GET /identity/v3/users/a4ff8a337018451a9242f5edd7dc5f8e => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:24.810657 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18feb83a-4afc-4779-957f-4ea72ac44a9e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:24.912958 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:24.923107 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3594ae-67f8-4642-b806-0e9b5eec24c8 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:24.925907 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:24.960459 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b2ce2-a6ff-47dd-856a-22c11608a7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:24.961266 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b2ce2-a6ff-47dd-856a-22c11608a7ab None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:24.961549 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b2ce2-a6ff-47dd-856a-22c11608a7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:24.961832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b2ce2-a6ff-47dd-856a-22c11608a7ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:24.972200 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18feb83a-4afc-4779-957f-4ea72ac44a9e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:24.973561 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b2ce2-a6ff-47dd-856a-22c11608a7ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:24.981707 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-d99b2ce2-a6ff-47dd-856a-22c11608a7ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:09:24.981707 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:24.981707 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:24.981707 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:24.981707 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:24.981707 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:24.981707 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:24.981707 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:24.981707 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:24.981707 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:24.981707 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:24.981707 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:24.981707 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:24.981707 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:24.981707 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:24.981707 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:24.982703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:24.982703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:24.982703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:24.982703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:24.982703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:24.982703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:24.982703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:24.982703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:24.982703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:24.982703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:24.982703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:24.982703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:24.982703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:24.982703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:24.982703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:24.982703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:24.984143 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:24.984143 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:24.984143 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:24.984143 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:24.984143 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:24.984143 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:24.984143 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:24.984143 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:24.984143 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:24.984143 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:24.984143 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:09:24.984143 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:09:24.984143 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 122/254] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:09:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:24.995393 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b2ce2-a6ff-47dd-856a-22c11608a7ab None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:25.047985 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc90de2-40ac-459e-a80d-b19fc39e88e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:25.048869 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc90de2-40ac-459e-a80d-b19fc39e88e2 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:25.049151 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc90de2-40ac-459e-a80d-b19fc39e88e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:25.049426 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc90de2-40ac-459e-a80d-b19fc39e88e2 None admin] PATH_INFO: `/v3/projects/c504b86211c0482394a54688bc1c6c04` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:25.054043 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc90de2-40ac-459e-a80d-b19fc39e88e2 None admin] RBAC: Authorizing `identity:get_project(project_id=c504b86211c0482394a54688bc1c6c04)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:25.054043 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc90de2-40ac-459e-a80d-b19fc39e88e2 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:25.055158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 133/255] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:24 2022] GET /identity/v3/projects/c504b86211c0482394a54688bc1c6c04 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:25.060554 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc90de2-40ac-459e-a80d-b19fc39e88e2 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:25.194372 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b2ce2-a6ff-47dd-856a-22c11608a7ab None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:25.233266 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc90de2-40ac-459e-a80d-b19fc39e88e2 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:25.238665 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e8fa6-b4c3-4315-85a3-c596c4d79369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:25.239378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e8fa6-b4c3-4315-85a3-c596c4d79369 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:25.239665 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e8fa6-b4c3-4315-85a3-c596c4d79369 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:25.239937 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e8fa6-b4c3-4315-85a3-c596c4d79369 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:25.240680 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e8fa6-b4c3-4315-85a3-c596c4d79369 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:25.240980 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e8fa6-b4c3-4315-85a3-c596c4d79369 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:25.242484 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e8fa6-b4c3-4315-85a3-c596c4d79369 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:25.251119 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 123/256] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:25.252487 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f200f6-9782-4edf-b902-feca5258dd73 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:25.252891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f200f6-9782-4edf-b902-feca5258dd73 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:25.253176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f200f6-9782-4edf-b902-feca5258dd73 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:25.254543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 124/257] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:25.259401 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f200f6-9782-4edf-b902-feca5258dd73 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:25.281305 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:25.302338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa137c0-a84d-4d3b-8cde-d9b7f78f12fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:25.303303 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa137c0-a84d-4d3b-8cde-d9b7f78f12fb None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:25.303585 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa137c0-a84d-4d3b-8cde-d9b7f78f12fb None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:25.309767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa137c0-a84d-4d3b-8cde-d9b7f78f12fb None admin] PATH_INFO: `/v3/projects/c504b86211c0482394a54688bc1c6c04/users/a4ff8a337018451a9242f5edd7dc5f8e/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:25.309767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa137c0-a84d-4d3b-8cde-d9b7f78f12fb None admin] RBAC: Authorizing `identity:create_grant(project_id=c504b86211c0482394a54688bc1c6c04, user_id=a4ff8a337018451a9242f5edd7dc5f8e, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:25.309767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa137c0-a84d-4d3b-8cde-d9b7f78f12fb None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:25.313758 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:25.385643 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 134/258] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 21:09:25 2022] PUT /identity/v3/projects/c504b86211c0482394a54688bc1c6c04/users/a4ff8a337018451a9242f5edd7dc5f8e/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:09:25.387159 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbaa528-ea14-419a-9699-368388b43dd5 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:25.387501 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbaa528-ea14-419a-9699-368388b43dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:25.387832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbaa528-ea14-419a-9699-368388b43dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:25.410863 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f200f6-9782-4edf-b902-feca5258dd73 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:25.423017 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-7bbaa528-ea14-419a-9699-368388b43dd5 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:25.424489 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7bbaa528-ea14-419a-9699-368388b43dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:25.479743 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2261d9-7d8b-4979-b534-5a930e1b18c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:25.480539 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2261d9-7d8b-4979-b534-5a930e1b18c0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:25.480816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2261d9-7d8b-4979-b534-5a930e1b18c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:25.481087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2261d9-7d8b-4979-b534-5a930e1b18c0 None admin] PATH_INFO: `/v3/users/b033f58dbd2944a0b1fa3df3e206af7f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:25.483002 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2261d9-7d8b-4979-b534-5a930e1b18c0 None admin] RBAC: Authorizing `identity:get_user(user_id=b033f58dbd2944a0b1fa3df3e206af7f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:25.485424 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2261d9-7d8b-4979-b534-5a930e1b18c0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:25.490217 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 125/259] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:25 2022] GET /identity/v3/users/b033f58dbd2944a0b1fa3df3e206af7f => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:25.495534 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2261d9-7d8b-4979-b534-5a930e1b18c0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:25.564628 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 135/260] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:25.599195 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbaa528-ea14-419a-9699-368388b43dd5 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:25.638567 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:25.668511 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2261d9-7d8b-4979-b534-5a930e1b18c0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:25.733981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15235a1-e00b-41dd-b270-73b7a70409dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:25.734568 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15235a1-e00b-41dd-b270-73b7a70409dc None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:25.734849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15235a1-e00b-41dd-b270-73b7a70409dc None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:25.735124 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15235a1-e00b-41dd-b270-73b7a70409dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:25.782362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbaa528-ea14-419a-9699-368388b43dd5 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:25.830497 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:25.850846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670526a4-42fd-4371-a066-1810556d084b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:25.851621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670526a4-42fd-4371-a066-1810556d084b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:25.851909 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670526a4-42fd-4371-a066-1810556d084b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:25.852193 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670526a4-42fd-4371-a066-1810556d084b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:25.863074 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15235a1-e00b-41dd-b270-73b7a70409dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:25.864613 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15235a1-e00b-41dd-b270-73b7a70409dc None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:25.877129 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670526a4-42fd-4371-a066-1810556d084b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:25.887208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-670526a4-42fd-4371-a066-1810556d084b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:09:25.887208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:25.887208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:25.887208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:25.887208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:25.887208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:25.887208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:25.887208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:25.887208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:25.887208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:25.887208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:25.887208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:25.887208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:25.887208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:25.887208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:25.887208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:25.888206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:25.888206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:25.888206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:25.888206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:25.888206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:25.888206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:25.888206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:25.888206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:25.888206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:25.888206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:25.888206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:25.888206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:25.888206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:25.888206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:25.888206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:25.888206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:25.889023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:25.889023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:25.889023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:25.889023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:25.889023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:25.889023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:25.889023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:25.889023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:25.889023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:25.889023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:25.889023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:09:25.889023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:25.889023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 136/261] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 21:09:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:25.907152 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670526a4-42fd-4371-a066-1810556d084b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:26.000635 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:26.028047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 126/262] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:26.036770 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15235a1-e00b-41dd-b270-73b7a70409dc None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:26.160346 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670526a4-42fd-4371-a066-1810556d084b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:26.221968 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15235a1-e00b-41dd-b270-73b7a70409dc None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:26.266605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330bedab-7dbf-486d-a62d-ed9820b7d930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:26.267547 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bedab-7dbf-486d-a62d-ed9820b7d930 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:26.267828 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bedab-7dbf-486d-a62d-ed9820b7d930 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:26.268113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bedab-7dbf-486d-a62d-ed9820b7d930 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:26.268855 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330bedab-7dbf-486d-a62d-ed9820b7d930 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:26.269159 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330bedab-7dbf-486d-a62d-ed9820b7d930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:26.270572 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330bedab-7dbf-486d-a62d-ed9820b7d930 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:26.285305 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c797cc-445c-4d26-b7fe-de6f12c47c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:26.286512 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c797cc-445c-4d26-b7fe-de6f12c47c3e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:26.287000 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c797cc-445c-4d26-b7fe-de6f12c47c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:26.287499 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c797cc-445c-4d26-b7fe-de6f12c47c3e None admin] PATH_INFO: `/v3/projects/c504b86211c0482394a54688bc1c6c04` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:26.291099 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c797cc-445c-4d26-b7fe-de6f12c47c3e None admin] RBAC: Authorizing `identity:get_project(project_id=c504b86211c0482394a54688bc1c6c04)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:26.292421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 137/263] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:09:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:26.293272 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c797cc-445c-4d26-b7fe-de6f12c47c3e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:26.295224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 127/264] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:26 2022] GET /identity/v3/projects/c504b86211c0482394a54688bc1c6c04 => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:26.298766 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330bedab-7dbf-486d-a62d-ed9820b7d930 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:26.306056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c797cc-445c-4d26-b7fe-de6f12c47c3e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:26.399582 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:26.410458 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:26.496636 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c797cc-445c-4d26-b7fe-de6f12c47c3e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:26.556319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330bedab-7dbf-486d-a62d-ed9820b7d930 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:26.566745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa07c1-07cc-4fdd-a5ce-f012b4802ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:26.567491 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa07c1-07cc-4fdd-a5ce-f012b4802ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:26.567691 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa07c1-07cc-4fdd-a5ce-f012b4802ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:26.567970 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa07c1-07cc-4fdd-a5ce-f012b4802ca1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:26.568813 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa07c1-07cc-4fdd-a5ce-f012b4802ca1 None admin] RBAC: Adding query filter params (role.id=15cf04fec8c6477088a33bf286f1bbdb, scope.project.id=c504b86211c0482394a54688bc1c6c04, user.id=b033f58dbd2944a0b1fa3df3e206af7f) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:26.569125 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa07c1-07cc-4fdd-a5ce-f012b4802ca1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:26.570620 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa07c1-07cc-4fdd-a5ce-f012b4802ca1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:26.584194 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 128/265] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:26 2022] GET /identity/v3/role_assignments?user.id=b033f58dbd2944a0b1fa3df3e206af7f&scope.project.id=c504b86211c0482394a54688bc1c6c04&role.id=15cf04fec8c6477088a33bf286f1bbdb => generated 608 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:26.627788 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804213f-1c02-45b2-8ca5-122e32b68466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:26.628696 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804213f-1c02-45b2-8ca5-122e32b68466 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:26.628975 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804213f-1c02-45b2-8ca5-122e32b68466 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:26.629248 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804213f-1c02-45b2-8ca5-122e32b68466 None admin] PATH_INFO: `/v3/users/b033f58dbd2944a0b1fa3df3e206af7f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:26.630574 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804213f-1c02-45b2-8ca5-122e32b68466 None admin] RBAC: Authorizing `identity:get_user(user_id=b033f58dbd2944a0b1fa3df3e206af7f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:26.632085 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804213f-1c02-45b2-8ca5-122e32b68466 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:26.633791 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 138/266] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:26 2022] GET /identity/v3/users/b033f58dbd2944a0b1fa3df3e206af7f => generated 283 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:26.640719 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa07c1-07cc-4fdd-a5ce-f012b4802ca1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:26.770809 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa07c1-07cc-4fdd-a5ce-f012b4802ca1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:26.794241 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:26.819436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae3647-0e88-4e24-a78e-7d8b964fe17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:26.820025 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae3647-0e88-4e24-a78e-7d8b964fe17f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:26.820356 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae3647-0e88-4e24-a78e-7d8b964fe17f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:26.820633 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae3647-0e88-4e24-a78e-7d8b964fe17f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:26.910301 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae3647-0e88-4e24-a78e-7d8b964fe17f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:26.911784 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae3647-0e88-4e24-a78e-7d8b964fe17f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:27.015844 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 129/267] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:27.021428 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804213f-1c02-45b2-8ca5-122e32b68466 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:27.151168 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804213f-1c02-45b2-8ca5-122e32b68466 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:27.169216 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:27.195721 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa9057-8484-44cb-b84c-57945fe56af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:27.197534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa9057-8484-44cb-b84c-57945fe56af0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:27.197534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa9057-8484-44cb-b84c-57945fe56af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:27.197534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa9057-8484-44cb-b84c-57945fe56af0 None admin] PATH_INFO: `/v3/projects/c504b86211c0482394a54688bc1c6c04` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:27.198351 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa9057-8484-44cb-b84c-57945fe56af0 None admin] RBAC: Authorizing `identity:get_project(project_id=c504b86211c0482394a54688bc1c6c04)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:27.199839 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa9057-8484-44cb-b84c-57945fe56af0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:27.201543 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 139/268] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:27 2022] GET /identity/v3/projects/c504b86211c0482394a54688bc1c6c04 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:27.207685 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae3647-0e88-4e24-a78e-7d8b964fe17f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:27.230696 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:27.272803 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a937a0-03c3-4cb1-9296-492e22a478bc None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:27.273305 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a937a0-03c3-4cb1-9296-492e22a478bc None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:27.273379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a937a0-03c3-4cb1-9296-492e22a478bc None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:27.275000 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 140/269] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:09:27.280978 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8b990-2cea-4b07-9fd4-99579b88b4ae None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:27.281263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8b990-2cea-4b07-9fd4-99579b88b4ae None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:27.281735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8b990-2cea-4b07-9fd4-99579b88b4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:27.301643 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-86d8b990-2cea-4b07-9fd4-99579b88b4ae None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:27.303170 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-86d8b990-2cea-4b07-9fd4-99579b88b4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:27.332471 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae3647-0e88-4e24-a78e-7d8b964fe17f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:27.373418 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345811e-1718-4e56-9b9a-fcaebad7aecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:27.374924 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345811e-1718-4e56-9b9a-fcaebad7aecf None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:27.375417 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345811e-1718-4e56-9b9a-fcaebad7aecf None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:27.375798 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345811e-1718-4e56-9b9a-fcaebad7aecf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:27.376641 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345811e-1718-4e56-9b9a-fcaebad7aecf None admin] RBAC: Adding query filter params (role.id=d39f0a4f271f470490b67062462b2d74, scope.project.id=c504b86211c0482394a54688bc1c6c04, user.id=b033f58dbd2944a0b1fa3df3e206af7f) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:27.376953 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345811e-1718-4e56-9b9a-fcaebad7aecf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:27.378527 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345811e-1718-4e56-9b9a-fcaebad7aecf None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:27.385100 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 130/270] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:27 2022] GET /identity/v3/role_assignments?user.id=b033f58dbd2944a0b1fa3df3e206af7f&scope.project.id=c504b86211c0482394a54688bc1c6c04&role.id=d39f0a4f271f470490b67062462b2d74 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:27.386475 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4a642-7e0d-42c1-9fe0-6139b90440d4 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:27.386761 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4a642-7e0d-42c1-9fe0-6139b90440d4 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:27.387039 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4a642-7e0d-42c1-9fe0-6139b90440d4 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:27.388260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 131/271] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:27.392078 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 141/272] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:09:27.396458 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceac01f-efb0-4c3c-bd7f-cae57f347e90 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:27.396458 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceac01f-efb0-4c3c-bd7f-cae57f347e90 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:27.396458 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceac01f-efb0-4c3c-bd7f-cae57f347e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:27.413935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-dceac01f-efb0-4c3c-bd7f-cae57f347e90 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:27.415260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-dceac01f-efb0-4c3c-bd7f-cae57f347e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:27.422594 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8b990-2cea-4b07-9fd4-99579b88b4ae None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:27.540383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 132/273] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:27.564451 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceac01f-efb0-4c3c-bd7f-cae57f347e90 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:27.579649 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:27.612924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8b990-2cea-4b07-9fd4-99579b88b4ae None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:27.649823 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:27.663370 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb447a-a318-4d7c-abf1-be547f30902b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:27.664237 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb447a-a318-4d7c-abf1-be547f30902b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:27.664461 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb447a-a318-4d7c-abf1-be547f30902b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:27.664735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb447a-a318-4d7c-abf1-be547f30902b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:27.667719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb447a-a318-4d7c-abf1-be547f30902b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:27.669352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb447a-a318-4d7c-abf1-be547f30902b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:27.671704 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 142/274] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:27.683108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb447a-a318-4d7c-abf1-be547f30902b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:27.686681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceac01f-efb0-4c3c-bd7f-cae57f347e90 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:27.730685 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72023b0-6a16-467c-bd57-213642c5a716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:27.731487 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72023b0-6a16-467c-bd57-213642c5a716 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:27.731768 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72023b0-6a16-467c-bd57-213642c5a716 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:27.734714 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72023b0-6a16-467c-bd57-213642c5a716 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:27.745257 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72023b0-6a16-467c-bd57-213642c5a716 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:27.754299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-c72023b0-6a16-467c-bd57-213642c5a716 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:27.754299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:27.754299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:27.754299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:27.754299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:27.754299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:27.754299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:27.754299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:27.754299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:27.754299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:27.754299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:27.754299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:27.754299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:27.754299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:27.754299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:27.754299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:27.755258 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:27.755258 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:27.755258 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:27.755258 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:27.755258 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:27.755258 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:27.755258 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:27.755258 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:27.755258 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:27.755258 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:27.755258 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:27.755258 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:27.755258 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:27.755258 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:27.755258 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:27.755258 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:27.756505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:27.756505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:27.756505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:27.756505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:27.756505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:27.756505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:27.756505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:27.756505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:27.756505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:27.756505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:27.756505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:27.756505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:09:27.756505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 133/275] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:27.761239 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72023b0-6a16-467c-bd57-213642c5a716 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:27.825673 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb447a-a318-4d7c-abf1-be547f30902b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:27.853080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:27.867516 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18777cf-6229-4d06-b9d1-3bccac3f5cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:27.868197 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18777cf-6229-4d06-b9d1-3bccac3f5cfc None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:27.868615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18777cf-6229-4d06-b9d1-3bccac3f5cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:27.869028 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18777cf-6229-4d06-b9d1-3bccac3f5cfc None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:27.869753 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18777cf-6229-4d06-b9d1-3bccac3f5cfc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:27.871979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18777cf-6229-4d06-b9d1-3bccac3f5cfc None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:27.879974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72023b0-6a16-467c-bd57-213642c5a716 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:27.915599 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de243bb-df7c-472b-bde6-c0947712f421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:27.916474 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de243bb-df7c-472b-bde6-c0947712f421 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:27.916753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de243bb-df7c-472b-bde6-c0947712f421 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:27.917030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de243bb-df7c-472b-bde6-c0947712f421 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:27.917770 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de243bb-df7c-472b-bde6-c0947712f421 None admin] RBAC: Adding query filter params (name=member) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:27.918075 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de243bb-df7c-472b-bde6-c0947712f421 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:27.919534 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de243bb-df7c-472b-bde6-c0947712f421 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:27.927996 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 134/276] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 21:09:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:27.929382 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04ad38-5601-4e4e-a302-a726081671c4 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:27.929584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04ad38-5601-4e4e-a302-a726081671c4 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:27.929785 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04ad38-5601-4e4e-a302-a726081671c4 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:27.931183 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 135/277] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:27.933501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04ad38-5601-4e4e-a302-a726081671c4 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:27.976752 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 143/278] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 21:09:27 2022] POST /identity/v3/users => generated 293 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:09:27.987810 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf55283-ed25-4e56-93f3-84cc14f2bb3c None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:27.988122 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf55283-ed25-4e56-93f3-84cc14f2bb3c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:27.988438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf55283-ed25-4e56-93f3-84cc14f2bb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:28.030945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-faf55283-ed25-4e56-93f3-84cc14f2bb3c None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:28.032291 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-faf55283-ed25-4e56-93f3-84cc14f2bb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:28.043557 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04ad38-5601-4e4e-a302-a726081671c4 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:28.087596 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:28.090455 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32fa76-c5c8-4cd4-8f3a-96c224b7a958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:28.091485 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32fa76-c5c8-4cd4-8f3a-96c224b7a958 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:28.091831 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32fa76-c5c8-4cd4-8f3a-96c224b7a958 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:28.092169 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32fa76-c5c8-4cd4-8f3a-96c224b7a958 None admin] PATH_INFO: `/v3/users/3ae0fa2531614fbea709e6f0ed98a962` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:28.095312 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:28.110310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32fa76-c5c8-4cd4-8f3a-96c224b7a958 None admin] RBAC: Authorizing `identity:get_user(user_id=3ae0fa2531614fbea709e6f0ed98a962)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:28.112245 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32fa76-c5c8-4cd4-8f3a-96c224b7a958 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:28.114251 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 136/279] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:27 2022] GET /identity/v3/users/3ae0fa2531614fbea709e6f0ed98a962 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:28.119633 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32fa76-c5c8-4cd4-8f3a-96c224b7a958 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:28.135123 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 144/280] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:28.158469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf55283-ed25-4e56-93f3-84cc14f2bb3c None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:28.252343 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32fa76-c5c8-4cd4-8f3a-96c224b7a958 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:28.539119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf55283-ed25-4e56-93f3-84cc14f2bb3c None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:28.539639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60409f50-9c6d-41c8-83fe-c8b9ac7e5809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:28.539639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60409f50-9c6d-41c8-83fe-c8b9ac7e5809 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:28.539639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60409f50-9c6d-41c8-83fe-c8b9ac7e5809 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:28.539639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60409f50-9c6d-41c8-83fe-c8b9ac7e5809 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:28.539997 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60409f50-9c6d-41c8-83fe-c8b9ac7e5809 None admin] RBAC: Adding query filter params (role.id=a93b63d74444489ebd7f92fd096f7eaf, user.id=3ae0fa2531614fbea709e6f0ed98a962, scope.system=all) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:28.539997 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60409f50-9c6d-41c8-83fe-c8b9ac7e5809 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:28.539997 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60409f50-9c6d-41c8-83fe-c8b9ac7e5809 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:28.539997 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 137/281] 10.222.0.13 () {56 vars in 1308 bytes} [Tue Jul 5 21:09:28 2022] GET /identity/v3/role_assignments?user.id=3ae0fa2531614fbea709e6f0ed98a962&scope.system=all&role.id=a93b63d74444489ebd7f92fd096f7eaf => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:28.540303 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee9c5c-d3d8-42d6-86e1-b7347dceee68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:28.540303 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee9c5c-d3d8-42d6-86e1-b7347dceee68 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:28.540303 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee9c5c-d3d8-42d6-86e1-b7347dceee68 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:28.540303 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee9c5c-d3d8-42d6-86e1-b7347dceee68 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:28.540621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee9c5c-d3d8-42d6-86e1-b7347dceee68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:28.540621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-b2ee9c5c-d3d8-42d6-86e1-b7347dceee68 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:09:28.540621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:28.540621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:28.540621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:28.540621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:28.540621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:28.540621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:28.540621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:28.540621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:28.540621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:28.540621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:28.540621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:28.540621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:28.541547 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:28.541547 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:28.541547 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:28.541547 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:28.541547 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:28.541547 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:28.541547 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:28.541547 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:28.541547 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:28.541547 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:28.541547 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:28.541547 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:28.541547 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:28.541547 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:28.541547 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:28.541547 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:28.541547 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:28.542650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:28.542650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:28.542650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:28.542650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:28.542650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:28.542650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:28.542650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:28.542650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:28.542650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:28.542650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:28.542650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:28.542650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:28.542650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:09:28.542650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:28.542650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 145/282] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:28.543522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60409f50-9c6d-41c8-83fe-c8b9ac7e5809 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:28.543522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:28.543522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60409f50-9c6d-41c8-83fe-c8b9ac7e5809 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:28.547123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272a44e-998c-4b6f-81ae-51d39832a4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:28.548230 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272a44e-998c-4b6f-81ae-51d39832a4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:28.548671 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272a44e-998c-4b6f-81ae-51d39832a4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:28.549095 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272a44e-998c-4b6f-81ae-51d39832a4d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:28.550013 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272a44e-998c-4b6f-81ae-51d39832a4d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:28.550534 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272a44e-998c-4b6f-81ae-51d39832a4d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:28.552084 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272a44e-998c-4b6f-81ae-51d39832a4d3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:28.561345 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 138/283] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 21:09:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:28.567390 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee9c5c-d3d8-42d6-86e1-b7347dceee68 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:28.571042 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57c508-178c-4724-bfe9-b127ebeb7684 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:28.571341 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57c508-178c-4724-bfe9-b127ebeb7684 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:28.571621 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57c508-178c-4724-bfe9-b127ebeb7684 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:28.573284 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 139/284] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:28.579021 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e1c26-69e0-43ba-8716-bf7859530a34 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:28.579316 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e1c26-69e0-43ba-8716-bf7859530a34 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:28.579600 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e1c26-69e0-43ba-8716-bf7859530a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:28.605793 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-174e1c26-69e0-43ba-8716-bf7859530a34 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:28.607043 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-174e1c26-69e0-43ba-8716-bf7859530a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:28.623090 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:28.736385 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 140/285] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:09:28.739570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee9c5c-d3d8-42d6-86e1-b7347dceee68 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:28.770571 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e1c26-69e0-43ba-8716-bf7859530a34 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:28.782484 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bff50-5344-4912-a4e7-be5fcc48dfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:28.783024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bff50-5344-4912-a4e7-be5fcc48dfe2 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:28.783307 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bff50-5344-4912-a4e7-be5fcc48dfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:28.783614 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bff50-5344-4912-a4e7-be5fcc48dfe2 None admin] PATH_INFO: `/v3/users/b423dde28e0844f1a8b7ac296d6eff61` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:28.784911 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007bff50-5344-4912-a4e7-be5fcc48dfe2 None admin] RBAC: Authorizing `identity:get_user(user_id=b423dde28e0844f1a8b7ac296d6eff61)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:28.786536 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007bff50-5344-4912-a4e7-be5fcc48dfe2 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:28.788351 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 146/286] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:28 2022] GET /identity/v3/users/b423dde28e0844f1a8b7ac296d6eff61 => generated 297 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:28.793722 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bff50-5344-4912-a4e7-be5fcc48dfe2 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:28.858105 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:28.931840 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e1c26-69e0-43ba-8716-bf7859530a34 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:28.965607 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:28.977199 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bff50-5344-4912-a4e7-be5fcc48dfe2 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:29.005808 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef4467-a63b-4269-a22a-bc86c478114d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:29.006649 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef4467-a63b-4269-a22a-bc86c478114d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:29.006942 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef4467-a63b-4269-a22a-bc86c478114d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:29.007223 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef4467-a63b-4269-a22a-bc86c478114d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:29.033102 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7893c63-0b6c-404c-9fee-034b2da38aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:29.033961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7893c63-0b6c-404c-9fee-034b2da38aee None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:29.034287 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7893c63-0b6c-404c-9fee-034b2da38aee None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:29.034570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7893c63-0b6c-404c-9fee-034b2da38aee None admin] PATH_INFO: `/v3/projects/c504b86211c0482394a54688bc1c6c04` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:29.037157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef4467-a63b-4269-a22a-bc86c478114d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:29.042861 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7893c63-0b6c-404c-9fee-034b2da38aee None admin] RBAC: Authorizing `identity:get_project(project_id=c504b86211c0482394a54688bc1c6c04)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:29.044411 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7893c63-0b6c-404c-9fee-034b2da38aee None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:29.044891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-66ef4467-a63b-4269-a22a-bc86c478114d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:29.044891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:29.044891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:29.044891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:29.044891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:29.044891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:29.044891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:29.044891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:29.044891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:29.044891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:29.044891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:29.044891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:29.044891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:29.044891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:29.044891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:29.044891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:29.045781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:29.045781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:29.045781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:29.045781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:29.045781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:29.045781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:29.045781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:29.045781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:29.045781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:29.045781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:29.045781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:29.045781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:29.045781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:29.045781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:29.045781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:29.045781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:29.046796 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:29.046796 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:29.046796 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:29.046796 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:29.046796 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:29.046796 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:29.046796 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:29.046796 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:29.046796 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:29.046796 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:29.046796 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:29.046796 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:09:29.047615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 147/287] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:28 2022] GET /identity/v3/projects/c504b86211c0482394a54688bc1c6c04 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:29.047691 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 141/288] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:29.052157 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7893c63-0b6c-404c-9fee-034b2da38aee None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:29.059173 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef4467-a63b-4269-a22a-bc86c478114d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:29.191830 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7893c63-0b6c-404c-9fee-034b2da38aee None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:29.227441 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b74e87-1461-46f7-8670-b2b01ed171b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:29.228118 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b74e87-1461-46f7-8670-b2b01ed171b9 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:29.228407 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b74e87-1461-46f7-8670-b2b01ed171b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:29.228684 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b74e87-1461-46f7-8670-b2b01ed171b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:29.229569 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b74e87-1461-46f7-8670-b2b01ed171b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:29.229879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b74e87-1461-46f7-8670-b2b01ed171b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:29.231305 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b74e87-1461-46f7-8670-b2b01ed171b9 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:29.240487 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 148/289] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 21:09:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:29.246001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b74e87-1461-46f7-8670-b2b01ed171b9 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:29.278560 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:29.336116 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef4467-a63b-4269-a22a-bc86c478114d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:29.349424 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b74e87-1461-46f7-8670-b2b01ed171b9 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:29.356091 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:29.386600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac1562-a31c-4170-a451-99ecbd0882bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:29.387782 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac1562-a31c-4170-a451-99ecbd0882bb None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:29.388068 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac1562-a31c-4170-a451-99ecbd0882bb None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:29.388741 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac1562-a31c-4170-a451-99ecbd0882bb None admin] PATH_INFO: `/v3/users/a4ff8a337018451a9242f5edd7dc5f8e` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:29.389988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac1562-a31c-4170-a451-99ecbd0882bb None admin] RBAC: Authorizing `identity:get_user(user_id=a4ff8a337018451a9242f5edd7dc5f8e)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:29.391572 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac1562-a31c-4170-a451-99ecbd0882bb None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:29.393794 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 149/290] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:29 2022] GET /identity/v3/users/a4ff8a337018451a9242f5edd7dc5f8e => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:29.399685 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac1562-a31c-4170-a451-99ecbd0882bb None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:29.486892 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf91a71-2181-433b-b63a-b09afdeea8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:29.487868 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf91a71-2181-433b-b63a-b09afdeea8e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:29.488157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf91a71-2181-433b-b63a-b09afdeea8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:29.488437 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf91a71-2181-433b-b63a-b09afdeea8e0 None admin] PATH_INFO: `/v3/projects/c504b86211c0482394a54688bc1c6c04/users/b423dde28e0844f1a8b7ac296d6eff61/roles/92fb139a25ed41a09f3d5bceec3752fc` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:29.495460 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf91a71-2181-433b-b63a-b09afdeea8e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c504b86211c0482394a54688bc1c6c04, user_id=b423dde28e0844f1a8b7ac296d6eff61, role_id=92fb139a25ed41a09f3d5bceec3752fc)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:29.496934 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf91a71-2181-433b-b63a-b09afdeea8e0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:29.502516 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:29.511090 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac1562-a31c-4170-a451-99ecbd0882bb None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:29.547489 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91e1e7-f1ec-408b-a81f-abfe6f44b891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:29.548140 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91e1e7-f1ec-408b-a81f-abfe6f44b891 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:29.548597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91e1e7-f1ec-408b-a81f-abfe6f44b891 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:29.548888 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91e1e7-f1ec-408b-a81f-abfe6f44b891 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:29.617368 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 142/291] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 21:09:29 2022] PUT /identity/v3/projects/c504b86211c0482394a54688bc1c6c04/users/b423dde28e0844f1a8b7ac296d6eff61/roles/92fb139a25ed41a09f3d5bceec3752fc => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:09:29.624812 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db91e1e7-f1ec-408b-a81f-abfe6f44b891 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:29.624812 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db91e1e7-f1ec-408b-a81f-abfe6f44b891 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:29.734858 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:29.742606 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 150/292] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:29.748378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf91a71-2181-433b-b63a-b09afdeea8e0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:29.864482 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf91a71-2181-433b-b63a-b09afdeea8e0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:29.901429 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069dbe5-3c70-4777-9c19-e245de676fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:29.902382 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069dbe5-3c70-4777-9c19-e245de676fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:29.902686 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069dbe5-3c70-4777-9c19-e245de676fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:29.902994 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069dbe5-3c70-4777-9c19-e245de676fb1 None admin] PATH_INFO: `/v3/projects/c504b86211c0482394a54688bc1c6c04` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:29.904203 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069dbe5-3c70-4777-9c19-e245de676fb1 None admin] RBAC: Authorizing `identity:get_project(project_id=c504b86211c0482394a54688bc1c6c04)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:29.906231 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069dbe5-3c70-4777-9c19-e245de676fb1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:29.907944 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 143/293] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:29 2022] GET /identity/v3/projects/c504b86211c0482394a54688bc1c6c04 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:29.915575 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91e1e7-f1ec-408b-a81f-abfe6f44b891 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:30.020872 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91e1e7-f1ec-408b-a81f-abfe6f44b891 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:30.057006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a78e1-170c-4866-8e61-e8e88da83473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:30.057662 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a78e1-170c-4866-8e61-e8e88da83473 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:30.057950 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a78e1-170c-4866-8e61-e8e88da83473 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:30.058311 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a78e1-170c-4866-8e61-e8e88da83473 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:30.059154 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a78e1-170c-4866-8e61-e8e88da83473 None admin] RBAC: Adding query filter params (role.id=a93b63d74444489ebd7f92fd096f7eaf, scope.project.id=c504b86211c0482394a54688bc1c6c04, user.id=a4ff8a337018451a9242f5edd7dc5f8e) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:30.059470 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a78e1-170c-4866-8e61-e8e88da83473 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:30.060925 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a78e1-170c-4866-8e61-e8e88da83473 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:30.067609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 151/294] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:29 2022] GET /identity/v3/role_assignments?user.id=a4ff8a337018451a9242f5edd7dc5f8e&scope.project.id=c504b86211c0482394a54688bc1c6c04&role.id=a93b63d74444489ebd7f92fd096f7eaf => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:30.527974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ebae7-39fc-4f92-a8ca-18d9289cc56c None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:30.528506 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ebae7-39fc-4f92-a8ca-18d9289cc56c None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:30.528506 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ebae7-39fc-4f92-a8ca-18d9289cc56c None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:30.530219 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 144/295] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:30.535864 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c7131-88cb-470f-b024-4551133537c8 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:30.536159 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c7131-88cb-470f-b024-4551133537c8 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:30.536442 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c7131-88cb-470f-b024-4551133537c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:30.557268 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-394c7131-88cb-470f-b024-4551133537c8 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:30.558524 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-394c7131-88cb-470f-b024-4551133537c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:30.622499 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:30.641223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 152/296] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:30.664674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ebae7-39fc-4f92-a8ca-18d9289cc56c None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:30.705250 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:30.786750 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ebae7-39fc-4f92-a8ca-18d9289cc56c None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:30.815136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b964d13-59cf-419c-ba73-96fd47beee9c None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:30.815751 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b964d13-59cf-419c-ba73-96fd47beee9c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:30.816246 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b964d13-59cf-419c-ba73-96fd47beee9c None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:30.818057 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 153/297] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:09:30.822871 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1933fef-aed7-4e75-8444-e1a8b878986a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:30.823902 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1933fef-aed7-4e75-8444-e1a8b878986a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:30.824082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1933fef-aed7-4e75-8444-e1a8b878986a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:30.824232 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1933fef-aed7-4e75-8444-e1a8b878986a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:30.826743 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e017fc-4c12-462c-b7c4-957811e43d00 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:30.827546 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e017fc-4c12-462c-b7c4-957811e43d00 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:30.828335 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e017fc-4c12-462c-b7c4-957811e43d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:30.836973 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1933fef-aed7-4e75-8444-e1a8b878986a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:30.845901 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-91e017fc-4c12-462c-b7c4-957811e43d00 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:30.846465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-a1933fef-aed7-4e75-8444-e1a8b878986a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:09:30.846465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:30.846465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:30.846465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:30.846465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:30.846465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:30.846465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:30.846465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:30.846465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:30.846465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:30.846465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:30.846465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:30.846465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:30.846465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:30.846465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:30.846465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:30.847358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:30.847358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:30.847358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:30.847358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:30.847358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:30.847358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:30.847358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:30.847358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:30.847358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:30.847358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:30.847358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:30.847358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:30.847358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:30.847358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:30.847358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:30.847358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:30.848174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:30.848174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:30.848174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:30.848174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:30.848174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:30.848174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:30.848174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:30.848174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:30.848174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:30.848174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:30.848174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:09:30.848174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:09:30.848174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 145/298] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:30.850358 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-91e017fc-4c12-462c-b7c4-957811e43d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:30.854748 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1933fef-aed7-4e75-8444-e1a8b878986a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:30.934335 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 154/299] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:30.936003 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f74c0e-91b2-466b-9d58-2578fc3f27cd None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:30.936369 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f74c0e-91b2-466b-9d58-2578fc3f27cd None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:30.937949 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f74c0e-91b2-466b-9d58-2578fc3f27cd None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:30.943950 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 155/300] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:30.945152 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b407d7-e737-4d92-8e6c-a40a2ab8aaf5 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:30.945446 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b407d7-e737-4d92-8e6c-a40a2ab8aaf5 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:30.945730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b407d7-e737-4d92-8e6c-a40a2ab8aaf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:30.964308 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-16b407d7-e737-4d92-8e6c-a40a2ab8aaf5 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:30.965415 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:30.965581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-16b407d7-e737-4d92-8e6c-a40a2ab8aaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:30.971312 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1933fef-aed7-4e75-8444-e1a8b878986a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:31.010850 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a38130-9ed0-4e10-982d-358eb9807c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:31.011541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a38130-9ed0-4e10-982d-358eb9807c6b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:31.011973 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a38130-9ed0-4e10-982d-358eb9807c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:31.012222 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a38130-9ed0-4e10-982d-358eb9807c6b None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:31.013000 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a38130-9ed0-4e10-982d-358eb9807c6b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:31.013314 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a38130-9ed0-4e10-982d-358eb9807c6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:31.014973 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a38130-9ed0-4e10-982d-358eb9807c6b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:31.030757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 146/301] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 21:09:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:31.031942 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a38130-9ed0-4e10-982d-358eb9807c6b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:31.036686 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 156/302] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:31.037448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b407d7-e737-4d92-8e6c-a40a2ab8aaf5 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:31.099397 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:31.145265 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a38130-9ed0-4e10-982d-358eb9807c6b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:31.153079 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b407d7-e737-4d92-8e6c-a40a2ab8aaf5 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:31.181731 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323c5ce-2317-4758-b3c5-0fbb0ddf5684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:31.182920 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323c5ce-2317-4758-b3c5-0fbb0ddf5684 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:31.183399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323c5ce-2317-4758-b3c5-0fbb0ddf5684 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:31.183833 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323c5ce-2317-4758-b3c5-0fbb0ddf5684 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:31.187952 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b6de7-212f-437e-885d-61e87417a1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:31.188824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b6de7-212f-437e-885d-61e87417a1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:31.189108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b6de7-212f-437e-885d-61e87417a1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:31.189387 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b6de7-212f-437e-885d-61e87417a1c0 None admin] PATH_INFO: `/v3/users/18dd1c9eb32e4fce939c7aa82e27636b` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:31.195424 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323c5ce-2317-4758-b3c5-0fbb0ddf5684 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:31.203633 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b6de7-212f-437e-885d-61e87417a1c0 None admin] RBAC: Authorizing `identity:get_user(user_id=18dd1c9eb32e4fce939c7aa82e27636b)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:31.204213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-7323c5ce-2317-4758-b3c5-0fbb0ddf5684 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:31.204213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:31.204213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:31.204213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:31.204213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:31.204213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:31.204213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:31.204213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:31.204213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:31.204213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:31.204213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:31.204213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:31.204213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:31.204213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:31.204213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:31.204213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:31.205282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:31.205282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:31.205282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:31.205282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:31.205282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:31.205282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:31.205282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:31.205282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:31.205282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:31.205282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:31.205282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:31.205282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:31.205282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:31.205282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:31.205282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:31.205282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:31.206288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:31.206288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:31.206288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:31.206288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:31.206288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:31.206288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:31.206288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:31.206288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:31.206288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:31.206288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:31.206288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:31.206288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:09:31.207015 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b6de7-212f-437e-885d-61e87417a1c0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:31.207015 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 157/303] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:31 2022] GET /identity/v3/users/18dd1c9eb32e4fce939c7aa82e27636b => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:31.210164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 147/304] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:31.210323 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b6de7-212f-437e-885d-61e87417a1c0 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:31.213088 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323c5ce-2317-4758-b3c5-0fbb0ddf5684 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:31.234186 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:31.317533 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b6de7-212f-437e-885d-61e87417a1c0 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:31.318931 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323c5ce-2317-4758-b3c5-0fbb0ddf5684 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:31.319815 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:31.353264 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b167886-d3a0-43df-bcc6-003598689596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:31.354229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b167886-d3a0-43df-bcc6-003598689596 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:31.354776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b167886-d3a0-43df-bcc6-003598689596 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:31.355046 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ae87a-d5e3-4489-83e3-c938ce6212c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:31.355162 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b167886-d3a0-43df-bcc6-003598689596 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:31.355759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ae87a-d5e3-4489-83e3-c938ce6212c6 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:31.356049 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ae87a-d5e3-4489-83e3-c938ce6212c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:31.356202 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b167886-d3a0-43df-bcc6-003598689596 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:31.356356 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ae87a-d5e3-4489-83e3-c938ce6212c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:31.357072 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ae87a-d5e3-4489-83e3-c938ce6212c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:31.357383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ae87a-d5e3-4489-83e3-c938ce6212c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:31.357656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b167886-d3a0-43df-bcc6-003598689596 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:31.359401 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ae87a-d5e3-4489-83e3-c938ce6212c6 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:31.364959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 158/305] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:31.364959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b167886-d3a0-43df-bcc6-003598689596 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:31.377179 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 148/306] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 21:09:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:31.377179 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ae87a-d5e3-4489-83e3-c938ce6212c6 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:31.462686 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:31.472689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b167886-d3a0-43df-bcc6-003598689596 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:31.483771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ae87a-d5e3-4489-83e3-c938ce6212c6 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:31.509679 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bbfa9-7d02-4e50-a01f-9401284cf706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:31.510364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bbfa9-7d02-4e50-a01f-9401284cf706 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:31.510648 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bbfa9-7d02-4e50-a01f-9401284cf706 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:31.510917 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bbfa9-7d02-4e50-a01f-9401284cf706 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:31.511750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650bbfa9-7d02-4e50-a01f-9401284cf706 None admin] RBAC: Adding query filter params (role.id=92fb139a25ed41a09f3d5bceec3752fc, user.id=18dd1c9eb32e4fce939c7aa82e27636b, scope.system=all) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:31.512095 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650bbfa9-7d02-4e50-a01f-9401284cf706 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:31.513500 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650bbfa9-7d02-4e50-a01f-9401284cf706 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:31.530568 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c3864-f376-41dd-82aa-c7f91fb3cb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:31.531128 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 159/307] 10.222.0.13 () {56 vars in 1308 bytes} [Tue Jul 5 21:09:31 2022] GET /identity/v3/role_assignments?user.id=18dd1c9eb32e4fce939c7aa82e27636b&scope.system=all&role.id=92fb139a25ed41a09f3d5bceec3752fc => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:31.531223 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c3864-f376-41dd-82aa-c7f91fb3cb07 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:31.531329 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bbfa9-7d02-4e50-a01f-9401284cf706 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:31.531421 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c3864-f376-41dd-82aa-c7f91fb3cb07 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:31.531421 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c3864-f376-41dd-82aa-c7f91fb3cb07 None admin] PATH_INFO: `/v3/groups` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:31.531421 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c3864-f376-41dd-82aa-c7f91fb3cb07 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:31.531421 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c3864-f376-41dd-82aa-c7f91fb3cb07 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:31.569871 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:31.606585 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 149/308] 10.222.0.13 () {60 vars in 1134 bytes} [Tue Jul 5 21:09:31 2022] POST /identity/v3/groups => generated 229 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:09:31.660060 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bbfa9-7d02-4e50-a01f-9401284cf706 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:31.705193 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634cd8f-2020-4b47-9253-df6c135474b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:31.706456 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634cd8f-2020-4b47-9253-df6c135474b8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:31.706952 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634cd8f-2020-4b47-9253-df6c135474b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:31.707583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634cd8f-2020-4b47-9253-df6c135474b8 None admin] PATH_INFO: `/v3/users/3ae0fa2531614fbea709e6f0ed98a962` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:31.709133 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634cd8f-2020-4b47-9253-df6c135474b8 None admin] RBAC: Authorizing `identity:get_user(user_id=3ae0fa2531614fbea709e6f0ed98a962)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:31.710940 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634cd8f-2020-4b47-9253-df6c135474b8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:31.712955 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 160/309] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:31 2022] GET /identity/v3/users/3ae0fa2531614fbea709e6f0ed98a962 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:31.719818 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c3864-f376-41dd-82aa-c7f91fb3cb07 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:31.845688 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c3864-f376-41dd-82aa-c7f91fb3cb07 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:31.881924 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15fc2a-e8b5-4238-95f2-4e3b1f6a2a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:31.882879 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15fc2a-e8b5-4238-95f2-4e3b1f6a2a24 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:31.883166 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15fc2a-e8b5-4238-95f2-4e3b1f6a2a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:31.883445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15fc2a-e8b5-4238-95f2-4e3b1f6a2a24 None admin] PATH_INFO: `/v3/system/users/3ae0fa2531614fbea709e6f0ed98a962/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:31.884959 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15fc2a-e8b5-4238-95f2-4e3b1f6a2a24 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3ae0fa2531614fbea709e6f0ed98a962, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:31.886376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15fc2a-e8b5-4238-95f2-4e3b1f6a2a24 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:31.964171 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09617b52-56a6-4bc2-a337-d06bd462c1cf None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:31.964579 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09617b52-56a6-4bc2-a337-d06bd462c1cf None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:31.964763 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09617b52-56a6-4bc2-a337-d06bd462c1cf None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:31.966264 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 161/310] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:09:31.971099 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706fe63-9c56-435e-9ea1-e1a6b53f6ea5 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:31.971389 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706fe63-9c56-435e-9ea1-e1a6b53f6ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:31.971663 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706fe63-9c56-435e-9ea1-e1a6b53f6ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:31.984933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 150/311] 10.222.0.13 () {58 vars in 1334 bytes} [Tue Jul 5 21:09:31 2022] PUT /identity/v3/system/users/3ae0fa2531614fbea709e6f0ed98a962/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:09:31.988675 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-6706fe63-9c56-435e-9ea1-e1a6b53f6ea5 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:31.989915 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6706fe63-9c56-435e-9ea1-e1a6b53f6ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:32.069773 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 162/312] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:09:32.094382 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15fc2a-e8b5-4238-95f2-4e3b1f6a2a24 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:32.098809 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:32.209395 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15fc2a-e8b5-4238-95f2-4e3b1f6a2a24 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:32.244555 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fe1ab-41db-4650-8505-5b0b6b7e0261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:32.245355 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fe1ab-41db-4650-8505-5b0b6b7e0261 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:32.245637 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fe1ab-41db-4650-8505-5b0b6b7e0261 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:32.245911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fe1ab-41db-4650-8505-5b0b6b7e0261 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:32.257311 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954fe1ab-41db-4650-8505-5b0b6b7e0261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:32.265565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-954fe1ab-41db-4650-8505-5b0b6b7e0261 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:09:32.265565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:32.265565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:32.265565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:32.265565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:32.265565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:32.265565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:32.265565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:32.265565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:32.265565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:32.265565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:32.265565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:32.265565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:32.265565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:32.265565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:32.265565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:32.266505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:32.266505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:32.266505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:32.266505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:32.266505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:32.266505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:32.266505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:32.266505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:32.266505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:32.266505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:32.266505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:32.266505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:32.266505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:32.266505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:32.266505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:32.266505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:32.267570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:32.267570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:32.267570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:32.267570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:32.267570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:32.267570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:32.267570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:32.267570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:32.267570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:32.267570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:32.267570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:09:32.267570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:09:32.271225 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 151/313] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:32.273544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706fe63-9c56-435e-9ea1-e1a6b53f6ea5 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:32.308044 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:32.396589 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706fe63-9c56-435e-9ea1-e1a6b53f6ea5 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:32.432477 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6cbf4-e342-4b57-89d4-26ba68ed949a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:32.433500 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6cbf4-e342-4b57-89d4-26ba68ed949a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:32.434011 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6cbf4-e342-4b57-89d4-26ba68ed949a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:32.434507 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6cbf4-e342-4b57-89d4-26ba68ed949a None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:32.435456 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6cbf4-e342-4b57-89d4-26ba68ed949a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:32.435982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6cbf4-e342-4b57-89d4-26ba68ed949a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:32.438262 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6cbf4-e342-4b57-89d4-26ba68ed949a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:32.447602 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 163/314] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 21:09:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:32.453476 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fe1ab-41db-4650-8505-5b0b6b7e0261 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:32.518488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:32.557023 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fe1ab-41db-4650-8505-5b0b6b7e0261 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:32.592156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0794d7c-1222-4a58-8c33-79293fb1ea62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:32.593066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0794d7c-1222-4a58-8c33-79293fb1ea62 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:32.593341 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0794d7c-1222-4a58-8c33-79293fb1ea62 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:32.593611 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0794d7c-1222-4a58-8c33-79293fb1ea62 None admin] PATH_INFO: `/v3/users/b423dde28e0844f1a8b7ac296d6eff61` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:32.594838 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0794d7c-1222-4a58-8c33-79293fb1ea62 None admin] RBAC: Authorizing `identity:get_user(user_id=b423dde28e0844f1a8b7ac296d6eff61)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:32.596306 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0794d7c-1222-4a58-8c33-79293fb1ea62 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:32.602223 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 152/315] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:32 2022] GET /identity/v3/users/b423dde28e0844f1a8b7ac296d6eff61 => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:32.604028 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6cbf4-e342-4b57-89d4-26ba68ed949a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:32.702914 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:32.708621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6cbf4-e342-4b57-89d4-26ba68ed949a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:32.745989 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d02e0-78be-46a6-81d9-da798b0f01bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:32.746679 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d02e0-78be-46a6-81d9-da798b0f01bd None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:32.746963 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d02e0-78be-46a6-81d9-da798b0f01bd None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:32.747239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d02e0-78be-46a6-81d9-da798b0f01bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:32.821396 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d02e0-78be-46a6-81d9-da798b0f01bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:32.823256 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d02e0-78be-46a6-81d9-da798b0f01bd None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:32.922994 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:32.927860 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 164/316] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:32.934603 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0794d7c-1222-4a58-8c33-79293fb1ea62 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:33.037165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0794d7c-1222-4a58-8c33-79293fb1ea62 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:33.066847 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:33.071806 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df81cf4-0de3-4400-9a33-da46aeafb552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:33.072675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df81cf4-0de3-4400-9a33-da46aeafb552 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:33.073223 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df81cf4-0de3-4400-9a33-da46aeafb552 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:33.073502 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df81cf4-0de3-4400-9a33-da46aeafb552 None admin] PATH_INFO: `/v3/projects/c504b86211c0482394a54688bc1c6c04` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:33.074722 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df81cf4-0de3-4400-9a33-da46aeafb552 None admin] RBAC: Authorizing `identity:get_project(project_id=c504b86211c0482394a54688bc1c6c04)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:33.076174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df81cf4-0de3-4400-9a33-da46aeafb552 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:33.082225 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 153/317] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:32 2022] GET /identity/v3/projects/c504b86211c0482394a54688bc1c6c04 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:33.084635 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d02e0-78be-46a6-81d9-da798b0f01bd None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:33.187580 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d02e0-78be-46a6-81d9-da798b0f01bd None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:33.224022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f91d87-6e82-4310-b027-f43039bda477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:33.225045 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f91d87-6e82-4310-b027-f43039bda477 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:33.225556 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f91d87-6e82-4310-b027-f43039bda477 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:33.226045 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f91d87-6e82-4310-b027-f43039bda477 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:33.227106 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f91d87-6e82-4310-b027-f43039bda477 None admin] RBAC: Adding query filter params (role.id=92fb139a25ed41a09f3d5bceec3752fc, scope.project.id=c504b86211c0482394a54688bc1c6c04, user.id=b423dde28e0844f1a8b7ac296d6eff61) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:33.227619 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f91d87-6e82-4310-b027-f43039bda477 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:33.229264 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f91d87-6e82-4310-b027-f43039bda477 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:33.236194 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 165/318] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:33 2022] GET /identity/v3/role_assignments?user.id=b423dde28e0844f1a8b7ac296d6eff61&scope.project.id=c504b86211c0482394a54688bc1c6c04&role.id=92fb139a25ed41a09f3d5bceec3752fc => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:33.671623 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bea87d-0541-4116-9a45-a3afb664747d None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:33.672135 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bea87d-0541-4116-9a45-a3afb664747d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:33.672210 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bea87d-0541-4116-9a45-a3afb664747d None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:33.673715 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 154/319] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:33.678827 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9474b-8a76-4348-92d4-29d09125616e None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:33.679250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9474b-8a76-4348-92d4-29d09125616e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:33.679451 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9474b-8a76-4348-92d4-29d09125616e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:33.696288 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f4d9474b-8a76-4348-92d4-29d09125616e None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:33.697494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f4d9474b-8a76-4348-92d4-29d09125616e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:33.737415 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862d5e9-8d01-40eb-b2fb-e01581241d27 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:33.737716 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862d5e9-8d01-40eb-b2fb-e01581241d27 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:33.737974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862d5e9-8d01-40eb-b2fb-e01581241d27 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:33.739475 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 155/320] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:09:33.744215 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07caec-dcfd-4724-ad05-56c7ee0344f0 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:33.744504 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07caec-dcfd-4724-ad05-56c7ee0344f0 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:33.744789 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07caec-dcfd-4724-ad05-56c7ee0344f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:33.755208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:33.761841 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-1a07caec-dcfd-4724-ad05-56c7ee0344f0 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:33.763923 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1a07caec-dcfd-4724-ad05-56c7ee0344f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:33.767893 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 166/321] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:33.790855 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9474b-8a76-4348-92d4-29d09125616e None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:33.846425 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 156/322] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:09:33.866578 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07caec-dcfd-4724-ad05-56c7ee0344f0 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:33.906725 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9474b-8a76-4348-92d4-29d09125616e None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:33.942439 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a634a-2644-4732-84e2-b359feef630c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:33.943234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a634a-2644-4732-84e2-b359feef630c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:33.943512 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a634a-2644-4732-84e2-b359feef630c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:33.943781 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a634a-2644-4732-84e2-b359feef630c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:33.954829 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a634a-2644-4732-84e2-b359feef630c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:33.962609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-9c0a634a-2644-4732-84e2-b359feef630c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:09:33.962609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:33.962609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:33.962609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:33.962609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:33.962609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:33.962609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:33.962609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:33.962609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:33.962609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:33.962609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:33.962609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:33.962609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:33.962609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:33.962609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:33.962609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:33.963526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:33.963526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:33.963526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:33.963526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:33.963526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:33.963526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:33.963526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:33.963526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:33.963526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:33.963526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:33.963526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:33.963526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:33.963526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:33.963526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:33.963526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:33.963526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:33.964362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:33.964362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:33.964362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:33.964362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:33.964362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:33.964362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:33.964362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:33.964362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:33.964362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:33.964362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:33.964362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:09:33.964362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:33.964362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 167/323] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:33.969995 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a634a-2644-4732-84e2-b359feef630c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:33.976665 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07caec-dcfd-4724-ad05-56c7ee0344f0 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:34.007375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:34.013429 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e43462-0e7f-4847-8618-391c9bca7968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:34.014781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e43462-0e7f-4847-8618-391c9bca7968 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:34.015067 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e43462-0e7f-4847-8618-391c9bca7968 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:34.015337 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e43462-0e7f-4847-8618-391c9bca7968 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:34.017064 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e43462-0e7f-4847-8618-391c9bca7968 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:34.018493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e43462-0e7f-4847-8618-391c9bca7968 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:34.024196 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:34.024887 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 157/324] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:34.025498 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e43462-0e7f-4847-8618-391c9bca7968 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:34.072863 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a634a-2644-4732-84e2-b359feef630c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:34.110099 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740331f9-40cc-4608-a0c0-075056972911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:34.110718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740331f9-40cc-4608-a0c0-075056972911 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:34.110997 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740331f9-40cc-4608-a0c0-075056972911 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:34.111275 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740331f9-40cc-4608-a0c0-075056972911 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:34.112029 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740331f9-40cc-4608-a0c0-075056972911 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:34.112343 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740331f9-40cc-4608-a0c0-075056972911 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:34.113721 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740331f9-40cc-4608-a0c0-075056972911 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:34.122069 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 168/325] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 21:09:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:34.127578 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740331f9-40cc-4608-a0c0-075056972911 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:34.131410 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e43462-0e7f-4847-8618-391c9bca7968 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:34.169281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e996b9d-40dc-45f5-9003-4f4d4e1c685d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:34.169949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e996b9d-40dc-45f5-9003-4f4d4e1c685d None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:34.170262 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e996b9d-40dc-45f5-9003-4f4d4e1c685d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:34.170707 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e996b9d-40dc-45f5-9003-4f4d4e1c685d None admin] PATH_INFO: `/v3/groups` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:34.171828 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e996b9d-40dc-45f5-9003-4f4d4e1c685d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:34.173302 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e996b9d-40dc-45f5-9003-4f4d4e1c685d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:34.231554 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740331f9-40cc-4608-a0c0-075056972911 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:34.244282 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:34.265478 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21c07b-5df2-411d-b974-67e8af034629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:34.266428 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21c07b-5df2-411d-b974-67e8af034629 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:34.266959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21c07b-5df2-411d-b974-67e8af034629 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:34.267233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21c07b-5df2-411d-b974-67e8af034629 None admin] PATH_INFO: `/v3/users/18dd1c9eb32e4fce939c7aa82e27636b` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:34.268435 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21c07b-5df2-411d-b974-67e8af034629 None admin] RBAC: Authorizing `identity:get_user(user_id=18dd1c9eb32e4fce939c7aa82e27636b)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:34.269878 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21c07b-5df2-411d-b974-67e8af034629 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:34.271524 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 169/326] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:34 2022] GET /identity/v3/users/18dd1c9eb32e4fce939c7aa82e27636b => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:34.272569 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 158/327] 10.222.0.13 () {60 vars in 1134 bytes} [Tue Jul 5 21:09:34 2022] POST /identity/v3/groups => generated 226 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:09:34.274716 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be7543-be73-4bb7-b049-d1aeb479e4f0 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:34.275013 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be7543-be73-4bb7-b049-d1aeb479e4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:34.275298 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be7543-be73-4bb7-b049-d1aeb479e4f0 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:34.276882 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 170/328] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:34.287458 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e996b9d-40dc-45f5-9003-4f4d4e1c685d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:34.287668 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf966b-83d4-4560-aeba-0b261003b2a5 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:34.287668 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf966b-83d4-4560-aeba-0b261003b2a5 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:34.287668 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf966b-83d4-4560-aeba-0b261003b2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:34.301014 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-5ddf966b-83d4-4560-aeba-0b261003b2a5 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:34.302291 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5ddf966b-83d4-4560-aeba-0b261003b2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:34.350890 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:34.384315 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 171/329] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:09:34.400166 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e996b9d-40dc-45f5-9003-4f4d4e1c685d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:34.408605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf966b-83d4-4560-aeba-0b261003b2a5 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:34.447935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d5544-979d-4039-b3f2-50bd1cb218c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:34.448810 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d5544-979d-4039-b3f2-50bd1cb218c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:34.449088 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d5544-979d-4039-b3f2-50bd1cb218c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:34.449363 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d5544-979d-4039-b3f2-50bd1cb218c5 None admin] PATH_INFO: `/v3/system/users/18dd1c9eb32e4fce939c7aa82e27636b/roles/92fb139a25ed41a09f3d5bceec3752fc` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:34.450839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d5544-979d-4039-b3f2-50bd1cb218c5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=18dd1c9eb32e4fce939c7aa82e27636b, role_id=92fb139a25ed41a09f3d5bceec3752fc)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:34.452898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d5544-979d-4039-b3f2-50bd1cb218c5 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:34.515259 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 159/330] 10.222.0.13 () {58 vars in 1334 bytes} [Tue Jul 5 21:09:34 2022] PUT /identity/v3/system/users/18dd1c9eb32e4fce939c7aa82e27636b/roles/92fb139a25ed41a09f3d5bceec3752fc => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:09:34.521691 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf966b-83d4-4560-aeba-0b261003b2a5 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:34.536064 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:34.563578 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bc195-d64d-484e-abd6-2e9b865bc120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:34.564380 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bc195-d64d-484e-abd6-2e9b865bc120 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:34.564677 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bc195-d64d-484e-abd6-2e9b865bc120 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:34.564956 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bc195-d64d-484e-abd6-2e9b865bc120 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:34.579899 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084bc195-d64d-484e-abd6-2e9b865bc120 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:34.588175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-084bc195-d64d-484e-abd6-2e9b865bc120 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:34.588175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:34.588175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:34.588175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:34.588175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:34.588175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:34.588175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:34.588175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:34.588175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:34.588175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:34.588175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:34.588175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:34.588175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:34.588175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:34.588175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:34.588175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:34.591784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:34.591784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:34.591784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:34.591784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:34.591784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:34.591784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:34.591784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:34.591784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:34.591784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:34.591784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:34.591784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:34.591784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:34.591784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:34.591784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:34.591784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:34.591784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:34.593392 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:34.593392 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:34.593392 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:34.593392 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:34.593392 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:34.593392 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:34.593392 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:34.593392 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:34.593392 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:34.593392 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:34.593392 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:34.593392 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:34.593392 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 172/331] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:34.598001 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d5544-979d-4039-b3f2-50bd1cb218c5 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:34.725543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d5544-979d-4039-b3f2-50bd1cb218c5 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:34.752661 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:34.764625 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1978e-7bea-43a2-97fe-5452c1ff5152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:34.765296 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1978e-7bea-43a2-97fe-5452c1ff5152 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:34.765572 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1978e-7bea-43a2-97fe-5452c1ff5152 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:34.765843 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1978e-7bea-43a2-97fe-5452c1ff5152 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:34.766984 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1978e-7bea-43a2-97fe-5452c1ff5152 None admin] RBAC: Adding query filter params (name=member) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:34.767290 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1978e-7bea-43a2-97fe-5452c1ff5152 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:34.768695 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1978e-7bea-43a2-97fe-5452c1ff5152 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:34.777723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 160/332] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 21:09:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:34.783519 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bc195-d64d-484e-abd6-2e9b865bc120 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:34.916014 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bc195-d64d-484e-abd6-2e9b865bc120 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:34.955965 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7126aaa-298b-4fbc-b651-5e222204be14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:34.956847 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7126aaa-298b-4fbc-b651-5e222204be14 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:34.957134 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7126aaa-298b-4fbc-b651-5e222204be14 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:34.957414 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7126aaa-298b-4fbc-b651-5e222204be14 None admin] PATH_INFO: `/v3/users/3ae0fa2531614fbea709e6f0ed98a962` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:34.958719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7126aaa-298b-4fbc-b651-5e222204be14 None admin] RBAC: Authorizing `identity:get_user(user_id=3ae0fa2531614fbea709e6f0ed98a962)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:34.960171 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7126aaa-298b-4fbc-b651-5e222204be14 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:34.961806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 173/333] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:34 2022] GET /identity/v3/users/3ae0fa2531614fbea709e6f0ed98a962 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:34.968459 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1978e-7bea-43a2-97fe-5452c1ff5152 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:35.081577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1978e-7bea-43a2-97fe-5452c1ff5152 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:35.119771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83770c73-0705-4473-89bd-d08068579f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:35.120435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83770c73-0705-4473-89bd-d08068579f78 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:35.120714 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83770c73-0705-4473-89bd-d08068579f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:35.120987 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83770c73-0705-4473-89bd-d08068579f78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:35.121822 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83770c73-0705-4473-89bd-d08068579f78 None admin] RBAC: Adding query filter params (role.id=a93b63d74444489ebd7f92fd096f7eaf, user.id=3ae0fa2531614fbea709e6f0ed98a962, scope.system=all) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:35.122145 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83770c73-0705-4473-89bd-d08068579f78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:35.123643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83770c73-0705-4473-89bd-d08068579f78 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:35.138402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 161/334] 10.222.0.13 () {56 vars in 1308 bytes} [Tue Jul 5 21:09:34 2022] GET /identity/v3/role_assignments?user.id=3ae0fa2531614fbea709e6f0ed98a962&scope.system=all&role.id=a93b63d74444489ebd7f92fd096f7eaf => generated 510 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:36.752181 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3723c21-a536-4e5c-9de8-dc947ecf525a None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:36.752688 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3723c21-a536-4e5c-9de8-dc947ecf525a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:36.752795 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3723c21-a536-4e5c-9de8-dc947ecf525a None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:36.754276 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 174/335] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:36.759623 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6941c-67b0-4257-b02c-e60bad0fcd2e None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:36.760032 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6941c-67b0-4257-b02c-e60bad0fcd2e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:36.760199 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6941c-67b0-4257-b02c-e60bad0fcd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:36.784721 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-91e6941c-67b0-4257-b02c-e60bad0fcd2e None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:36.785960 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-91e6941c-67b0-4257-b02c-e60bad0fcd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:36.835356 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:36.874588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 162/336] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:36.909635 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3723c21-a536-4e5c-9de8-dc947ecf525a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:36.954456 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:37.021304 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3723c21-a536-4e5c-9de8-dc947ecf525a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:37.060670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b096e-b128-4d18-bf22-e4c901301a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:37.062084 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b096e-b128-4d18-bf22-e4c901301a2f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:37.062407 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b096e-b128-4d18-bf22-e4c901301a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:37.062688 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b096e-b128-4d18-bf22-e4c901301a2f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:37.074944 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b096e-b128-4d18-bf22-e4c901301a2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:37.082844 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-4a3b096e-b128-4d18-bf22-e4c901301a2f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:37.082844 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:37.082844 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:37.082844 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:37.082844 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:37.082844 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:37.082844 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:37.082844 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:37.082844 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:37.082844 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:37.082844 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:37.082844 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:37.082844 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:37.082844 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:37.082844 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:37.082844 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:37.083767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:37.083767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:37.083767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:37.083767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:37.083767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:37.083767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:37.083767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:37.083767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:37.083767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:37.083767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:37.083767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:37.083767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:37.083767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:37.083767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:37.083767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:37.083767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:37.084573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:37.084573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:37.084573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:37.084573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:37.084573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:37.084573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:37.084573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:37.084573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:37.084573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:37.084573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:37.084573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:37.084573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:37.084573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 175/337] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:37.090061 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6941c-67b0-4257-b02c-e60bad0fcd2e None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:37.124762 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8dbda-b712-44c8-9fd4-4269f81a9638 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:37.125036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8dbda-b712-44c8-9fd4-4269f81a9638 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:37.125242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8dbda-b712-44c8-9fd4-4269f81a9638 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:37.127886 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 176/338] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:37.131937 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a20d78-c8f1-45a5-8e6a-aecf679e78ba None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:37.132225 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a20d78-c8f1-45a5-8e6a-aecf679e78ba None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:37.132503 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a20d78-c8f1-45a5-8e6a-aecf679e78ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:37.152266 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-88a20d78-c8f1-45a5-8e6a-aecf679e78ba None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:37.153473 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-88a20d78-c8f1-45a5-8e6a-aecf679e78ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:37.212760 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6941c-67b0-4257-b02c-e60bad0fcd2e None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:37.248766 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 177/339] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:09:37.268849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8df15-fd6b-4409-b911-c91a4ab14607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:37.269612 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8df15-fd6b-4409-b911-c91a4ab14607 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:37.269932 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8df15-fd6b-4409-b911-c91a4ab14607 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:37.270310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8df15-fd6b-4409-b911-c91a4ab14607 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:37.271218 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8df15-fd6b-4409-b911-c91a4ab14607 None admin] RBAC: Adding query filter params (name=member) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:37.271584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8df15-fd6b-4409-b911-c91a4ab14607 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:37.272981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8df15-fd6b-4409-b911-c91a4ab14607 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:37.282716 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 163/340] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 21:09:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:37.291242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a20d78-c8f1-45a5-8e6a-aecf679e78ba None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:37.301702 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8df15-fd6b-4409-b911-c91a4ab14607 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:37.340994 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:37.410492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:37.477914 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a20d78-c8f1-45a5-8e6a-aecf679e78ba None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:37.507556 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8df15-fd6b-4409-b911-c91a4ab14607 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:37.547826 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc93ff8-60ef-46e4-8ef6-7701450ebcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:37.548490 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc93ff8-60ef-46e4-8ef6-7701450ebcb1 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:37.548776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc93ff8-60ef-46e4-8ef6-7701450ebcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:37.549058 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc93ff8-60ef-46e4-8ef6-7701450ebcb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:37.579910 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb313a2e-d40d-4076-ad7d-9d5910b7d0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:37.580744 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb313a2e-d40d-4076-ad7d-9d5910b7d0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:37.581030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb313a2e-d40d-4076-ad7d-9d5910b7d0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:37.581311 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb313a2e-d40d-4076-ad7d-9d5910b7d0e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:37.603823 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb313a2e-d40d-4076-ad7d-9d5910b7d0e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:37.616975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-eb313a2e-d40d-4076-ad7d-9d5910b7d0e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:09:37.616975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:37.616975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:37.616975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:37.616975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:37.616975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:37.616975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:37.616975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:37.616975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:37.616975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:37.616975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:37.616975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:37.616975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:37.616975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:37.616975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:37.616975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:37.618162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:37.618162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:37.618162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:37.618162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:37.618162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:37.618162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:37.618162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:37.618162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:37.618162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:37.618162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:37.618162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:37.618162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:37.618162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:37.618162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:37.618162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:37.618162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:37.619176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:37.619176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:37.619176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:37.619176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:37.619176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:37.619176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:37.619176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:37.619176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:37.619176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:37.619176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:37.619176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:09:37.619176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:09:37.620026 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 164/341] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:37.622184 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8561c7-1266-4214-9f27-96d2b435ace5 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:37.622184 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8561c7-1266-4214-9f27-96d2b435ace5 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:37.622184 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8561c7-1266-4214-9f27-96d2b435ace5 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:37.626601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 165/342] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:37.631720 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8561c7-1266-4214-9f27-96d2b435ace5 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:37.686809 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc93ff8-60ef-46e4-8ef6-7701450ebcb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:37.688220 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc93ff8-60ef-46e4-8ef6-7701450ebcb1 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:37.745633 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:37.822675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:37.839919 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8561c7-1266-4214-9f27-96d2b435ace5 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:37.896608 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 178/343] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:37.897695 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf7d87-63f5-4e8d-949a-6b6252863694 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:37.897989 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf7d87-63f5-4e8d-949a-6b6252863694 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:37.898297 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf7d87-63f5-4e8d-949a-6b6252863694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:37.912041 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b3d15-3fe4-4031-8b33-1a53ab0f0b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:37.912717 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b3d15-3fe4-4031-8b33-1a53ab0f0b38 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:37.913002 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b3d15-3fe4-4031-8b33-1a53ab0f0b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:37.913283 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b3d15-3fe4-4031-8b33-1a53ab0f0b38 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:37.914185 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b3d15-3fe4-4031-8b33-1a53ab0f0b38 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:37.919139 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b3d15-3fe4-4031-8b33-1a53ab0f0b38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:37.919139 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b3d15-3fe4-4031-8b33-1a53ab0f0b38 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:37.939157 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-47bf7d87-63f5-4e8d-949a-6b6252863694 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:37.940302 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-47bf7d87-63f5-4e8d-949a-6b6252863694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:37.941140 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 166/344] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 21:09:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:37.942042 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b3d15-3fe4-4031-8b33-1a53ab0f0b38 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:38.068174 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 179/345] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:38.069028 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf7d87-63f5-4e8d-949a-6b6252863694 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:38.085075 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b3d15-3fe4-4031-8b33-1a53ab0f0b38 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:38.134208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288558f6-51f7-4d2b-a7b0-f29502db3f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:38.135093 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288558f6-51f7-4d2b-a7b0-f29502db3f31 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:38.135378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288558f6-51f7-4d2b-a7b0-f29502db3f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:38.135658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288558f6-51f7-4d2b-a7b0-f29502db3f31 None admin] PATH_INFO: `/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:38.138344 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288558f6-51f7-4d2b-a7b0-f29502db3f31 None admin] RBAC: Authorizing `identity:get_project(project_id=ce0639f1aa774369ae34b4a7e8f866fa)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:38.140658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288558f6-51f7-4d2b-a7b0-f29502db3f31 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:38.142909 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 167/346] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:37 2022] GET /identity/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:38.143596 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288558f6-51f7-4d2b-a7b0-f29502db3f31 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:38.147843 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:38.199831 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:38.218415 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf7d87-63f5-4e8d-949a-6b6252863694 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:38.257141 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55528437-6714-499b-bbf9-5f2f4be5d0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:38.257768 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55528437-6714-499b-bbf9-5f2f4be5d0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:38.258045 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55528437-6714-499b-bbf9-5f2f4be5d0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:38.258352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55528437-6714-499b-bbf9-5f2f4be5d0c6 None admin] PATH_INFO: `/v3/users/18dd1c9eb32e4fce939c7aa82e27636b` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:38.259566 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55528437-6714-499b-bbf9-5f2f4be5d0c6 None admin] RBAC: Authorizing `identity:get_user(user_id=18dd1c9eb32e4fce939c7aa82e27636b)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:38.261025 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55528437-6714-499b-bbf9-5f2f4be5d0c6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:38.268558 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 180/347] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:38 2022] GET /identity/v3/users/18dd1c9eb32e4fce939c7aa82e27636b => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:38.268558 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55528437-6714-499b-bbf9-5f2f4be5d0c6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:38.299315 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288558f6-51f7-4d2b-a7b0-f29502db3f31 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:38.339883 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794ff15-e0c3-4dec-9d2f-e7d7f4b5d791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:38.341041 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794ff15-e0c3-4dec-9d2f-e7d7f4b5d791 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:38.341548 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794ff15-e0c3-4dec-9d2f-e7d7f4b5d791 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:38.342050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794ff15-e0c3-4dec-9d2f-e7d7f4b5d791 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:38.353774 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794ff15-e0c3-4dec-9d2f-e7d7f4b5d791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:38.363310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-6794ff15-e0c3-4dec-9d2f-e7d7f4b5d791 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:09:38.363310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:38.363310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:38.363310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:38.363310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:38.363310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:38.363310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:38.363310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:38.363310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:38.363310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:38.363310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:38.363310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:38.363310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:38.363310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:38.363310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:38.363310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:38.364338 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:38.364338 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:38.364338 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:38.364338 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:38.364338 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:38.364338 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:38.364338 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:38.364338 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:38.364338 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:38.364338 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:38.364338 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:38.364338 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:38.364338 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:38.364338 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:38.364338 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:38.364338 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:38.365176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:38.365176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:38.365176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:38.365176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:38.365176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:38.365176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:38.365176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:38.365176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:38.365176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:38.365176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:38.365176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:09:38.365176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:09:38.372984 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 168/348] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 21:09:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:38.375262 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dad8d2-be75-4300-8fe9-ae37e113fc31 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:38.375757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dad8d2-be75-4300-8fe9-ae37e113fc31 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:38.376303 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dad8d2-be75-4300-8fe9-ae37e113fc31 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:38.378214 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 169/349] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:38.379204 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dad8d2-be75-4300-8fe9-ae37e113fc31 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:38.383388 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55528437-6714-499b-bbf9-5f2f4be5d0c6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:38.412754 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:38.423253 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5b1c7-1c07-45a3-b199-dff5de59a882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:38.423596 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5b1c7-1c07-45a3-b199-dff5de59a882 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:38.423880 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5b1c7-1c07-45a3-b199-dff5de59a882 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:38.424157 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5b1c7-1c07-45a3-b199-dff5de59a882 None admin] PATH_INFO: `/v3/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:38.431176 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c5b1c7-1c07-45a3-b199-dff5de59a882 None admin] RBAC: Authorizing `identity:get_group(group_id=aeb2e2ec2ebf4345bf4fa443c872e2c1)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:38.432451 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c5b1c7-1c07-45a3-b199-dff5de59a882 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:38.438142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 181/350] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 21:09:38 2022] GET /identity/v3/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:38.438142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5b1c7-1c07-45a3-b199-dff5de59a882 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:38.487463 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:38.505823 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dad8d2-be75-4300-8fe9-ae37e113fc31 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:38.544044 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057daede-4478-4685-8e53-fee6ef0eda7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:38.545352 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057daede-4478-4685-8e53-fee6ef0eda7b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:38.545838 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057daede-4478-4685-8e53-fee6ef0eda7b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:38.546346 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057daede-4478-4685-8e53-fee6ef0eda7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:38.548297 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057daede-4478-4685-8e53-fee6ef0eda7b None admin] RBAC: Adding query filter params (role.id=92fb139a25ed41a09f3d5bceec3752fc, user.id=18dd1c9eb32e4fce939c7aa82e27636b, scope.system=all) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:38.548410 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5b1c7-1c07-45a3-b199-dff5de59a882 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:38.548940 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057daede-4478-4685-8e53-fee6ef0eda7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:38.550850 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057daede-4478-4685-8e53-fee6ef0eda7b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:38.570272 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 170/351] 10.222.0.13 () {56 vars in 1308 bytes} [Tue Jul 5 21:09:38 2022] GET /identity/v3/role_assignments?user.id=18dd1c9eb32e4fce939c7aa82e27636b&scope.system=all&role.id=92fb139a25ed41a09f3d5bceec3752fc => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:38.572171 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089c0e5-352d-4b62-920a-bf79f153a137 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:38.572679 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089c0e5-352d-4b62-920a-bf79f153a137 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:38.573274 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089c0e5-352d-4b62-920a-bf79f153a137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:38.593757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f3a5b-3384-4a28-9f6b-24fa8d74e342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:38.593757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f3a5b-3384-4a28-9f6b-24fa8d74e342 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:38.593757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f3a5b-3384-4a28-9f6b-24fa8d74e342 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:38.593757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f3a5b-3384-4a28-9f6b-24fa8d74e342 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:38.594221 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f3a5b-3384-4a28-9f6b-24fa8d74e342 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:38.594221 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f3a5b-3384-4a28-9f6b-24fa8d74e342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:38.594221 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f3a5b-3384-4a28-9f6b-24fa8d74e342 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:38.606227 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 182/352] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:09:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:38.606227 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f3a5b-3384-4a28-9f6b-24fa8d74e342 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:38.620434 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-8089c0e5-352d-4b62-920a-bf79f153a137 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:38.621996 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8089c0e5-352d-4b62-920a-bf79f153a137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:38.673701 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:38.723806 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 171/353] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:38.724926 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089c0e5-352d-4b62-920a-bf79f153a137 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:38.735732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f3a5b-3384-4a28-9f6b-24fa8d74e342 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:38.780098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c552b-bbea-4bde-832d-17ea990875c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:38.781025 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c552b-bbea-4bde-832d-17ea990875c2 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:38.781454 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c552b-bbea-4bde-832d-17ea990875c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:38.781899 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c552b-bbea-4bde-832d-17ea990875c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:38.783049 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c552b-bbea-4bde-832d-17ea990875c2 None admin] RBAC: Adding query filter params (group.id=aeb2e2ec2ebf4345bf4fa443c872e2c1, role.id=a93b63d74444489ebd7f92fd096f7eaf, scope.project.id=ce0639f1aa774369ae34b4a7e8f866fa) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:38.783522 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c552b-bbea-4bde-832d-17ea990875c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:38.785331 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c552b-bbea-4bde-832d-17ea990875c2 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:38.792612 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 183/354] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Jul 5 21:09:38 2022] GET /identity/v3/role_assignments?group.id=aeb2e2ec2ebf4345bf4fa443c872e2c1&scope.project.id=ce0639f1aa774369ae34b4a7e8f866fa&role.id=a93b63d74444489ebd7f92fd096f7eaf => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:38.794453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a23eb-8e10-41ad-9df5-c70edbeaee6e None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:38.795162 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a23eb-8e10-41ad-9df5-c70edbeaee6e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:38.796114 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a23eb-8e10-41ad-9df5-c70edbeaee6e None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:38.798005 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 184/355] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:38.799288 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a23eb-8e10-41ad-9df5-c70edbeaee6e None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:38.826754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:38.880181 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089c0e5-352d-4b62-920a-bf79f153a137 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:38.925017 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a7a70-3b67-465b-8d6d-d40e9bd4ef58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:38.925992 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a7a70-3b67-465b-8d6d-d40e9bd4ef58 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:38.926478 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a7a70-3b67-465b-8d6d-d40e9bd4ef58 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:38.927123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a7a70-3b67-465b-8d6d-d40e9bd4ef58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:38.973238 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a23eb-8e10-41ad-9df5-c70edbeaee6e None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:38.997980 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:39.017764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a7a70-3b67-465b-8d6d-d40e9bd4ef58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:39.019560 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a7a70-3b67-465b-8d6d-d40e9bd4ef58 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:39.022310 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b136e-9ff2-4a08-9450-057fbf50b592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:39.023464 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b136e-9ff2-4a08-9450-057fbf50b592 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:39.023464 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b136e-9ff2-4a08-9450-057fbf50b592 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:39.023761 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b136e-9ff2-4a08-9450-057fbf50b592 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:39.037252 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b136e-9ff2-4a08-9450-057fbf50b592 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:39.045799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-761b136e-9ff2-4a08-9450-057fbf50b592 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:39.045799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:39.045799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:39.045799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:39.045799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:39.045799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:39.045799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:39.045799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:39.045799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:39.045799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:39.045799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:39.045799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:39.045799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:39.045799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:39.045799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:39.045799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:39.046931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:39.046931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:39.046931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:39.046931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:39.046931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:39.046931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:39.046931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:39.046931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:39.046931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:39.046931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:39.046931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:39.046931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:39.046931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:39.046931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:39.046931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:39.046931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:39.047823 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:39.047823 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:39.047823 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:39.047823 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:39.047823 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:39.047823 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:39.047823 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:39.047823 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:39.047823 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:39.047823 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:39.047823 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:39.047823 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:39.047823 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 185/356] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:39.048648 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce4220-e6ff-4834-bc0d-bc9d31e3ce5f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:39.048939 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce4220-e6ff-4834-bc0d-bc9d31e3ce5f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:39.049220 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce4220-e6ff-4834-bc0d-bc9d31e3ce5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:39.068626 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-8cce4220-e6ff-4834-bc0d-bc9d31e3ce5f None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:39.070262 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8cce4220-e6ff-4834-bc0d-bc9d31e3ce5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:39.106832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:39.145818 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 172/357] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:39.150274 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a7a70-3b67-465b-8d6d-d40e9bd4ef58 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:39.153753 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 186/358] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:39.156016 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce4220-e6ff-4834-bc0d-bc9d31e3ce5f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:39.272912 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce4220-e6ff-4834-bc0d-bc9d31e3ce5f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:39.281401 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a7a70-3b67-465b-8d6d-d40e9bd4ef58 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:39.283315 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:39.320713 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db3fa4-0cce-4f4e-b7aa-d2ef25194d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:39.322524 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db3fa4-0cce-4f4e-b7aa-d2ef25194d8c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:39.322815 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db3fa4-0cce-4f4e-b7aa-d2ef25194d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:39.323097 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db3fa4-0cce-4f4e-b7aa-d2ef25194d8c None admin] PATH_INFO: `/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:39.324320 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db3fa4-0cce-4f4e-b7aa-d2ef25194d8c None admin] RBAC: Authorizing `identity:get_project(project_id=ce0639f1aa774369ae34b4a7e8f866fa)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:39.325776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db3fa4-0cce-4f4e-b7aa-d2ef25194d8c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:39.325972 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bbe3c-d3dd-4ad0-8aea-086698842478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:39.327209 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bbe3c-d3dd-4ad0-8aea-086698842478 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:39.327577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bbe3c-d3dd-4ad0-8aea-086698842478 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:39.327898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bbe3c-d3dd-4ad0-8aea-086698842478 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:39.328510 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 187/359] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:39 2022] GET /identity/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:39.328700 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279bbe3c-d3dd-4ad0-8aea-086698842478 None admin] RBAC: Adding query filter params (name=member) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:39.333466 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279bbe3c-d3dd-4ad0-8aea-086698842478 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:39.333615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db3fa4-0cce-4f4e-b7aa-d2ef25194d8c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:39.333706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279bbe3c-d3dd-4ad0-8aea-086698842478 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:39.340990 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 173/360] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 21:09:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:39.343717 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abec9a-4953-47b3-b2a4-f4223bb435de None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:39.344113 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abec9a-4953-47b3-b2a4-f4223bb435de None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:39.344392 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abec9a-4953-47b3-b2a4-f4223bb435de None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:39.345824 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 174/361] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:39.346523 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45abec9a-4953-47b3-b2a4-f4223bb435de None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:39.393858 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:39.470213 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db3fa4-0cce-4f4e-b7aa-d2ef25194d8c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:39.479485 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45abec9a-4953-47b3-b2a4-f4223bb435de None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:39.511609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ccc6d-2eb1-4de4-8e2c-65d2ae73b5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:39.512516 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ccc6d-2eb1-4de4-8e2c-65d2ae73b5fb None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:39.512870 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ccc6d-2eb1-4de4-8e2c-65d2ae73b5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:39.513217 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ccc6d-2eb1-4de4-8e2c-65d2ae73b5fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:39.527012 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ccc6d-2eb1-4de4-8e2c-65d2ae73b5fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:39.527539 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276750e-602b-4668-8d68-67220885794e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:39.528411 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276750e-602b-4668-8d68-67220885794e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:39.528698 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276750e-602b-4668-8d68-67220885794e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:39.528977 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276750e-602b-4668-8d68-67220885794e None admin] PATH_INFO: `/v3/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:39.530174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276750e-602b-4668-8d68-67220885794e None admin] RBAC: Authorizing `identity:get_group(group_id=aeb2e2ec2ebf4345bf4fa443c872e2c1)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:39.531625 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276750e-602b-4668-8d68-67220885794e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:39.533570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 175/362] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 21:09:39 2022] GET /identity/v3/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:39.534852 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128e835-bcd7-43a8-93e4-0b54def3b8e5 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:39.535139 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128e835-bcd7-43a8-93e4-0b54def3b8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:39.535417 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128e835-bcd7-43a8-93e4-0b54def3b8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:39.536113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-a08ccc6d-2eb1-4de4-8e2c-65d2ae73b5fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:09:39.536113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:39.536113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:39.536113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:39.536113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:39.536113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:39.536113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:39.536113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:39.536113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:39.536113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:39.536113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:39.536113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:39.536113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:39.536113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:39.536113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:39.536113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:39.536987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:39.536987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:39.536987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:39.536987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:39.536987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:39.536987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:39.536987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:39.536987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:39.536987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:39.536987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:39.536987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:39.536987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:39.536987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:39.536987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:39.536987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:39.536987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:39.537818 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:39.537818 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:39.537818 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:39.537818 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:39.537818 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:39.537818 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:39.537818 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:39.537818 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:39.537818 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:39.537818 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:39.537818 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:09:39.537818 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:39.542227 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 188/363] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 21:09:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:39.543106 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ccc6d-2eb1-4de4-8e2c-65d2ae73b5fb None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:39.561508 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-e128e835-bcd7-43a8-93e4-0b54def3b8e5 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:39.563116 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e128e835-bcd7-43a8-93e4-0b54def3b8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:39.598574 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:39.674157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 176/364] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:39.674459 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128e835-bcd7-43a8-93e4-0b54def3b8e5 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:39.691143 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ccc6d-2eb1-4de4-8e2c-65d2ae73b5fb None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:39.717860 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:39.736827 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5b310-fd9e-484d-a2ba-592c20a6bd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:39.737606 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5b310-fd9e-484d-a2ba-592c20a6bd00 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:39.737891 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5b310-fd9e-484d-a2ba-592c20a6bd00 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:39.738195 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5b310-fd9e-484d-a2ba-592c20a6bd00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:39.812919 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128e835-bcd7-43a8-93e4-0b54def3b8e5 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:39.823510 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5b310-fd9e-484d-a2ba-592c20a6bd00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:39.825098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5b310-fd9e-484d-a2ba-592c20a6bd00 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:39.862682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83869e-9194-4257-818e-f77fdb4c061b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:39.865092 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83869e-9194-4257-818e-f77fdb4c061b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:39.865092 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83869e-9194-4257-818e-f77fdb4c061b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:39.865092 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83869e-9194-4257-818e-f77fdb4c061b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:39.865092 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83869e-9194-4257-818e-f77fdb4c061b None admin] RBAC: Adding query filter params (group.id=aeb2e2ec2ebf4345bf4fa443c872e2c1, role.id=d39f0a4f271f470490b67062462b2d74, scope.project.id=ce0639f1aa774369ae34b4a7e8f866fa) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:39.865092 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83869e-9194-4257-818e-f77fdb4c061b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:39.866388 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83869e-9194-4257-818e-f77fdb4c061b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:39.872371 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 177/365] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Jul 5 21:09:39 2022] GET /identity/v3/role_assignments?group.id=aeb2e2ec2ebf4345bf4fa443c872e2c1&scope.project.id=ce0639f1aa774369ae34b4a7e8f866fa&role.id=d39f0a4f271f470490b67062462b2d74 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:39.872702 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:39.872983 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83869e-9194-4257-818e-f77fdb4c061b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:39.987568 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 189/366] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:39.988833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5b310-fd9e-484d-a2ba-592c20a6bd00 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:40.012986 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:40.022881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83869e-9194-4257-818e-f77fdb4c061b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:40.071947 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426aa7b-1a96-469e-8b1a-ecd2def3e679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:40.072635 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426aa7b-1a96-469e-8b1a-ecd2def3e679 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:40.072924 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426aa7b-1a96-469e-8b1a-ecd2def3e679 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:40.073203 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426aa7b-1a96-469e-8b1a-ecd2def3e679 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:40.073980 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426aa7b-1a96-469e-8b1a-ecd2def3e679 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:40.074439 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426aa7b-1a96-469e-8b1a-ecd2def3e679 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:40.076010 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426aa7b-1a96-469e-8b1a-ecd2def3e679 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:40.086657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 178/367] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:09:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:40.087653 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426aa7b-1a96-469e-8b1a-ecd2def3e679 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:40.121310 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5b310-fd9e-484d-a2ba-592c20a6bd00 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:40.179899 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4824bf8-2478-4004-a7fd-b3dab89f3112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:40.180801 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4824bf8-2478-4004-a7fd-b3dab89f3112 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:40.181086 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4824bf8-2478-4004-a7fd-b3dab89f3112 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:40.181364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4824bf8-2478-4004-a7fd-b3dab89f3112 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:40.184382 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:40.195800 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4824bf8-2478-4004-a7fd-b3dab89f3112 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:40.207306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-f4824bf8-2478-4004-a7fd-b3dab89f3112 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:09:40.207306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:40.207306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:40.207306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:40.207306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:40.207306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:40.207306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:40.207306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:40.207306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:40.207306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:40.207306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:40.207306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:40.207306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:40.207306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:40.207306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:40.207306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:40.208239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:40.208239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:40.208239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:40.208239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:40.208239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:40.208239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:40.208239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:40.208239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:40.208239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:40.208239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:40.208239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:40.208239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:40.208239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:40.208239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:40.208239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:40.208239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:40.209071 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:40.209071 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:40.209071 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:40.209071 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:40.209071 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:40.209071 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:40.209071 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:40.209071 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:40.209071 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:40.209071 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:40.209071 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:09:40.209071 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:40.209711 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426aa7b-1a96-469e-8b1a-ecd2def3e679 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:40.212181 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 190/368] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:09:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:40.213196 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4824bf8-2478-4004-a7fd-b3dab89f3112 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:40.255927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1b151-5f3e-4ed1-9047-4b524e178380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:40.256840 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1b151-5f3e-4ed1-9047-4b524e178380 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:40.257039 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1b151-5f3e-4ed1-9047-4b524e178380 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:40.257332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1b151-5f3e-4ed1-9047-4b524e178380 None admin] PATH_INFO: `/v3/projects/c504b86211c0482394a54688bc1c6c04` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:40.258553 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1b151-5f3e-4ed1-9047-4b524e178380 None admin] RBAC: Authorizing `identity:get_project(project_id=c504b86211c0482394a54688bc1c6c04)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:40.260068 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1b151-5f3e-4ed1-9047-4b524e178380 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:40.268617 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 179/369] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:40 2022] GET /identity/v3/projects/c504b86211c0482394a54688bc1c6c04 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:40.269511 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1b151-5f3e-4ed1-9047-4b524e178380 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:40.317516 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:40.350094 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4824bf8-2478-4004-a7fd-b3dab89f3112 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:40.387268 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1b151-5f3e-4ed1-9047-4b524e178380 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:40.390743 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e9089-196c-4ff1-b63e-36b79eeea69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:40.391831 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e9089-196c-4ff1-b63e-36b79eeea69b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:40.392259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e9089-196c-4ff1-b63e-36b79eeea69b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:40.392676 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e9089-196c-4ff1-b63e-36b79eeea69b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:40.429607 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f233b3-51c2-441d-b4fd-a6d8fe978cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:40.430314 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f233b3-51c2-441d-b4fd-a6d8fe978cfb None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:40.430599 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f233b3-51c2-441d-b4fd-a6d8fe978cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:40.430876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f233b3-51c2-441d-b4fd-a6d8fe978cfb None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:40.431630 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f233b3-51c2-441d-b4fd-a6d8fe978cfb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:40.431936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f233b3-51c2-441d-b4fd-a6d8fe978cfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:40.433320 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f233b3-51c2-441d-b4fd-a6d8fe978cfb None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:40.448076 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 180/370] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:40.448930 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f233b3-51c2-441d-b4fd-a6d8fe978cfb None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:40.478155 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:40.486090 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e9089-196c-4ff1-b63e-36b79eeea69b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:40.487604 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e9089-196c-4ff1-b63e-36b79eeea69b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:40.555237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:40.569406 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f233b3-51c2-441d-b4fd-a6d8fe978cfb None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:40.620145 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468baea6-c6cd-4ca4-8365-89565ec69a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:40.621753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468baea6-c6cd-4ca4-8365-89565ec69a44 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:40.622504 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468baea6-c6cd-4ca4-8365-89565ec69a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:40.622953 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468baea6-c6cd-4ca4-8365-89565ec69a44 None admin] PATH_INFO: `/v3/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:40.624949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468baea6-c6cd-4ca4-8365-89565ec69a44 None admin] RBAC: Authorizing `identity:get_group(group_id=aeb2e2ec2ebf4345bf4fa443c872e2c1)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:40.625743 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 191/371] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:40.626794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468baea6-c6cd-4ca4-8365-89565ec69a44 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:40.628895 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 181/372] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 21:09:40 2022] GET /identity/v3/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:40.631019 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e9089-196c-4ff1-b63e-36b79eeea69b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:40.631143 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468baea6-c6cd-4ca4-8365-89565ec69a44 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:40.746470 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:40.753931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e9089-196c-4ff1-b63e-36b79eeea69b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:40.764259 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468baea6-c6cd-4ca4-8365-89565ec69a44 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:40.792823 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203df0df-8353-416f-a9f8-569a853988d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:40.793492 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203df0df-8353-416f-a9f8-569a853988d5 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:40.793775 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203df0df-8353-416f-a9f8-569a853988d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:40.794383 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203df0df-8353-416f-a9f8-569a853988d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:40.803581 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5013c7a-ae43-4197-9f5b-42afc4cdc766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:40.804699 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5013c7a-ae43-4197-9f5b-42afc4cdc766 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:40.805130 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5013c7a-ae43-4197-9f5b-42afc4cdc766 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:40.805550 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5013c7a-ae43-4197-9f5b-42afc4cdc766 None admin] PATH_INFO: `/v3/projects/c504b86211c0482394a54688bc1c6c04` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:40.806944 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5013c7a-ae43-4197-9f5b-42afc4cdc766 None admin] RBAC: Authorizing `identity:get_project(project_id=c504b86211c0482394a54688bc1c6c04)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:40.808546 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5013c7a-ae43-4197-9f5b-42afc4cdc766 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:40.811275 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 182/373] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:40 2022] GET /identity/v3/projects/c504b86211c0482394a54688bc1c6c04 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:40.812197 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5013c7a-ae43-4197-9f5b-42afc4cdc766 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:40.846455 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:40.896324 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203df0df-8353-416f-a9f8-569a853988d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:40.898238 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203df0df-8353-416f-a9f8-569a853988d5 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:40.945134 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5013c7a-ae43-4197-9f5b-42afc4cdc766 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:40.994418 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43db6b7-450a-4b41-8f43-acc929dfedb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:40.995357 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43db6b7-450a-4b41-8f43-acc929dfedb8 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:40.995868 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43db6b7-450a-4b41-8f43-acc929dfedb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:40.996403 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43db6b7-450a-4b41-8f43-acc929dfedb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:40.997547 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43db6b7-450a-4b41-8f43-acc929dfedb8 None admin] RBAC: Adding query filter params (group.id=aeb2e2ec2ebf4345bf4fa443c872e2c1, role.id=a93b63d74444489ebd7f92fd096f7eaf, scope.project.id=c504b86211c0482394a54688bc1c6c04) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:40.998014 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43db6b7-450a-4b41-8f43-acc929dfedb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:40.999742 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43db6b7-450a-4b41-8f43-acc929dfedb8 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:41.006736 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 183/374] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Jul 5 21:09:40 2022] GET /identity/v3/role_assignments?group.id=aeb2e2ec2ebf4345bf4fa443c872e2c1&scope.project.id=c504b86211c0482394a54688bc1c6c04&role.id=a93b63d74444489ebd7f92fd096f7eaf => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:41.007817 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43db6b7-450a-4b41-8f43-acc929dfedb8 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:41.010464 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:41.026194 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 192/375] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:41.031105 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203df0df-8353-416f-a9f8-569a853988d5 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:41.135277 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:41.151449 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43db6b7-450a-4b41-8f43-acc929dfedb8 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:41.174743 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203df0df-8353-416f-a9f8-569a853988d5 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:41.197464 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdabbc13-9737-40ff-bf7f-4782c953aa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:41.198361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabbc13-9737-40ff-bf7f-4782c953aa87 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:41.198652 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabbc13-9737-40ff-bf7f-4782c953aa87 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:41.198937 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabbc13-9737-40ff-bf7f-4782c953aa87 None admin] PATH_INFO: `/v3/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:41.200230 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdabbc13-9737-40ff-bf7f-4782c953aa87 None admin] RBAC: Authorizing `identity:get_group(group_id=aeb2e2ec2ebf4345bf4fa443c872e2c1)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:41.201838 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdabbc13-9737-40ff-bf7f-4782c953aa87 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:41.203600 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 184/376] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 21:09:41 2022] GET /identity/v3/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:41.204971 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5602a7-60e4-424d-a6b5-6694434f64e4 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:41.205264 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5602a7-60e4-424d-a6b5-6694434f64e4 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:41.205544 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5602a7-60e4-424d-a6b5-6694434f64e4 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:41.210316 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 185/377] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:41.212902 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a0d12-35ea-4ca6-a30f-5d5f3b23849f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:41.213193 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a0d12-35ea-4ca6-a30f-5d5f3b23849f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:41.213639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a0d12-35ea-4ca6-a30f-5d5f3b23849f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:41.226262 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b18cc-b1ce-4b75-8aa4-f49d53a2d6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:41.227149 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b18cc-b1ce-4b75-8aa4-f49d53a2d6e6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:41.227437 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b18cc-b1ce-4b75-8aa4-f49d53a2d6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:41.227715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b18cc-b1ce-4b75-8aa4-f49d53a2d6e6 None admin] PATH_INFO: `/v3/projects/c475db16707f46ecb5780cbec2330b6e` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:41.229386 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b18cc-b1ce-4b75-8aa4-f49d53a2d6e6 None admin] RBAC: Authorizing `identity:get_project(project_id=c475db16707f46ecb5780cbec2330b6e)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:41.230908 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b18cc-b1ce-4b75-8aa4-f49d53a2d6e6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:41.233785 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 193/378] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:41 2022] GET /identity/v3/projects/c475db16707f46ecb5780cbec2330b6e => generated 344 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:41.234724 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b18cc-b1ce-4b75-8aa4-f49d53a2d6e6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:41.239667 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-032a0d12-35ea-4ca6-a30f-5d5f3b23849f None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:41.240954 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-032a0d12-35ea-4ca6-a30f-5d5f3b23849f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:41.310485 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:41.333084 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 186/379] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:09:41.334134 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a0d12-35ea-4ca6-a30f-5d5f3b23849f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:41.360091 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b18cc-b1ce-4b75-8aa4-f49d53a2d6e6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:41.410152 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ffde0-39e9-449c-8061-23d1d6559834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:41.411330 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ffde0-39e9-449c-8061-23d1d6559834 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:41.411739 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ffde0-39e9-449c-8061-23d1d6559834 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:41.412025 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ffde0-39e9-449c-8061-23d1d6559834 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:41.413050 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ffde0-39e9-449c-8061-23d1d6559834 None admin] RBAC: Adding query filter params (group.id=aeb2e2ec2ebf4345bf4fa443c872e2c1, role.id=d39f0a4f271f470490b67062462b2d74, scope.project.id=c504b86211c0482394a54688bc1c6c04) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:41.413671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ffde0-39e9-449c-8061-23d1d6559834 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:41.416575 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ffde0-39e9-449c-8061-23d1d6559834 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:41.424628 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 194/380] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Jul 5 21:09:41 2022] GET /identity/v3/role_assignments?group.id=aeb2e2ec2ebf4345bf4fa443c872e2c1&scope.project.id=c504b86211c0482394a54688bc1c6c04&role.id=d39f0a4f271f470490b67062462b2d74 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:41.430444 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ffde0-39e9-449c-8061-23d1d6559834 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:41.471443 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:41.490446 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a0d12-35ea-4ca6-a30f-5d5f3b23849f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:41.534206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481235a-bc7a-4ffd-b809-1355d6940120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:41.535123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481235a-bc7a-4ffd-b809-1355d6940120 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:41.535414 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481235a-bc7a-4ffd-b809-1355d6940120 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:41.535909 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481235a-bc7a-4ffd-b809-1355d6940120 None admin] PATH_INFO: `/v3/groups/44c6e9eed2df4806b5d8ed5b2a643895` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:41.546384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481235a-bc7a-4ffd-b809-1355d6940120 None admin] RBAC: Authorizing `identity:get_group(group_id=44c6e9eed2df4806b5d8ed5b2a643895)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:41.548248 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481235a-bc7a-4ffd-b809-1355d6940120 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:41.550024 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 187/381] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 21:09:41 2022] GET /identity/v3/groups/44c6e9eed2df4806b5d8ed5b2a643895 => generated 229 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:41.559451 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481235a-bc7a-4ffd-b809-1355d6940120 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:41.619165 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ffde0-39e9-449c-8061-23d1d6559834 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:41.665335 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:41.678450 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b00020-0950-4f12-897d-3dd937722a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:41.679330 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b00020-0950-4f12-897d-3dd937722a0a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:41.679619 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b00020-0950-4f12-897d-3dd937722a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:41.679902 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b00020-0950-4f12-897d-3dd937722a0a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:41.692411 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481235a-bc7a-4ffd-b809-1355d6940120 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:41.696534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b00020-0950-4f12-897d-3dd937722a0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:41.707250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-97b00020-0950-4f12-897d-3dd937722a0a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:41.707250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:41.707250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:41.707250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:41.707250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:41.707250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:41.707250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:41.707250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:41.707250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:41.707250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:41.707250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:41.707250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:41.707250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:41.707250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:41.707250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:41.707250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:41.708234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:41.708234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:41.708234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:41.708234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:41.708234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:41.708234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:41.708234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:41.708234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:41.708234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:41.708234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:41.708234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:41.708234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:41.708234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:41.708234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:41.708234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:41.708234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:41.709056 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:41.709056 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:41.709056 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:41.709056 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:41.709056 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:41.709056 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:41.709056 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:41.709056 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:41.709056 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:41.709056 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:41.709056 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:41.709056 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:41.709056 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 195/382] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:41.715027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b00020-0950-4f12-897d-3dd937722a0a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:41.745071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2d013-43ab-4d36-bea3-c60dfb1e235e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:41.745748 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2d013-43ab-4d36-bea3-c60dfb1e235e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:41.746033 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2d013-43ab-4d36-bea3-c60dfb1e235e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:41.746334 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2d013-43ab-4d36-bea3-c60dfb1e235e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:41.747186 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2d013-43ab-4d36-bea3-c60dfb1e235e None admin] RBAC: Adding query filter params (group.id=44c6e9eed2df4806b5d8ed5b2a643895, role.id=15cf04fec8c6477088a33bf286f1bbdb, scope.project.id=c475db16707f46ecb5780cbec2330b6e) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:41.747502 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2d013-43ab-4d36-bea3-c60dfb1e235e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:41.749538 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2d013-43ab-4d36-bea3-c60dfb1e235e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:41.764366 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 188/383] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Jul 5 21:09:41 2022] GET /identity/v3/role_assignments?group.id=44c6e9eed2df4806b5d8ed5b2a643895&scope.project.id=c475db16707f46ecb5780cbec2330b6e&role.id=15cf04fec8c6477088a33bf286f1bbdb => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:41.861607 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b00020-0950-4f12-897d-3dd937722a0a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:41.900916 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa78c6-03f2-41ca-9704-de34a8689277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:41.901609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa78c6-03f2-41ca-9704-de34a8689277 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:41.901893 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa78c6-03f2-41ca-9704-de34a8689277 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:41.902191 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa78c6-03f2-41ca-9704-de34a8689277 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:41.902962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa78c6-03f2-41ca-9704-de34a8689277 None admin] RBAC: Adding query filter params (name=member) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:41.903269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa78c6-03f2-41ca-9704-de34a8689277 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:41.904776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa78c6-03f2-41ca-9704-de34a8689277 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:41.920518 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 196/384] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 21:09:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:41.922009 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2d013-43ab-4d36-bea3-c60dfb1e235e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:41.950962 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:42.074066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2d013-43ab-4d36-bea3-c60dfb1e235e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:42.117338 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a36c9f-92db-428e-a83c-ab37ed4ff61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:42.118625 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a36c9f-92db-428e-a83c-ab37ed4ff61d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:42.119137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a36c9f-92db-428e-a83c-ab37ed4ff61d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:42.119609 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a36c9f-92db-428e-a83c-ab37ed4ff61d None admin] PATH_INFO: `/v3/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:42.126851 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a36c9f-92db-428e-a83c-ab37ed4ff61d None admin] RBAC: Authorizing `identity:get_group(group_id=aeb2e2ec2ebf4345bf4fa443c872e2c1)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:42.128595 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a36c9f-92db-428e-a83c-ab37ed4ff61d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:42.130592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 189/385] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 21:09:41 2022] GET /identity/v3/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:42.136202 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa78c6-03f2-41ca-9704-de34a8689277 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:42.195455 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:42.258163 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa78c6-03f2-41ca-9704-de34a8689277 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:42.304154 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b17f4-97eb-4a03-8c94-93fd0181bb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:42.305404 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b17f4-97eb-4a03-8c94-93fd0181bb46 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:42.305893 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b17f4-97eb-4a03-8c94-93fd0181bb46 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:42.306416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b17f4-97eb-4a03-8c94-93fd0181bb46 None admin] PATH_INFO: `/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:42.307880 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b17f4-97eb-4a03-8c94-93fd0181bb46 None admin] RBAC: Authorizing `identity:get_project(project_id=ce0639f1aa774369ae34b4a7e8f866fa)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:42.309635 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b17f4-97eb-4a03-8c94-93fd0181bb46 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:42.312453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 197/386] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:42 2022] GET /identity/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:42.317681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a36c9f-92db-428e-a83c-ab37ed4ff61d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:42.437543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:42.449649 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14778a-6d73-4aa1-841a-e04278384815 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:42.450278 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14778a-6d73-4aa1-841a-e04278384815 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:42.450819 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14778a-6d73-4aa1-841a-e04278384815 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:42.452711 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 198/387] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:42.458383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a36c9f-92db-428e-a83c-ab37ed4ff61d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:42.472839 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee559b26-d2b7-47c0-8e87-a1bb37af5aed None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:42.473543 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee559b26-d2b7-47c0-8e87-a1bb37af5aed None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:42.474038 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee559b26-d2b7-47c0-8e87-a1bb37af5aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:42.497326 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c279b44-68f7-4806-a69d-b91b2a4bc9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:42.499687 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c279b44-68f7-4806-a69d-b91b2a4bc9dd None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:42.499687 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c279b44-68f7-4806-a69d-b91b2a4bc9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:42.499687 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c279b44-68f7-4806-a69d-b91b2a4bc9dd None admin] PATH_INFO: `/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:42.501213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c279b44-68f7-4806-a69d-b91b2a4bc9dd None admin] RBAC: Authorizing `identity:create_grant(project_id=ce0639f1aa774369ae34b4a7e8f866fa, group_id=aeb2e2ec2ebf4345bf4fa443c872e2c1, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:42.503579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c279b44-68f7-4806-a69d-b91b2a4bc9dd None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:42.514156 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-ee559b26-d2b7-47c0-8e87-a1bb37af5aed None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:42.514156 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ee559b26-d2b7-47c0-8e87-a1bb37af5aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:42.610969 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 199/388] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:42.631694 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 190/389] 10.222.0.13 () {58 vars in 1442 bytes} [Tue Jul 5 21:09:42 2022] PUT /identity/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:09:42.646527 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee559b26-d2b7-47c0-8e87-a1bb37af5aed None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:42.706485 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:42.777121 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee559b26-d2b7-47c0-8e87-a1bb37af5aed None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:42.814911 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3627ea-3caf-4ed5-b72d-363f3fa4d04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:42.815735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3627ea-3caf-4ed5-b72d-363f3fa4d04e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:42.816011 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3627ea-3caf-4ed5-b72d-363f3fa4d04e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:42.816287 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3627ea-3caf-4ed5-b72d-363f3fa4d04e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:42.827936 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3627ea-3caf-4ed5-b72d-363f3fa4d04e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:42.836212 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-ae3627ea-3caf-4ed5-b72d-363f3fa4d04e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:09:42.836212 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:42.836212 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:42.836212 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:42.836212 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:42.836212 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:42.836212 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:42.836212 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:42.836212 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:42.836212 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:42.836212 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:42.836212 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:42.836212 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:42.836212 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:42.836212 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:42.836212 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:42.837161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:42.837161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:42.837161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:42.837161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:42.837161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:42.837161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:42.837161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:42.837161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:42.837161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:42.837161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:42.837161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:42.837161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:42.837161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:42.837161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:42.837161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:42.837161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:42.838112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:42.838112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:42.838112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:42.838112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:42.838112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:42.838112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:42.838112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:42.838112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:42.838112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:42.838112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:42.838112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:09:42.838112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:42.838112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 200/390] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 21:09:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:42.844907 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c279b44-68f7-4806-a69d-b91b2a4bc9dd None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:42.997002 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c279b44-68f7-4806-a69d-b91b2a4bc9dd None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:43.039074 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff518bc4-4caa-4bb5-bea0-b0a1c9045c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:43.040146 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff518bc4-4caa-4bb5-bea0-b0a1c9045c46 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:43.040638 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff518bc4-4caa-4bb5-bea0-b0a1c9045c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:43.041133 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff518bc4-4caa-4bb5-bea0-b0a1c9045c46 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:43.042107 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff518bc4-4caa-4bb5-bea0-b0a1c9045c46 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:43.042641 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff518bc4-4caa-4bb5-bea0-b0a1c9045c46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:43.044247 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff518bc4-4caa-4bb5-bea0-b0a1c9045c46 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:43.054324 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 191/391] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:09:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:43.061678 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3627ea-3caf-4ed5-b72d-363f3fa4d04e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:43.219243 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3627ea-3caf-4ed5-b72d-363f3fa4d04e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:43.226613 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:43.264692 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995cb34b-2ca7-4d6e-a37b-1e5dfd62bf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:43.265568 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cb34b-2ca7-4d6e-a37b-1e5dfd62bf0c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:43.265896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cb34b-2ca7-4d6e-a37b-1e5dfd62bf0c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:43.266250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cb34b-2ca7-4d6e-a37b-1e5dfd62bf0c None admin] PATH_INFO: `/v3/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:43.270847 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995cb34b-2ca7-4d6e-a37b-1e5dfd62bf0c None admin] RBAC: Authorizing `identity:get_group(group_id=aeb2e2ec2ebf4345bf4fa443c872e2c1)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:43.272307 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995cb34b-2ca7-4d6e-a37b-1e5dfd62bf0c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:43.274385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 201/392] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 21:09:43 2022] GET /identity/v3/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:43.280171 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff518bc4-4caa-4bb5-bea0-b0a1c9045c46 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:43.301948 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:43.425474 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff518bc4-4caa-4bb5-bea0-b0a1c9045c46 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:43.471678 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aee63c-cde1-4e5c-be64-a751d53bb88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:43.472541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aee63c-cde1-4e5c-be64-a751d53bb88b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:43.472821 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aee63c-cde1-4e5c-be64-a751d53bb88b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:43.473099 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aee63c-cde1-4e5c-be64-a751d53bb88b None admin] PATH_INFO: `/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:43.478874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aee63c-cde1-4e5c-be64-a751d53bb88b None admin] RBAC: Authorizing `identity:get_project(project_id=ce0639f1aa774369ae34b4a7e8f866fa)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:43.480342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aee63c-cde1-4e5c-be64-a751d53bb88b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:43.482571 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 192/393] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:43 2022] GET /identity/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:43.487901 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995cb34b-2ca7-4d6e-a37b-1e5dfd62bf0c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:43.658028 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995cb34b-2ca7-4d6e-a37b-1e5dfd62bf0c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:43.661043 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c95854-1cd1-4d8e-86d1-252d6ee73a43 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:43.661587 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c95854-1cd1-4d8e-86d1-252d6ee73a43 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:43.662080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c95854-1cd1-4d8e-86d1-252d6ee73a43 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:43.663980 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 193/394] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:43.669631 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bb8b6-f0f2-4719-826f-9f37da7efc15 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:43.670751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bb8b6-f0f2-4719-826f-9f37da7efc15 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:43.671327 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bb8b6-f0f2-4719-826f-9f37da7efc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:43.690331 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-a18bb8b6-f0f2-4719-826f-9f37da7efc15 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:43.692183 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a18bb8b6-f0f2-4719-826f-9f37da7efc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:43.705120 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdf7c9-daa1-45c1-aaa4-55ed34322858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:43.705895 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdf7c9-daa1-45c1-aaa4-55ed34322858 None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:43.706206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdf7c9-daa1-45c1-aaa4-55ed34322858 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:43.706487 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdf7c9-daa1-45c1-aaa4-55ed34322858 None admin] PATH_INFO: `/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1/roles/d39f0a4f271f470490b67062462b2d74` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:43.709435 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bdf7c9-daa1-45c1-aaa4-55ed34322858 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce0639f1aa774369ae34b4a7e8f866fa, group_id=aeb2e2ec2ebf4345bf4fa443c872e2c1, role_id=d39f0a4f271f470490b67062462b2d74)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:43.711079 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bdf7c9-daa1-45c1-aaa4-55ed34322858 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:43.778521 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 194/395] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:09:43.808955 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bb8b6-f0f2-4719-826f-9f37da7efc15 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:43.812025 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:43.837195 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 202/396] 10.222.0.13 () {58 vars in 1442 bytes} [Tue Jul 5 21:09:43 2022] PUT /identity/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1/roles/d39f0a4f271f470490b67062462b2d74 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:09:43.939255 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bb8b6-f0f2-4719-826f-9f37da7efc15 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:43.979796 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146cf07-88ff-4fde-849c-9c88bf00ee55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:43.980615 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146cf07-88ff-4fde-849c-9c88bf00ee55 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:43.980911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146cf07-88ff-4fde-849c-9c88bf00ee55 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:43.981165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146cf07-88ff-4fde-849c-9c88bf00ee55 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:43.993948 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146cf07-88ff-4fde-849c-9c88bf00ee55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:44.002037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-e146cf07-88ff-4fde-849c-9c88bf00ee55 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:44.002037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:44.002037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:44.002037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:44.002037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:44.002037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:44.002037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:44.002037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:44.002037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:44.002037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:44.002037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:44.002037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:44.002037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:44.002037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:44.002037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:44.002037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:44.003884 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:44.003884 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:44.003884 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:44.003884 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:44.003884 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:44.003884 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:44.003884 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:44.003884 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:44.003884 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:44.003884 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:44.003884 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:44.003884 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:44.003884 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:44.003884 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:44.003884 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:44.003884 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:44.005293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:44.005293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:44.005293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:44.005293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:44.005293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:44.005293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:44.005293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:44.005293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:44.005293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:44.005293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:44.005293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:44.005293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:09:44.005293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 195/397] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:44.009868 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdf7c9-daa1-45c1-aaa4-55ed34322858 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:44.048803 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:44.133391 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdf7c9-daa1-45c1-aaa4-55ed34322858 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:44.175944 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b0786-7b69-48c4-8dbd-123faf10dea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:44.176620 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b0786-7b69-48c4-8dbd-123faf10dea8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:44.176903 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b0786-7b69-48c4-8dbd-123faf10dea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:44.177175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b0786-7b69-48c4-8dbd-123faf10dea8 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:44.177933 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b0786-7b69-48c4-8dbd-123faf10dea8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:44.178279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b0786-7b69-48c4-8dbd-123faf10dea8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:44.179669 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b0786-7b69-48c4-8dbd-123faf10dea8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:44.189363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 203/398] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 21:09:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:44.194904 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146cf07-88ff-4fde-849c-9c88bf00ee55 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:44.266717 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:44.319568 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146cf07-88ff-4fde-849c-9c88bf00ee55 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:44.358283 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8becfb4-fcf6-4d1b-83eb-9d15e8b426ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:44.363289 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8becfb4-fcf6-4d1b-83eb-9d15e8b426ff None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:44.363289 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8becfb4-fcf6-4d1b-83eb-9d15e8b426ff None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:44.363289 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8becfb4-fcf6-4d1b-83eb-9d15e8b426ff None admin] PATH_INFO: `/v3/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:44.363289 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8becfb4-fcf6-4d1b-83eb-9d15e8b426ff None admin] RBAC: Authorizing `identity:get_group(group_id=aeb2e2ec2ebf4345bf4fa443c872e2c1)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:44.363289 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8becfb4-fcf6-4d1b-83eb-9d15e8b426ff None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:44.364752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 196/399] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 21:09:44 2022] GET /identity/v3/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:44.370326 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b0786-7b69-48c4-8dbd-123faf10dea8 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:44.472067 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762abadf-33d4-4972-8725-05c67f7eb61f None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:44.472376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762abadf-33d4-4972-8725-05c67f7eb61f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:44.472727 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762abadf-33d4-4972-8725-05c67f7eb61f None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:44.474488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 197/400] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:09:44.483555 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e25bb-7c48-46d4-8cde-cfffb9404b8b None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:44.483972 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e25bb-7c48-46d4-8cde-cfffb9404b8b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:44.484327 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e25bb-7c48-46d4-8cde-cfffb9404b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:44.486201 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:44.491849 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b0786-7b69-48c4-8dbd-123faf10dea8 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:44.503006 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-b38e25bb-7c48-46d4-8cde-cfffb9404b8b None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:44.504636 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b38e25bb-7c48-46d4-8cde-cfffb9404b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:44.530438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6b8ae-560c-42ac-868f-b2e9654b3327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:44.531363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6b8ae-560c-42ac-868f-b2e9654b3327 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:44.531654 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6b8ae-560c-42ac-868f-b2e9654b3327 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:44.531932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6b8ae-560c-42ac-868f-b2e9654b3327 None admin] PATH_INFO: `/v3/projects/c504b86211c0482394a54688bc1c6c04` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:44.533407 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6b8ae-560c-42ac-868f-b2e9654b3327 None admin] RBAC: Authorizing `identity:get_project(project_id=c504b86211c0482394a54688bc1c6c04)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:44.534687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6b8ae-560c-42ac-868f-b2e9654b3327 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:44.536339 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 204/401] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:44 2022] GET /identity/v3/projects/c504b86211c0482394a54688bc1c6c04 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:44.539670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816b2f4-d7dd-4ddd-9825-794fb2011bb2 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:44.539670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816b2f4-d7dd-4ddd-9825-794fb2011bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:44.539670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816b2f4-d7dd-4ddd-9825-794fb2011bb2 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:44.539670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 205/402] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:44.544672 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816b2f4-d7dd-4ddd-9825-794fb2011bb2 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:44.608163 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 198/403] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:44.614242 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169c433-533d-4d72-a5be-9f337c97b79f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:44.614242 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169c433-533d-4d72-a5be-9f337c97b79f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:44.614242 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169c433-533d-4d72-a5be-9f337c97b79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:44.635330 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-7169c433-533d-4d72-a5be-9f337c97b79f None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:44.637039 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7169c433-533d-4d72-a5be-9f337c97b79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:44.686293 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816b2f4-d7dd-4ddd-9825-794fb2011bb2 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:44.699944 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:44.714827 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 199/404] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:44.717845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169c433-533d-4d72-a5be-9f337c97b79f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:44.728187 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9adfc-b1d6-4ee7-b657-161520b36dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:44.729492 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9adfc-b1d6-4ee7-b657-161520b36dc8 None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:44.729874 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9adfc-b1d6-4ee7-b657-161520b36dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:44.730297 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9adfc-b1d6-4ee7-b657-161520b36dc8 None admin] PATH_INFO: `/v3/projects/c504b86211c0482394a54688bc1c6c04/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:44.732917 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9adfc-b1d6-4ee7-b657-161520b36dc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c504b86211c0482394a54688bc1c6c04, group_id=aeb2e2ec2ebf4345bf4fa443c872e2c1, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:44.734932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9adfc-b1d6-4ee7-b657-161520b36dc8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:44.827002 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169c433-533d-4d72-a5be-9f337c97b79f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:44.845679 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 206/405] 10.222.0.13 () {58 vars in 1442 bytes} [Tue Jul 5 21:09:44 2022] PUT /identity/v3/projects/c504b86211c0482394a54688bc1c6c04/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:09:44.848055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9adfc-b1d6-4ee7-b657-161520b36dc8 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:44.883210 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25df8b7-235d-430d-912a-32ab41e6d19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:44.884367 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25df8b7-235d-430d-912a-32ab41e6d19a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:44.884801 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25df8b7-235d-430d-912a-32ab41e6d19a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:44.885311 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25df8b7-235d-430d-912a-32ab41e6d19a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:44.899677 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25df8b7-235d-430d-912a-32ab41e6d19a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:44.909562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-c25df8b7-235d-430d-912a-32ab41e6d19a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:09:44.909562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:44.909562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:44.909562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:44.909562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:44.909562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:44.909562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:44.909562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:44.909562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:44.909562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:44.909562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:44.909562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:44.909562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:44.909562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:44.909562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:44.909562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:44.910808 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:44.910808 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:44.910808 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:44.910808 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:44.910808 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:44.910808 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:44.910808 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:44.910808 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:44.910808 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:44.910808 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:44.910808 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:44.910808 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:44.910808 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:44.910808 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:44.910808 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:44.910808 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:44.911734 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:44.911734 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:44.911734 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:44.911734 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:44.911734 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:44.911734 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:44.911734 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:44.911734 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:44.911734 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:44.911734 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:44.911734 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:09:44.911734 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:09:44.914405 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 200/406] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 21:09:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:44.923070 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25df8b7-235d-430d-912a-32ab41e6d19a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:44.926505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:45.027601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:45.065418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9adfc-b1d6-4ee7-b657-161520b36dc8 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:45.114609 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25df8b7-235d-430d-912a-32ab41e6d19a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:45.116458 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c824ce-40c0-4b7a-b4d1-2d5a9ebfdd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:45.117270 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c824ce-40c0-4b7a-b4d1-2d5a9ebfdd67 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:45.117554 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c824ce-40c0-4b7a-b4d1-2d5a9ebfdd67 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:45.117832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c824ce-40c0-4b7a-b4d1-2d5a9ebfdd67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:45.131926 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c824ce-40c0-4b7a-b4d1-2d5a9ebfdd67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:45.140334 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-74c824ce-40c0-4b7a-b4d1-2d5a9ebfdd67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:09:45.140334 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:45.140334 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:45.140334 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:45.140334 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:45.140334 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:45.140334 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:45.140334 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:45.140334 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:45.140334 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:45.140334 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:45.140334 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:45.140334 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:45.140334 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:45.140334 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:45.140334 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:45.141247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:45.141247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:45.141247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:45.141247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:45.141247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:45.141247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:45.141247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:45.141247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:45.141247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:45.141247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:45.141247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:45.141247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:45.141247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:45.141247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:45.141247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:45.141247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:45.142355 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:45.142355 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:45.142355 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:45.142355 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:45.142355 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:45.142355 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:45.142355 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:45.142355 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:45.142355 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:45.142355 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:45.142355 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:09:45.142355 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:45.142355 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 207/407] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:09:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:45.148599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c824ce-40c0-4b7a-b4d1-2d5a9ebfdd67 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:45.226842 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843eeb11-1ce5-4a64-89ba-c00f6713c8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:45.227527 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843eeb11-1ce5-4a64-89ba-c00f6713c8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:45.230286 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843eeb11-1ce5-4a64-89ba-c00f6713c8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:45.230286 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843eeb11-1ce5-4a64-89ba-c00f6713c8c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:45.230286 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843eeb11-1ce5-4a64-89ba-c00f6713c8c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:45.230286 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843eeb11-1ce5-4a64-89ba-c00f6713c8c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:45.230756 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843eeb11-1ce5-4a64-89ba-c00f6713c8c4 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:45.245982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:45.252636 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 201/408] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:09:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:45.259470 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843eeb11-1ce5-4a64-89ba-c00f6713c8c4 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:45.269396 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c824ce-40c0-4b7a-b4d1-2d5a9ebfdd67 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:45.309731 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58237b3b-8bde-466f-b8a4-cca0887e6283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:45.311106 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58237b3b-8bde-466f-b8a4-cca0887e6283 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:45.311399 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58237b3b-8bde-466f-b8a4-cca0887e6283 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:45.311680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58237b3b-8bde-466f-b8a4-cca0887e6283 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:45.312449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58237b3b-8bde-466f-b8a4-cca0887e6283 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:45.312760 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58237b3b-8bde-466f-b8a4-cca0887e6283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:45.314269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58237b3b-8bde-466f-b8a4-cca0887e6283 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:45.330257 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 208/409] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:45.331686 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58237b3b-8bde-466f-b8a4-cca0887e6283 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:45.444460 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58237b3b-8bde-466f-b8a4-cca0887e6283 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:45.481367 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e357665-202b-4627-a06a-d7779fca9b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:45.482857 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e357665-202b-4627-a06a-d7779fca9b35 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:45.483150 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e357665-202b-4627-a06a-d7779fca9b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:45.483435 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e357665-202b-4627-a06a-d7779fca9b35 None admin] PATH_INFO: `/v3/groups/44c6e9eed2df4806b5d8ed5b2a643895` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:45.484836 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e357665-202b-4627-a06a-d7779fca9b35 None admin] RBAC: Authorizing `identity:get_group(group_id=44c6e9eed2df4806b5d8ed5b2a643895)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:45.486444 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e357665-202b-4627-a06a-d7779fca9b35 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:45.492786 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 209/410] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 21:09:45 2022] GET /identity/v3/groups/44c6e9eed2df4806b5d8ed5b2a643895 => generated 229 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:45.493944 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e357665-202b-4627-a06a-d7779fca9b35 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:45.532756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:45.602425 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843eeb11-1ce5-4a64-89ba-c00f6713c8c4 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:45.608988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e357665-202b-4627-a06a-d7779fca9b35 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:45.616073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:45.638965 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a0289-288a-43b2-a170-c0ddfb695ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:45.639802 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a0289-288a-43b2-a170-c0ddfb695ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:45.640085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a0289-288a-43b2-a170-c0ddfb695ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:45.640361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a0289-288a-43b2-a170-c0ddfb695ce1 None admin] PATH_INFO: `/v3/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:45.641937 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a0289-288a-43b2-a170-c0ddfb695ce1 None admin] RBAC: Authorizing `identity:get_group(group_id=aeb2e2ec2ebf4345bf4fa443c872e2c1)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:45.643542 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a0289-288a-43b2-a170-c0ddfb695ce1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:45.645861 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 202/411] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 21:09:45 2022] GET /identity/v3/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1 => generated 226 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:45.646926 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e06b59-c0ed-4ece-ad2d-8c6f807fac30 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:45.647233 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e06b59-c0ed-4ece-ad2d-8c6f807fac30 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:45.647486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e06b59-c0ed-4ece-ad2d-8c6f807fac30 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:45.648824 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 203/412] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:45.653590 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e06b59-c0ed-4ece-ad2d-8c6f807fac30 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:45.655805 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03588d-db5f-4147-a49f-e8e6a4bb2db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:45.659278 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03588d-db5f-4147-a49f-e8e6a4bb2db1 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:45.659278 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03588d-db5f-4147-a49f-e8e6a4bb2db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:45.659278 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03588d-db5f-4147-a49f-e8e6a4bb2db1 None admin] PATH_INFO: `/v3/projects/c475db16707f46ecb5780cbec2330b6e` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:45.660615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f03588d-db5f-4147-a49f-e8e6a4bb2db1 None admin] RBAC: Authorizing `identity:get_project(project_id=c475db16707f46ecb5780cbec2330b6e)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:45.662316 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f03588d-db5f-4147-a49f-e8e6a4bb2db1 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:45.669566 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 210/413] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:45 2022] GET /identity/v3/projects/c475db16707f46ecb5780cbec2330b6e => generated 344 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:45.669566 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20449ef0-dc55-4087-8ce2-f46f5cc46ccf None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:45.669566 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20449ef0-dc55-4087-8ce2-f46f5cc46ccf None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:45.669566 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20449ef0-dc55-4087-8ce2-f46f5cc46ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:45.690298 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-20449ef0-dc55-4087-8ce2-f46f5cc46ccf None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:45.693735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-20449ef0-dc55-4087-8ce2-f46f5cc46ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:45.776398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 211/414] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:45.786533 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20449ef0-dc55-4087-8ce2-f46f5cc46ccf None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:45.788467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e06b59-c0ed-4ece-ad2d-8c6f807fac30 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:45.813378 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:45.832738 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ded247-74dd-4317-b411-59a48d94f6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:45.833653 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ded247-74dd-4317-b411-59a48d94f6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:45.833945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ded247-74dd-4317-b411-59a48d94f6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:45.834251 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ded247-74dd-4317-b411-59a48d94f6e5 None admin] PATH_INFO: `/v3/projects/c504b86211c0482394a54688bc1c6c04` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:45.835534 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ded247-74dd-4317-b411-59a48d94f6e5 None admin] RBAC: Authorizing `identity:get_project(project_id=c504b86211c0482394a54688bc1c6c04)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:45.837079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ded247-74dd-4317-b411-59a48d94f6e5 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:45.839126 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 204/415] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:45 2022] GET /identity/v3/projects/c504b86211c0482394a54688bc1c6c04 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:45.839962 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ded247-74dd-4317-b411-59a48d94f6e5 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:45.896497 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:45.909071 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20449ef0-dc55-4087-8ce2-f46f5cc46ccf None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:45.953909 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdae505-7a7b-4a17-99e4-a731021d8cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:45.955381 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdae505-7a7b-4a17-99e4-a731021d8cad None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:45.956129 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdae505-7a7b-4a17-99e4-a731021d8cad None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:45.956605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdae505-7a7b-4a17-99e4-a731021d8cad None admin] PATH_INFO: `/v3/projects/c475db16707f46ecb5780cbec2330b6e/groups/44c6e9eed2df4806b5d8ed5b2a643895/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:45.959550 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdae505-7a7b-4a17-99e4-a731021d8cad None admin] RBAC: Authorizing `identity:create_grant(project_id=c475db16707f46ecb5780cbec2330b6e, group_id=44c6e9eed2df4806b5d8ed5b2a643895, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:45.960637 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ded247-74dd-4317-b411-59a48d94f6e5 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:45.960995 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdae505-7a7b-4a17-99e4-a731021d8cad None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:45.998879 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561efc67-fd07-47a8-a37e-f2f9f15b5218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:46.000021 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561efc67-fd07-47a8-a37e-f2f9f15b5218 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:46.000507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561efc67-fd07-47a8-a37e-f2f9f15b5218 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:46.000988 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561efc67-fd07-47a8-a37e-f2f9f15b5218 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:46.011802 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561efc67-fd07-47a8-a37e-f2f9f15b5218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:46.020384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-561efc67-fd07-47a8-a37e-f2f9f15b5218 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:46.020384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:46.020384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:46.020384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:46.020384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:46.020384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:46.020384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:46.020384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:46.020384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:46.020384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:46.020384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:46.020384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:46.020384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:46.020384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:46.020384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:46.020384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:46.021375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:46.021375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:46.021375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:46.021375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:46.021375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:46.021375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:46.021375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:46.021375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:46.021375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:46.021375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:46.021375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:46.021375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:46.021375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:46.021375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:46.021375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:46.021375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:46.022400 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:46.022400 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:46.022400 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:46.022400 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:46.022400 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:46.022400 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:46.022400 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:46.022400 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:46.022400 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:46.022400 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:46.022400 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:46.022400 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:09:46.024540 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 205/416] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:46.025555 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561efc67-fd07-47a8-a37e-f2f9f15b5218 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:46.035691 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 212/417] 10.222.0.13 () {58 vars in 1442 bytes} [Tue Jul 5 21:09:45 2022] PUT /identity/v3/projects/c475db16707f46ecb5780cbec2330b6e/groups/44c6e9eed2df4806b5d8ed5b2a643895/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:09:46.046549 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdae505-7a7b-4a17-99e4-a731021d8cad None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:46.200507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561efc67-fd07-47a8-a37e-f2f9f15b5218 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:46.214621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:46.219683 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:46.245718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ba7e6-c8c0-4483-b2cf-60dc6b3caa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:46.246665 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ba7e6-c8c0-4483-b2cf-60dc6b3caa4b None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:46.246929 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ba7e6-c8c0-4483-b2cf-60dc6b3caa4b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:46.247210 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ba7e6-c8c0-4483-b2cf-60dc6b3caa4b None admin] PATH_INFO: `/v3/projects/c504b86211c0482394a54688bc1c6c04/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1/roles/d39f0a4f271f470490b67062462b2d74` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:46.247700 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdae505-7a7b-4a17-99e4-a731021d8cad None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:46.251175 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ba7e6-c8c0-4483-b2cf-60dc6b3caa4b None admin] RBAC: Authorizing `identity:create_grant(project_id=c504b86211c0482394a54688bc1c6c04, group_id=aeb2e2ec2ebf4345bf4fa443c872e2c1, role_id=d39f0a4f271f470490b67062462b2d74)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:46.252649 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ba7e6-c8c0-4483-b2cf-60dc6b3caa4b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:46.287504 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faafcf6c-fe56-4cda-9cb4-2fd0aab80da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:46.288183 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafcf6c-fe56-4cda-9cb4-2fd0aab80da0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:46.288465 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafcf6c-fe56-4cda-9cb4-2fd0aab80da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:46.288738 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafcf6c-fe56-4cda-9cb4-2fd0aab80da0 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:46.289485 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faafcf6c-fe56-4cda-9cb4-2fd0aab80da0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:46.289790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faafcf6c-fe56-4cda-9cb4-2fd0aab80da0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:46.291206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faafcf6c-fe56-4cda-9cb4-2fd0aab80da0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:46.300854 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 213/418] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 21:09:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:46.305922 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faafcf6c-fe56-4cda-9cb4-2fd0aab80da0 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:46.355342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 206/419] 10.222.0.13 () {58 vars in 1442 bytes} [Tue Jul 5 21:09:46 2022] PUT /identity/v3/projects/c504b86211c0482394a54688bc1c6c04/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1/roles/d39f0a4f271f470490b67062462b2d74 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:09:46.356779 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709b1e8-4b28-45c8-a939-150a34ea7866 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:46.357168 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709b1e8-4b28-45c8-a939-150a34ea7866 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:46.357453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709b1e8-4b28-45c8-a939-150a34ea7866 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:46.358977 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 207/420] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:46.364678 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477ba0b-c029-43f6-9d85-99be10b66f0c None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:46.364972 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477ba0b-c029-43f6-9d85-99be10b66f0c None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:46.365262 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477ba0b-c029-43f6-9d85-99be10b66f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:46.384034 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-2477ba0b-c029-43f6-9d85-99be10b66f0c None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:46.385239 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2477ba0b-c029-43f6-9d85-99be10b66f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:46.497436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 208/421] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:09:46.506057 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faafcf6c-fe56-4cda-9cb4-2fd0aab80da0 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:46.534762 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477ba0b-c029-43f6-9d85-99be10b66f0c None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:46.556095 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e3b66-e88d-408d-8eeb-1890ddf951e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:46.556773 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e3b66-e88d-408d-8eeb-1890ddf951e3 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:46.557029 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e3b66-e88d-408d-8eeb-1890ddf951e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:46.557317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e3b66-e88d-408d-8eeb-1890ddf951e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:46.561042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:46.642022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e3b66-e88d-408d-8eeb-1890ddf951e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:46.643522 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e3b66-e88d-408d-8eeb-1890ddf951e3 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:46.687952 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:46.692286 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477ba0b-c029-43f6-9d85-99be10b66f0c None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:46.736872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2c50c-d14b-4cfc-adac-70b8c35a39c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:46.738081 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2c50c-d14b-4cfc-adac-70b8c35a39c7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:46.738583 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2c50c-d14b-4cfc-adac-70b8c35a39c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:46.739054 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2c50c-d14b-4cfc-adac-70b8c35a39c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:46.758525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 214/422] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:46.759342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2c50c-d14b-4cfc-adac-70b8c35a39c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:46.768961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-38d2c50c-d14b-4cfc-adac-70b8c35a39c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:09:46.768961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:46.768961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:46.768961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:46.768961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:46.768961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:46.768961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:46.768961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:46.768961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:46.768961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:46.768961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:46.768961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:46.768961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:46.768961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:46.768961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:46.768961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:46.769876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:46.769876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:46.769876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:46.769876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:46.769876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:46.769876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:46.769876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:46.769876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:46.769876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:46.769876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:46.769876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:46.769876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:46.769876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:46.769876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:46.769876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:46.769876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:46.770742 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:46.770742 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:46.770742 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:46.770742 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:46.770742 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:46.770742 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:46.770742 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:46.770742 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:46.770742 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:46.770742 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:46.770742 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:09:46.770742 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:09:46.771824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e3b66-e88d-408d-8eeb-1890ddf951e3 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:46.773582 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 209/423] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 21:09:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:46.800225 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2c50c-d14b-4cfc-adac-70b8c35a39c7 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:46.813138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:46.890147 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e3b66-e88d-408d-8eeb-1890ddf951e3 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:46.927888 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca5699-74e8-4855-8b6c-8915824e8b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:46.928753 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca5699-74e8-4855-8b6c-8915824e8b04 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:46.929030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca5699-74e8-4855-8b6c-8915824e8b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:46.929300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca5699-74e8-4855-8b6c-8915824e8b04 None admin] PATH_INFO: `/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:46.930646 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ca5699-74e8-4855-8b6c-8915824e8b04 None admin] RBAC: Authorizing `identity:get_project(project_id=ce0639f1aa774369ae34b4a7e8f866fa)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:46.937620 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ca5699-74e8-4855-8b6c-8915824e8b04 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:46.939572 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 215/424] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:46 2022] GET /identity/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:46.948412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca5699-74e8-4855-8b6c-8915824e8b04 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:46.970828 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2c50c-d14b-4cfc-adac-70b8c35a39c7 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:47.038835 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9abb7-790b-4214-bfe4-5080753e2844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:47.039527 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9abb7-790b-4214-bfe4-5080753e2844 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:47.039819 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9abb7-790b-4214-bfe4-5080753e2844 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:47.040103 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9abb7-790b-4214-bfe4-5080753e2844 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:47.040864 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9abb7-790b-4214-bfe4-5080753e2844 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:47.041174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9abb7-790b-4214-bfe4-5080753e2844 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:47.042585 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9abb7-790b-4214-bfe4-5080753e2844 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:47.063869 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 210/425] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:09:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:47.070562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9abb7-790b-4214-bfe4-5080753e2844 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:47.096459 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:47.122033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca5699-74e8-4855-8b6c-8915824e8b04 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:47.140568 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:47.158468 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59990db-7243-437d-a5c4-d11f88f7a914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:47.159326 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59990db-7243-437d-a5c4-d11f88f7a914 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:47.159608 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59990db-7243-437d-a5c4-d11f88f7a914 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:47.159882 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59990db-7243-437d-a5c4-d11f88f7a914 None admin] PATH_INFO: `/v3/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:47.161060 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59990db-7243-437d-a5c4-d11f88f7a914 None admin] RBAC: Authorizing `identity:get_group(group_id=aeb2e2ec2ebf4345bf4fa443c872e2c1)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:47.162549 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59990db-7243-437d-a5c4-d11f88f7a914 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:47.164860 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 216/426] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 21:09:46 2022] GET /identity/v3/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:47.171484 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57918a-89d3-48c2-a52e-4b95bd39b292 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:47.171776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57918a-89d3-48c2-a52e-4b95bd39b292 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:47.172062 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57918a-89d3-48c2-a52e-4b95bd39b292 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:47.174059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 217/427] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:47 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:47.174904 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57918a-89d3-48c2-a52e-4b95bd39b292 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:47.202239 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9abb7-790b-4214-bfe4-5080753e2844 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:47.241790 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84339328-e6ec-455c-af95-029875045403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:47.242772 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84339328-e6ec-455c-af95-029875045403 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:47.243296 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84339328-e6ec-455c-af95-029875045403 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:47.243838 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84339328-e6ec-455c-af95-029875045403 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:47.295624 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57918a-89d3-48c2-a52e-4b95bd39b292 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:47.322477 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84339328-e6ec-455c-af95-029875045403 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:47.324237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84339328-e6ec-455c-af95-029875045403 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:47.331766 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9143a-1b71-4169-b74b-48b8a552c56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:47.332431 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9143a-1b71-4169-b74b-48b8a552c56a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:47.332715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9143a-1b71-4169-b74b-48b8a552c56a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:47.332992 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9143a-1b71-4169-b74b-48b8a552c56a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:47.333825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9143a-1b71-4169-b74b-48b8a552c56a None admin] RBAC: Adding query filter params (group.id=aeb2e2ec2ebf4345bf4fa443c872e2c1, role.id=a93b63d74444489ebd7f92fd096f7eaf, scope.project.id=ce0639f1aa774369ae34b4a7e8f866fa) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:47.334145 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9143a-1b71-4169-b74b-48b8a552c56a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:47.335804 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9143a-1b71-4169-b74b-48b8a552c56a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:47.343567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 218/428] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Jul 5 21:09:47 2022] GET /identity/v3/role_assignments?group.id=aeb2e2ec2ebf4345bf4fa443c872e2c1&scope.project.id=ce0639f1aa774369ae34b4a7e8f866fa&role.id=a93b63d74444489ebd7f92fd096f7eaf => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:47.344881 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461a059-295e-4760-a754-953d3b687831 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:47.345175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461a059-295e-4760-a754-953d3b687831 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:47.345454 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461a059-295e-4760-a754-953d3b687831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:47.351442 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:47.363773 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-a461a059-295e-4760-a754-953d3b687831 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:47.365339 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a461a059-295e-4760-a754-953d3b687831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:47.403243 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:47.455419 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 211/430] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 21:09:47.455877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 219/430] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:47.459118 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84339328-e6ec-455c-af95-029875045403 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:47.488397 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461a059-295e-4760-a754-953d3b687831 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:47.575185 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84339328-e6ec-455c-af95-029875045403 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:47.613332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:47.632966 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868da36d-8c0f-494b-b4e4-e7b322b10723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:47.633871 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868da36d-8c0f-494b-b4e4-e7b322b10723 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:47.634188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868da36d-8c0f-494b-b4e4-e7b322b10723 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:47.634468 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868da36d-8c0f-494b-b4e4-e7b322b10723 None admin] PATH_INFO: `/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:47.635873 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868da36d-8c0f-494b-b4e4-e7b322b10723 None admin] RBAC: Authorizing `identity:get_project(project_id=ce0639f1aa774369ae34b4a7e8f866fa)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:47.637352 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868da36d-8c0f-494b-b4e4-e7b322b10723 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:47.645148 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 212/431] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:47 2022] GET /identity/v3/projects/ce0639f1aa774369ae34b4a7e8f866fa => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:47.646163 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868da36d-8c0f-494b-b4e4-e7b322b10723 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:47.680945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461a059-295e-4760-a754-953d3b687831 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:47.726088 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8ac21-1009-4b82-8733-f5b10df6c5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:47.727356 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8ac21-1009-4b82-8733-f5b10df6c5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:47.727782 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8ac21-1009-4b82-8733-f5b10df6c5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:47.728188 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8ac21-1009-4b82-8733-f5b10df6c5f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:47.746263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8ac21-1009-4b82-8733-f5b10df6c5f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:47.757581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-0bc8ac21-1009-4b82-8733-f5b10df6c5f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:47.757581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:47.757581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:47.757581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:47.757581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:47.757581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:47.757581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:47.757581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:47.757581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:47.757581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:47.757581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:47.757581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:47.757581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:47.757581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:47.757581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:47.757581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:47.758555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:47.758555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:47.758555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:47.758555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:47.758555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:47.758555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:47.758555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:47.758555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:47.758555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:47.758555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:47.758555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:47.758555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:47.758555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:47.758555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:47.758555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:47.758555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:47.759362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:47.759362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:47.759362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:47.759362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:47.759362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:47.759362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:47.759362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:47.759362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:47.759362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:47.759362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:47.759362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:09:47.759362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:47.760564 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 220/432] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:47.771167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8ac21-1009-4b82-8733-f5b10df6c5f1 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:47.785928 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868da36d-8c0f-494b-b4e4-e7b322b10723 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:47.806197 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:47.824410 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17354a0-5c0f-4db2-8061-0e265cc56929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:47.828130 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17354a0-5c0f-4db2-8061-0e265cc56929 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:47.828130 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17354a0-5c0f-4db2-8061-0e265cc56929 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:47.828130 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17354a0-5c0f-4db2-8061-0e265cc56929 None admin] PATH_INFO: `/v3/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:47.828130 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17354a0-5c0f-4db2-8061-0e265cc56929 None admin] RBAC: Authorizing `identity:get_group(group_id=aeb2e2ec2ebf4345bf4fa443c872e2c1)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:47.829337 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17354a0-5c0f-4db2-8061-0e265cc56929 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:47.831292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 213/433] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 21:09:47 2022] GET /identity/v3/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:47.836942 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17354a0-5c0f-4db2-8061-0e265cc56929 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:47.909793 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:47.911622 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8ac21-1009-4b82-8733-f5b10df6c5f1 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:47.957438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57dddb1-5e29-493f-a940-c8acaf91a7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:47.958448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dddb1-5e29-493f-a940-c8acaf91a7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:47.959068 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dddb1-5e29-493f-a940-c8acaf91a7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:47.959347 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dddb1-5e29-493f-a940-c8acaf91a7c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:47.960370 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57dddb1-5e29-493f-a940-c8acaf91a7c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:47.960982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57dddb1-5e29-493f-a940-c8acaf91a7c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:47.963048 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57dddb1-5e29-493f-a940-c8acaf91a7c8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:47.967850 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17354a0-5c0f-4db2-8061-0e265cc56929 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:47.974659 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 221/434] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 21:09:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:47.980853 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57dddb1-5e29-493f-a940-c8acaf91a7c8 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:48.019677 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add34e8-11f3-4dcf-8171-d765ec3eb194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:48.020865 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add34e8-11f3-4dcf-8171-d765ec3eb194 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:48.021152 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add34e8-11f3-4dcf-8171-d765ec3eb194 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:48.021711 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add34e8-11f3-4dcf-8171-d765ec3eb194 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:48.022605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add34e8-11f3-4dcf-8171-d765ec3eb194 None admin] RBAC: Adding query filter params (group.id=aeb2e2ec2ebf4345bf4fa443c872e2c1, role.id=d39f0a4f271f470490b67062462b2d74, scope.project.id=ce0639f1aa774369ae34b4a7e8f866fa) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:48.022921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add34e8-11f3-4dcf-8171-d765ec3eb194 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:48.025707 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add34e8-11f3-4dcf-8171-d765ec3eb194 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:48.036232 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 214/435] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Jul 5 21:09:47 2022] GET /identity/v3/role_assignments?group.id=aeb2e2ec2ebf4345bf4fa443c872e2c1&scope.project.id=ce0639f1aa774369ae34b4a7e8f866fa&role.id=d39f0a4f271f470490b67062462b2d74 => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:48.102344 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:48.121191 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57dddb1-5e29-493f-a940-c8acaf91a7c8 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:48.160419 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329963f6-3fa8-4c51-be1c-d8aeaf58eece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:48.161080 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329963f6-3fa8-4c51-be1c-d8aeaf58eece None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:48.161362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329963f6-3fa8-4c51-be1c-d8aeaf58eece None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:48.161637 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329963f6-3fa8-4c51-be1c-d8aeaf58eece None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:48.241873 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329963f6-3fa8-4c51-be1c-d8aeaf58eece None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:48.243711 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329963f6-3fa8-4c51-be1c-d8aeaf58eece None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:48.341433 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:48.361551 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 222/436] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:48.364025 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add34e8-11f3-4dcf-8171-d765ec3eb194 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:48.433450 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c718c99-4f13-42a9-8b01-dfa953086df0 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:48.433755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c718c99-4f13-42a9-8b01-dfa953086df0 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:48.434020 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c718c99-4f13-42a9-8b01-dfa953086df0 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:48.436278 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 223/437] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:09:48.441647 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c2632-89bf-4f5e-8eb8-9d5758464d36 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:48.442254 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c2632-89bf-4f5e-8eb8-9d5758464d36 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:48.442778 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c2632-89bf-4f5e-8eb8-9d5758464d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:48.461593 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-031c2632-89bf-4f5e-8eb8-9d5758464d36 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:48.462833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-031c2632-89bf-4f5e-8eb8-9d5758464d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:48.486892 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add34e8-11f3-4dcf-8171-d765ec3eb194 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:48.513135 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:48.529265 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ecea46-196b-412d-8f1d-5cdbd3eba8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:48.530305 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecea46-196b-412d-8f1d-5cdbd3eba8db None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:48.530590 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecea46-196b-412d-8f1d-5cdbd3eba8db None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:48.530864 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecea46-196b-412d-8f1d-5cdbd3eba8db None admin] PATH_INFO: `/v3/projects/c504b86211c0482394a54688bc1c6c04` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:48.532087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ecea46-196b-412d-8f1d-5cdbd3eba8db None admin] RBAC: Authorizing `identity:get_project(project_id=c504b86211c0482394a54688bc1c6c04)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:48.533546 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ecea46-196b-412d-8f1d-5cdbd3eba8db None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:48.535474 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 215/438] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:48 2022] GET /identity/v3/projects/c504b86211c0482394a54688bc1c6c04 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:48.540866 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ecea46-196b-412d-8f1d-5cdbd3eba8db None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:48.558905 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 224/439] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:48.581722 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c2632-89bf-4f5e-8eb8-9d5758464d36 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:48.658087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ecea46-196b-412d-8f1d-5cdbd3eba8db None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:48.690643 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c2632-89bf-4f5e-8eb8-9d5758464d36 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:48.695519 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138d21d-43fe-4c82-ba87-b32f09b1b355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:48.696391 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138d21d-43fe-4c82-ba87-b32f09b1b355 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:48.696683 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138d21d-43fe-4c82-ba87-b32f09b1b355 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:48.697003 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138d21d-43fe-4c82-ba87-b32f09b1b355 None admin] PATH_INFO: `/v3/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:48.698198 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138d21d-43fe-4c82-ba87-b32f09b1b355 None admin] RBAC: Authorizing `identity:get_group(group_id=aeb2e2ec2ebf4345bf4fa443c872e2c1)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:48.699811 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138d21d-43fe-4c82-ba87-b32f09b1b355 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:48.701603 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 216/440] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 21:09:48 2022] GET /identity/v3/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:48.707656 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138d21d-43fe-4c82-ba87-b32f09b1b355 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:48.715071 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:48.735532 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326555ae-7797-490f-9b57-a6886246ff39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:48.736317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326555ae-7797-490f-9b57-a6886246ff39 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:48.736599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326555ae-7797-490f-9b57-a6886246ff39 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:48.736877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326555ae-7797-490f-9b57-a6886246ff39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:48.747620 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326555ae-7797-490f-9b57-a6886246ff39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:48.755317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-326555ae-7797-490f-9b57-a6886246ff39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:09:48.755317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:48.755317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:48.755317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:48.755317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:48.755317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:48.755317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:48.755317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:48.755317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:48.755317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:48.755317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:48.755317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:48.755317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:48.755317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:48.755317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:48.755317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:48.756453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:48.756453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:48.756453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:48.756453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:48.756453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:48.756453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:48.756453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:48.756453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:48.756453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:48.756453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:48.756453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:48.756453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:48.756453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:48.756453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:48.756453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:48.756453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:48.759136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:48.759136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:48.759136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:48.759136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:48.759136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:48.759136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:48.759136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:48.759136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:48.759136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:48.759136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:48.759136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:09:48.759136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:48.759136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 225/441] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:09:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:48.762054 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326555ae-7797-490f-9b57-a6886246ff39 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:48.774627 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:48.824245 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138d21d-43fe-4c82-ba87-b32f09b1b355 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:48.865131 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5a7b7-9a8a-44df-acb4-5dbcb3c0a903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:48.865899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5a7b7-9a8a-44df-acb4-5dbcb3c0a903 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:48.866213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5a7b7-9a8a-44df-acb4-5dbcb3c0a903 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:48.866495 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5a7b7-9a8a-44df-acb4-5dbcb3c0a903 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:48.867331 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a5a7b7-9a8a-44df-acb4-5dbcb3c0a903 None admin] RBAC: Adding query filter params (group.id=aeb2e2ec2ebf4345bf4fa443c872e2c1, role.id=a93b63d74444489ebd7f92fd096f7eaf, scope.project.id=c504b86211c0482394a54688bc1c6c04) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:48.867644 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a5a7b7-9a8a-44df-acb4-5dbcb3c0a903 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:48.868565 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326555ae-7797-490f-9b57-a6886246ff39 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:48.869192 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a5a7b7-9a8a-44df-acb4-5dbcb3c0a903 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:48.876278 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 217/442] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Jul 5 21:09:48 2022] GET /identity/v3/role_assignments?group.id=aeb2e2ec2ebf4345bf4fa443c872e2c1&scope.project.id=c504b86211c0482394a54688bc1c6c04&role.id=a93b63d74444489ebd7f92fd096f7eaf => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:48.906365 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6931dce-2644-4147-9b7f-f6639a0ed330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:48.907055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6931dce-2644-4147-9b7f-f6639a0ed330 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:48.907340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6931dce-2644-4147-9b7f-f6639a0ed330 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:48.907621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6931dce-2644-4147-9b7f-f6639a0ed330 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:48.908480 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6931dce-2644-4147-9b7f-f6639a0ed330 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:48.908736 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6931dce-2644-4147-9b7f-f6639a0ed330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:48.910226 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6931dce-2644-4147-9b7f-f6639a0ed330 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:48.919935 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 226/443] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:48.925479 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5a7b7-9a8a-44df-acb4-5dbcb3c0a903 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:49.015352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1fdd5-f7b9-4709-9e2a-7a56bef7aae1 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:49.015750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1fdd5-f7b9-4709-9e2a-7a56bef7aae1 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:49.016352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1fdd5-f7b9-4709-9e2a-7a56bef7aae1 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:49.017848 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 227/444] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:49.024500 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed7a33-c521-4b61-b023-52450ddbf055 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:49.024949 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed7a33-c521-4b61-b023-52450ddbf055 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:49.025230 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed7a33-c521-4b61-b023-52450ddbf055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:49.034860 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5a7b7-9a8a-44df-acb4-5dbcb3c0a903 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:49.045732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-49ed7a33-c521-4b61-b023-52450ddbf055 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:49.046992 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-49ed7a33-c521-4b61-b023-52450ddbf055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:49.062110 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:49.079459 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e494f5-7217-4515-8962-e07ca86d40c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:49.080125 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e494f5-7217-4515-8962-e07ca86d40c1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:49.080411 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e494f5-7217-4515-8962-e07ca86d40c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:49.080719 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e494f5-7217-4515-8962-e07ca86d40c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:49.083478 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:49.126785 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 228/445] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:09:49.151078 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed7a33-c521-4b61-b023-52450ddbf055 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:49.164641 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e494f5-7217-4515-8962-e07ca86d40c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:49.166036 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e494f5-7217-4515-8962-e07ca86d40c1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:49.267795 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed7a33-c521-4b61-b023-52450ddbf055 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:49.280513 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 218/446] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:49.286008 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e494f5-7217-4515-8962-e07ca86d40c1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:49.302449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6a188-dc93-4236-b152-29aa619017df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:49.303252 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6a188-dc93-4236-b152-29aa619017df None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:49.303531 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6a188-dc93-4236-b152-29aa619017df None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:49.303803 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6a188-dc93-4236-b152-29aa619017df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:49.305852 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:49.314538 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6a188-dc93-4236-b152-29aa619017df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:49.322656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-28a6a188-dc93-4236-b152-29aa619017df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:09:49.322656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:49.322656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:49.322656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:49.322656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:49.322656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:49.322656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:49.322656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:49.322656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:49.322656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:49.322656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:49.322656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:49.322656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:49.322656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:49.322656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:49.322656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:49.323750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:49.323750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:49.323750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:49.323750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:49.323750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:49.323750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:49.323750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:49.323750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:49.323750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:49.323750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:49.323750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:49.323750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:49.323750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:49.323750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:49.323750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:49.323750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:49.324570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:49.324570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:49.324570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:49.324570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:49.324570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:49.324570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:49.324570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:49.324570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:49.324570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:49.324570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:49.324570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:09:49.324570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:49.324570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 229/447] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 21:09:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:49.330315 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6a188-dc93-4236-b152-29aa619017df None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:49.358342 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:49.383207 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e494f5-7217-4515-8962-e07ca86d40c1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:49.418174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa29d4-8538-4ada-b098-93d0c4f14d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:49.418958 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa29d4-8538-4ada-b098-93d0c4f14d96 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:49.419266 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa29d4-8538-4ada-b098-93d0c4f14d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:49.419544 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa29d4-8538-4ada-b098-93d0c4f14d96 None admin] PATH_INFO: `/v3/projects/c475db16707f46ecb5780cbec2330b6e` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:49.420798 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa29d4-8538-4ada-b098-93d0c4f14d96 None admin] RBAC: Authorizing `identity:get_project(project_id=c475db16707f46ecb5780cbec2330b6e)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:49.422270 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa29d4-8538-4ada-b098-93d0c4f14d96 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:49.423953 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 219/448] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:49 2022] GET /identity/v3/projects/c475db16707f46ecb5780cbec2330b6e => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:49.428615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6a188-dc93-4236-b152-29aa619017df None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:49.429288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa29d4-8538-4ada-b098-93d0c4f14d96 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:49.462640 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a60a8-8019-4ed7-a9c6-acf82c26b291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:49.463307 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a60a8-8019-4ed7-a9c6-acf82c26b291 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:49.463596 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a60a8-8019-4ed7-a9c6-acf82c26b291 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:49.463874 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a60a8-8019-4ed7-a9c6-acf82c26b291 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:49.464624 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a60a8-8019-4ed7-a9c6-acf82c26b291 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:49.464924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a60a8-8019-4ed7-a9c6-acf82c26b291 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:49.466422 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a60a8-8019-4ed7-a9c6-acf82c26b291 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:49.474381 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 230/449] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:09:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:49.479804 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a60a8-8019-4ed7-a9c6-acf82c26b291 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:49.517199 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:49.528884 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa29d4-8538-4ada-b098-93d0c4f14d96 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:49.563369 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a83dba-c52f-4825-a9e4-75fe9ad307b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:49.564225 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a83dba-c52f-4825-a9e4-75fe9ad307b8 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:49.564510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a83dba-c52f-4825-a9e4-75fe9ad307b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:49.564939 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a83dba-c52f-4825-a9e4-75fe9ad307b8 None admin] PATH_INFO: `/v3/groups/44c6e9eed2df4806b5d8ed5b2a643895` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:49.566143 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a83dba-c52f-4825-a9e4-75fe9ad307b8 None admin] RBAC: Authorizing `identity:get_group(group_id=44c6e9eed2df4806b5d8ed5b2a643895)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:49.567595 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a83dba-c52f-4825-a9e4-75fe9ad307b8 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:49.569213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 220/450] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 21:09:49 2022] GET /identity/v3/groups/44c6e9eed2df4806b5d8ed5b2a643895 => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:49.569351 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:49.574919 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a83dba-c52f-4825-a9e4-75fe9ad307b8 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:49.579270 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a60a8-8019-4ed7-a9c6-acf82c26b291 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:49.614664 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7d9ff-4e1f-45a5-b3ef-662c916fb447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:49.615316 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7d9ff-4e1f-45a5-b3ef-662c916fb447 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:49.615604 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7d9ff-4e1f-45a5-b3ef-662c916fb447 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:49.615926 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7d9ff-4e1f-45a5-b3ef-662c916fb447 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:49.675475 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a83dba-c52f-4825-a9e4-75fe9ad307b8 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:49.687038 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7d9ff-4e1f-45a5-b3ef-662c916fb447 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:49.688506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7d9ff-4e1f-45a5-b3ef-662c916fb447 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:49.709622 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba780000-4c25-4e0f-b058-473ba0bb7851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:49.710311 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba780000-4c25-4e0f-b058-473ba0bb7851 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:49.710589 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba780000-4c25-4e0f-b058-473ba0bb7851 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:49.710871 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba780000-4c25-4e0f-b058-473ba0bb7851 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:49.711703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba780000-4c25-4e0f-b058-473ba0bb7851 None admin] RBAC: Adding query filter params (group.id=44c6e9eed2df4806b5d8ed5b2a643895, role.id=15cf04fec8c6477088a33bf286f1bbdb, scope.project.id=c475db16707f46ecb5780cbec2330b6e) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:49.712015 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba780000-4c25-4e0f-b058-473ba0bb7851 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:49.713447 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba780000-4c25-4e0f-b058-473ba0bb7851 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:49.719241 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 221/451] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Jul 5 21:09:49 2022] GET /identity/v3/role_assignments?group.id=44c6e9eed2df4806b5d8ed5b2a643895&scope.project.id=c475db16707f46ecb5780cbec2330b6e&role.id=15cf04fec8c6477088a33bf286f1bbdb => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:49.789331 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:49.800443 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 231/452] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 21:09:49.806383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba780000-4c25-4e0f-b058-473ba0bb7851 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:49.833941 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:49.916099 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba780000-4c25-4e0f-b058-473ba0bb7851 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:49.949262 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615466ec-9f30-4c01-b0e7-4d44d8ea648c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:49.950053 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615466ec-9f30-4c01-b0e7-4d44d8ea648c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:49.950362 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615466ec-9f30-4c01-b0e7-4d44d8ea648c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:49.950666 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615466ec-9f30-4c01-b0e7-4d44d8ea648c None admin] PATH_INFO: `/v3/projects/c504b86211c0482394a54688bc1c6c04` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:49.951909 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615466ec-9f30-4c01-b0e7-4d44d8ea648c None admin] RBAC: Authorizing `identity:get_project(project_id=c504b86211c0482394a54688bc1c6c04)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:49.953342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615466ec-9f30-4c01-b0e7-4d44d8ea648c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:49.955055 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 222/453] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:49 2022] GET /identity/v3/projects/c504b86211c0482394a54688bc1c6c04 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:49.960531 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7d9ff-4e1f-45a5-b3ef-662c916fb447 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:50.056923 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7d9ff-4e1f-45a5-b3ef-662c916fb447 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:50.089242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fcb924-4f9d-46cf-b0de-410d2c170942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:50.090071 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcb924-4f9d-46cf-b0de-410d2c170942 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:50.090385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcb924-4f9d-46cf-b0de-410d2c170942 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:50.090662 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcb924-4f9d-46cf-b0de-410d2c170942 None admin] PATH_INFO: `/v3/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:50.092428 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fcb924-4f9d-46cf-b0de-410d2c170942 None admin] RBAC: Authorizing `identity:get_group(group_id=aeb2e2ec2ebf4345bf4fa443c872e2c1)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:50.093857 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fcb924-4f9d-46cf-b0de-410d2c170942 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:50.095467 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 232/454] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 21:09:49 2022] GET /identity/v3/groups/aeb2e2ec2ebf4345bf4fa443c872e2c1 => generated 226 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:50.100929 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615466ec-9f30-4c01-b0e7-4d44d8ea648c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:50.184722 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:50.196320 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615466ec-9f30-4c01-b0e7-4d44d8ea648c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:50.228376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f63866-03e2-4f7b-b80e-7ba14871d340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:50.228962 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f63866-03e2-4f7b-b80e-7ba14871d340 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:50.229445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f63866-03e2-4f7b-b80e-7ba14871d340 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:50.229890 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f63866-03e2-4f7b-b80e-7ba14871d340 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:50.231088 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f63866-03e2-4f7b-b80e-7ba14871d340 None admin] RBAC: Adding query filter params (group.id=aeb2e2ec2ebf4345bf4fa443c872e2c1, role.id=d39f0a4f271f470490b67062462b2d74, scope.project.id=c504b86211c0482394a54688bc1c6c04) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:50.231401 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f63866-03e2-4f7b-b80e-7ba14871d340 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:50.233431 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f63866-03e2-4f7b-b80e-7ba14871d340 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:50.239079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 223/455] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Jul 5 21:09:50 2022] GET /identity/v3/role_assignments?group.id=aeb2e2ec2ebf4345bf4fa443c872e2c1&scope.project.id=c504b86211c0482394a54688bc1c6c04&role.id=d39f0a4f271f470490b67062462b2d74 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:52.863050 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8b0c1-428a-4483-81f5-9d3a1d0da6ad None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:52.863609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8b0c1-428a-4483-81f5-9d3a1d0da6ad None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:52.863609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8b0c1-428a-4483-81f5-9d3a1d0da6ad None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:52.865321 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 233/456] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:52.870724 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd963a-7312-4f60-9c5d-ddb5d4f7fb03 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:52.871554 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd963a-7312-4f60-9c5d-ddb5d4f7fb03 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:52.872106 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd963a-7312-4f60-9c5d-ddb5d4f7fb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:52.895116 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-f2fd963a-7312-4f60-9c5d-ddb5d4f7fb03 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:52.896647 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f2fd963a-7312-4f60-9c5d-ddb5d4f7fb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:52.991478 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 224/457] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:53.040223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8b0c1-428a-4483-81f5-9d3a1d0da6ad None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:53.084657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce66ade-41c5-449c-a6da-b4fdad27f196 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:53.084945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce66ade-41c5-449c-a6da-b4fdad27f196 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:53.085503 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce66ade-41c5-449c-a6da-b4fdad27f196 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:53.087449 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 225/458] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:53.093643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c054fbd-9858-4fb4-9ea0-bd80b495b6ec None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:53.093935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c054fbd-9858-4fb4-9ea0-bd80b495b6ec None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:53.094261 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c054fbd-9858-4fb4-9ea0-bd80b495b6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:53.115145 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:53.127511 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-7c054fbd-9858-4fb4-9ea0-bd80b495b6ec None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:53.128711 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7c054fbd-9858-4fb4-9ea0-bd80b495b6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:53.196960 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8b0c1-428a-4483-81f5-9d3a1d0da6ad None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:53.268161 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 226/459] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:53.268823 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02273941-b264-49ca-b00a-c9224133c29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:53.269965 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02273941-b264-49ca-b00a-c9224133c29c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:53.270523 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02273941-b264-49ca-b00a-c9224133c29c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:53.270948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02273941-b264-49ca-b00a-c9224133c29c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:53.282594 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02273941-b264-49ca-b00a-c9224133c29c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:53.287772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02273941-b264-49ca-b00a-c9224133c29c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:53.311778 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-02273941-b264-49ca-b00a-c9224133c29c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:53.311778 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:53.311778 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:53.311778 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:53.311778 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:53.311778 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:53.311778 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:53.311778 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:53.311778 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:53.311778 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:53.311778 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:53.311778 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:53.311778 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:09:53.311778 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:09:53.311778 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:09:53.312896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:09:53.312896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:53.312896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:53.312896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:53.312896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:53.312896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:53.312896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:53.312896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:53.312896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:53.312896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:53.312896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:53.312896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:53.312896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:53.312896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:53.312896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:53.312896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:53.312896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:53.313967 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:09:53.313967 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:09:53.313967 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:53.313967 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:53.320057 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 234/460] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:53.325748 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02273941-b264-49ca-b00a-c9224133c29c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:53.325873 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c054fbd-9858-4fb4-9ea0-bd80b495b6ec None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:53.350454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:53.451584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02273941-b264-49ca-b00a-c9224133c29c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:53.463420 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:53.472573 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c054fbd-9858-4fb4-9ea0-bd80b495b6ec None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:53.489576 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47c4b1-aca7-479f-92bf-46e8f62de227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:53.490511 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47c4b1-aca7-479f-92bf-46e8f62de227 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:53.490805 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47c4b1-aca7-479f-92bf-46e8f62de227 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:53.491088 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47c4b1-aca7-479f-92bf-46e8f62de227 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:53.491844 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47c4b1-aca7-479f-92bf-46e8f62de227 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:53.492156 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47c4b1-aca7-479f-92bf-46e8f62de227 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:53.493543 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47c4b1-aca7-479f-92bf-46e8f62de227 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:53.509767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8c96e-947a-49e6-9fa9-36c54e712862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:53.511033 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8c96e-947a-49e6-9fa9-36c54e712862 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:53.511323 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8c96e-947a-49e6-9fa9-36c54e712862 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:53.511854 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8c96e-947a-49e6-9fa9-36c54e712862 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:53.518157 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 235/461] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:53.518157 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c800c2-78a9-4853-b1d0-3a070378f57a None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:53.518157 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c800c2-78a9-4853-b1d0-3a070378f57a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:53.518157 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c800c2-78a9-4853-b1d0-3a070378f57a None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:53.518483 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 236/462] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:53.523670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4cc00-f6f2-493a-a8fe-2798d1d213c2 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:53.524456 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4cc00-f6f2-493a-a8fe-2798d1d213c2 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:53.524748 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4cc00-f6f2-493a-a8fe-2798d1d213c2 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:53.526151 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 237/463] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:53.526254 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f8c96e-947a-49e6-9fa9-36c54e712862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:53.531053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4cc00-f6f2-493a-a8fe-2798d1d213c2 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:53.531180 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f8c96e-947a-49e6-9fa9-36c54e712862 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:53.547893 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-94f8c96e-947a-49e6-9fa9-36c54e712862 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:53.547893 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:53.547893 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:53.547893 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:53.547893 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:53.547893 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:53.547893 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:53.547893 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:53.547893 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:53.547893 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:53.547893 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:53.547893 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:53.547893 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:09:53.547893 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:09:53.547893 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:09:53.548795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:09:53.548795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:53.548795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:53.548795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:53.548795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:53.548795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:53.548795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:53.548795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:53.548795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:53.548795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:53.548795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:53.548795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:53.548795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:53.548795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:53.548795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:53.548795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:53.548795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:53.549766 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:09:53.549766 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:09:53.549766 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:53.549766 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:09:53.549766 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 227/464] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:53.550344 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46523a8-3a5d-41b5-ae49-16b9fc9f2860 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:53.550806 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46523a8-3a5d-41b5-ae49-16b9fc9f2860 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:53.551242 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46523a8-3a5d-41b5-ae49-16b9fc9f2860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:53.568955 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-b46523a8-3a5d-41b5-ae49-16b9fc9f2860 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:53.570168 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b46523a8-3a5d-41b5-ae49-16b9fc9f2860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:53.636699 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:53.643037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4cc00-f6f2-493a-a8fe-2798d1d213c2 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:53.651726 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 228/465] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:53.653002 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924c18e-1578-4c96-ba70-55d39541da3f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:53.653871 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924c18e-1578-4c96-ba70-55d39541da3f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:53.654162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924c18e-1578-4c96-ba70-55d39541da3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:53.680775 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa04b6-9cd7-4cfc-8fda-85e9f43a70ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:53.681452 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa04b6-9cd7-4cfc-8fda-85e9f43a70ca None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:53.681743 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa04b6-9cd7-4cfc-8fda-85e9f43a70ca None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:53.682025 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa04b6-9cd7-4cfc-8fda-85e9f43a70ca None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:53.682769 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa04b6-9cd7-4cfc-8fda-85e9f43a70ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:53.683630 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-7924c18e-1578-4c96-ba70-55d39541da3f None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:53.684216 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa04b6-9cd7-4cfc-8fda-85e9f43a70ca None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:53.685352 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7924c18e-1578-4c96-ba70-55d39541da3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:53.753659 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 229/466] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:53.754903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924c18e-1578-4c96-ba70-55d39541da3f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:53.787714 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 238/467] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 21:09:53 2022] POST /identity/v3/users => generated 246 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:09:53.788977 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa04b6-9cd7-4cfc-8fda-85e9f43a70ca None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:53.828560 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:53.896806 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924c18e-1578-4c96-ba70-55d39541da3f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:53.926600 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:53.936167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa04b6-9cd7-4cfc-8fda-85e9f43a70ca None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:53.948142 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddef54-6d13-4e0f-ba98-05f1ad2cbe97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:53.949199 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddef54-6d13-4e0f-ba98-05f1ad2cbe97 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:53.949546 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddef54-6d13-4e0f-ba98-05f1ad2cbe97 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:53.949831 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddef54-6d13-4e0f-ba98-05f1ad2cbe97 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:53.951162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ddef54-6d13-4e0f-ba98-05f1ad2cbe97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:53.951474 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ddef54-6d13-4e0f-ba98-05f1ad2cbe97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:53.952929 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ddef54-6d13-4e0f-ba98-05f1ad2cbe97 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:53.966965 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 230/468] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:53.968109 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddef54-6d13-4e0f-ba98-05f1ad2cbe97 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:53.978781 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682bbe1-d8a0-4683-82fa-311e87c5b1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:53.979587 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682bbe1-d8a0-4683-82fa-311e87c5b1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:53.979872 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682bbe1-d8a0-4683-82fa-311e87c5b1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:53.980163 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682bbe1-d8a0-4683-82fa-311e87c5b1b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:53.993136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682bbe1-d8a0-4683-82fa-311e87c5b1b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:53.994657 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682bbe1-d8a0-4683-82fa-311e87c5b1b1 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:54.014161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-c682bbe1-d8a0-4683-82fa-311e87c5b1b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:54.014161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:54.014161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:54.014161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:54.014161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:54.014161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:54.014161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:54.014161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:54.014161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:54.014161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:54.014161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:54.014161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:54.014161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:09:54.014161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:09:54.014161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:09:54.015055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:09:54.015055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:54.015055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:54.015055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:54.015055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:54.015055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:54.015055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:54.015055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:54.015055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:54.015055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:54.015055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:54.015055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:54.015055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:54.015055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:54.015055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:54.015055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:54.015055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:54.016228 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:09:54.016228 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:09:54.016228 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:54.016228 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:54.016228 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 239/469] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:54.016493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682bbe1-d8a0-4683-82fa-311e87c5b1b1 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:54.095698 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddef54-6d13-4e0f-ba98-05f1ad2cbe97 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:54.118261 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:54.138811 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a55ebf-df67-4172-9038-b89e57fded29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:54.139620 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a55ebf-df67-4172-9038-b89e57fded29 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:54.139897 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a55ebf-df67-4172-9038-b89e57fded29 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:54.140173 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a55ebf-df67-4172-9038-b89e57fded29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:54.143636 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682bbe1-d8a0-4683-82fa-311e87c5b1b1 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:54.151251 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a55ebf-df67-4172-9038-b89e57fded29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:54.152721 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a55ebf-df67-4172-9038-b89e57fded29 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:54.171675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-72a55ebf-df67-4172-9038-b89e57fded29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:54.171675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:54.171675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:54.171675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:54.171675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:54.171675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:54.171675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:54.171675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:54.171675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:54.171675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:54.171675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:54.171675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:54.171675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:09:54.171675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:09:54.171675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:09:54.172589 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:09:54.172589 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:54.172589 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:54.172589 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:54.172589 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:54.172589 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:54.172589 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:54.172589 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:54.172589 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:54.172589 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:54.172589 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:54.172589 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:54.172589 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:54.172589 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:54.172589 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:54.172589 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:54.172589 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:54.173486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:09:54.173486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:09:54.173486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:54.173486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:09:54.173486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 231/470] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:54.173762 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a55ebf-df67-4172-9038-b89e57fded29 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:54.191214 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb561ec1-465b-4591-a118-a3a59f7dbde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:54.192169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb561ec1-465b-4591-a118-a3a59f7dbde7 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:54.192461 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb561ec1-465b-4591-a118-a3a59f7dbde7 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:54.192741 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb561ec1-465b-4591-a118-a3a59f7dbde7 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:54.193614 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb561ec1-465b-4591-a118-a3a59f7dbde7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:54.195404 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb561ec1-465b-4591-a118-a3a59f7dbde7 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:54.211680 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:54.274707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 240/471] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 21:09:54 2022] POST /identity/v3/users => generated 248 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:09:54.274707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec4ca9-728f-446c-8714-f7468afb9757 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:54.274707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec4ca9-728f-446c-8714-f7468afb9757 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:54.274707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec4ca9-728f-446c-8714-f7468afb9757 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:54.274707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 241/472] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:54.274707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec4ca9-728f-446c-8714-f7468afb9757 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:54.287692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a55ebf-df67-4172-9038-b89e57fded29 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:54.331280 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5158d8-50e0-4838-97f6-616dc442f1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:54.332011 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5158d8-50e0-4838-97f6-616dc442f1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:54.332292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5158d8-50e0-4838-97f6-616dc442f1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:54.332682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5158d8-50e0-4838-97f6-616dc442f1b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:54.333472 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5158d8-50e0-4838-97f6-616dc442f1b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:54.333782 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5158d8-50e0-4838-97f6-616dc442f1b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:54.335399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5158d8-50e0-4838-97f6-616dc442f1b0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:54.354142 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 232/473] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:54.354142 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de9dd9-03aa-4f7c-ba71-0c5da4f013c9 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:54.354142 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de9dd9-03aa-4f7c-ba71-0c5da4f013c9 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:54.354142 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de9dd9-03aa-4f7c-ba71-0c5da4f013c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:54.373361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-94de9dd9-03aa-4f7c-ba71-0c5da4f013c9 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:54.374968 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-94de9dd9-03aa-4f7c-ba71-0c5da4f013c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:54.419925 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec4ca9-728f-446c-8714-f7468afb9757 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:54.457880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 233/474] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:54.459088 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de9dd9-03aa-4f7c-ba71-0c5da4f013c9 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:54.469914 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a1b3f-0624-4065-acc9-ad0cb0c20d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:54.470758 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a1b3f-0624-4065-acc9-ad0cb0c20d32 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:54.471046 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a1b3f-0624-4065-acc9-ad0cb0c20d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:54.471324 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a1b3f-0624-4065-acc9-ad0cb0c20d32 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:54.472116 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a1b3f-0624-4065-acc9-ad0cb0c20d32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:54.472423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a1b3f-0624-4065-acc9-ad0cb0c20d32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:54.473945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a1b3f-0624-4065-acc9-ad0cb0c20d32 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:54.481228 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:54.488725 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 242/475] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:54.494398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a1b3f-0624-4065-acc9-ad0cb0c20d32 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:54.497887 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:54.588686 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de9dd9-03aa-4f7c-ba71-0c5da4f013c9 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:54.628053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a1b3f-0624-4065-acc9-ad0cb0c20d32 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:54.635690 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005d43a-eb73-4699-b69e-2884181edd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:54.636371 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005d43a-eb73-4699-b69e-2884181edd7b None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:54.636651 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005d43a-eb73-4699-b69e-2884181edd7b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:54.636925 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005d43a-eb73-4699-b69e-2884181edd7b None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:54.638366 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005d43a-eb73-4699-b69e-2884181edd7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:54.639990 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005d43a-eb73-4699-b69e-2884181edd7b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:54.672821 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6451453-f9d3-4ab4-9f33-779c758683f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:54.673731 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6451453-f9d3-4ab4-9f33-779c758683f3 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:54.674216 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6451453-f9d3-4ab4-9f33-779c758683f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:54.674636 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6451453-f9d3-4ab4-9f33-779c758683f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:54.675525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6451453-f9d3-4ab4-9f33-779c758683f3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:54.677043 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6451453-f9d3-4ab4-9f33-779c758683f3 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:54.721777 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.sql.core [None req-a6451453-f9d3-4ab4-9f33-779c758683f3 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 21:09:54.721777 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 05 21:09:54.721777 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [parameters: {'id': 'be4c1157fe364eb49713ac5cf074b168', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 05 21:09:54.721777 dv-cinder-847335-3-smb devstack@keystone.service[80247]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80247) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 21:09:54.740065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-a6451453-f9d3-4ab4-9f33-779c758683f3 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 05 21:09:54.740065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:54.740065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 21:09:54.740065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 21:09:54.740065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 21:09:54.740065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 21:09:54.740065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 21:09:54.740065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 21:09:54.740065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 21:09:54.740065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application conn.query(q) Jul 05 21:09:54.740065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 21:09:54.740065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 21:09:54.740065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 21:09:54.740065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application result.read() Jul 05 21:09:54.740065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 21:09:54.741108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 21:09:54.741108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 21:09:54.741108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 21:09:54.741108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 21:09:54.741108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 21:09:54.741108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 21:09:54.741108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 21:09:54.741108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 21:09:54.741108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:54.741108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 21:09:54.741108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:54.741108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:54.741108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 21:09:54.741108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 21:09:54.741108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 05 21:09:54.741108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return ref.to_dict() Jul 05 21:09:54.741108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 21:09:54.741108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application next(self.gen) Jul 05 21:09:54.742042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 21:09:54.742042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application yield resource Jul 05 21:09:54.742042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 21:09:54.742042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application next(self.gen) Jul 05 21:09:54.742042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 21:09:54.742042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 21:09:54.742042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 21:09:54.742042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 21:09:54.742042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 21:09:54.742042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise self.value Jul 05 21:09:54.742042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 21:09:54.742042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 21:09:54.742042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 21:09:54.742042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application session.commit() Jul 05 21:09:54.742042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 21:09:54.742042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 21:09:54.742042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 21:09:54.749194 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 21:09:54.749194 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 21:09:54.749194 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self.session.flush() Jul 05 21:09:54.749194 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 21:09:54.749194 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 21:09:54.749194 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 21:09:54.749194 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 21:09:54.749194 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 21:09:54.749194 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application compat.raise_( Jul 05 21:09:54.749194 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 21:09:54.749194 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception Jul 05 21:09:54.749194 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 21:09:54.749194 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 21:09:54.749194 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 21:09:54.749194 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 21:09:54.749194 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 21:09:54.749194 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 21:09:54.750147 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 21:09:54.750147 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 21:09:54.750147 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 05 21:09:54.750147 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 05 21:09:54.750147 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 21:09:54.750147 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 21:09:54.750147 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 21:09:54.750147 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 21:09:54.750147 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 21:09:54.750147 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 21:09:54.750147 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 21:09:54.750147 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 21:09:54.750147 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 21:09:54.750147 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 21:09:54.750147 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 21:09:54.750147 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception Jul 05 21:09:54.750979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 21:09:54.750979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 21:09:54.750979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 21:09:54.750979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 21:09:54.750979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 21:09:54.750979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 21:09:54.750979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 21:09:54.750979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application conn.query(q) Jul 05 21:09:54.750979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 21:09:54.750979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 21:09:54.750979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 21:09:54.750979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application result.read() Jul 05 21:09:54.750979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 21:09:54.750979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 21:09:54.750979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 21:09:54.750979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 21:09:54.751806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 21:09:54.751806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 21:09:54.751806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 21:09:54.751806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 21:09:54.751806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 21:09:54.751806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 05 21:09:54.751806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [parameters: {'id': 'be4c1157fe364eb49713ac5cf074b168', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 05 21:09:54.751806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 21:09:54.751806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:54.751806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:09:54.751806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:54.751806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:54.751806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:54.751806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:54.751806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:54.751806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:54.752689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:54.752689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:54.752689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:54.752689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:54.752689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:54.752689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:54.752689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 05 21:09:54.752689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 05 21:09:54.752689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:54.752689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:54.752689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 05 21:09:54.752689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 05 21:09:54.752689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 21:09:54.752689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 21:09:54.752689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 05 21:09:54.752689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:54.753521 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 243/476] 10.222.0.13 () {60 vars in 1131 bytes} [Tue Jul 5 21:09:54 2022] POST /identity/v3/roles => generated 144 bytes in 248 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:54.753521 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6451453-f9d3-4ab4-9f33-779c758683f3 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:54.792494 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 234/477] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 21:09:54 2022] POST /identity/v3/users => generated 249 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:09:54.793530 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005d43a-eb73-4699-b69e-2884181edd7b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:54.853586 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:54.936737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6451453-f9d3-4ab4-9f33-779c758683f3 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:54.937923 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:54.973167 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005d43a-eb73-4699-b69e-2884181edd7b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:54.980528 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3899b4-0826-4be6-a0b6-ffe96f4a470d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:54.981897 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3899b4-0826-4be6-a0b6-ffe96f4a470d None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:54.982494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3899b4-0826-4be6-a0b6-ffe96f4a470d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:54.983050 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3899b4-0826-4be6-a0b6-ffe96f4a470d None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:54.983976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3899b4-0826-4be6-a0b6-ffe96f4a470d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:54.985606 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3899b4-0826-4be6-a0b6-ffe96f4a470d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:55.026758 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1fba0-0d14-43b5-9dda-cabe5b3f06a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:55.027886 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1fba0-0d14-43b5-9dda-cabe5b3f06a2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:55.028902 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1fba0-0d14-43b5-9dda-cabe5b3f06a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:55.029339 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1fba0-0d14-43b5-9dda-cabe5b3f06a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:55.043104 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1fba0-0d14-43b5-9dda-cabe5b3f06a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:55.052136 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-d1d1fba0-0d14-43b5-9dda-cabe5b3f06a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:09:55.052136 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:55.052136 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:55.052136 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:55.052136 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:55.052136 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:55.052136 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:55.052136 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:55.052136 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:55.052136 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:55.052136 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:55.052136 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:55.052136 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:55.052136 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:55.052136 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:55.052136 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:55.053325 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:55.053325 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:55.053325 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:55.053325 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:55.053325 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:55.053325 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:55.053325 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:55.053325 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:55.053325 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:55.053325 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:55.053325 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:55.053325 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:55.053325 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:55.053325 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:55.053325 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:55.053325 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:55.054429 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:55.054429 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:55.054429 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:55.054429 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:55.054429 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:55.054429 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:55.054429 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:55.054429 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:55.054429 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:55.054429 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:55.054429 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:09:55.054429 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:09:55.055926 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 235/478] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 21:09:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:55.062839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1fba0-0d14-43b5-9dda-cabe5b3f06a2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:55.072733 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 244/479] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 21:09:54 2022] POST /identity/v3/users => generated 248 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:09:55.181459 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1fba0-0d14-43b5-9dda-cabe5b3f06a2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:55.223797 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1c151-242b-44ec-80e5-07fba338d55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:55.224493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1c151-242b-44ec-80e5-07fba338d55c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:55.224778 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1c151-242b-44ec-80e5-07fba338d55c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:55.225056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1c151-242b-44ec-80e5-07fba338d55c None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:55.225825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1c151-242b-44ec-80e5-07fba338d55c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:55.226164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1c151-242b-44ec-80e5-07fba338d55c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:55.227564 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1c151-242b-44ec-80e5-07fba338d55c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:55.237404 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 236/480] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:09:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:56.074052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea374a-531a-419e-93db-5af1fc9109ec None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:56.074618 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea374a-531a-419e-93db-5af1fc9109ec None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:56.074618 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea374a-531a-419e-93db-5af1fc9109ec None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:56.076516 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 245/481] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:56.081526 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99291bd2-62f3-45e8-b63a-817c666db726 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:56.081945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99291bd2-62f3-45e8-b63a-817c666db726 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:56.082091 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99291bd2-62f3-45e8-b63a-817c666db726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:56.089276 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:56.103082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-99291bd2-62f3-45e8-b63a-817c666db726 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:56.106939 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-99291bd2-62f3-45e8-b63a-817c666db726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:56.199587 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 237/482] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:56.235551 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea374a-531a-419e-93db-5af1fc9109ec None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:56.369867 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea374a-531a-419e-93db-5af1fc9109ec None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:56.389384 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:56.416227 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee485afe-5531-4ecd-844f-2e50853b238a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:56.417028 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee485afe-5531-4ecd-844f-2e50853b238a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:56.417310 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee485afe-5531-4ecd-844f-2e50853b238a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:56.417581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee485afe-5531-4ecd-844f-2e50853b238a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:56.432626 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee485afe-5531-4ecd-844f-2e50853b238a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:56.442515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-ee485afe-5531-4ecd-844f-2e50853b238a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:09:56.442515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:56.442515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:56.442515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:56.442515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:56.442515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:56.442515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:56.442515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:56.442515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:56.442515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:56.442515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:56.442515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:56.442515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:56.442515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:56.442515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:56.442515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:56.443505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:56.443505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:56.443505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:56.443505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:56.443505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:56.443505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:56.443505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:56.443505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:56.443505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:56.443505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:56.443505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:56.443505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:56.443505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:56.443505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:56.443505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:56.443505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:56.444313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:56.444313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:56.444313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:56.444313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:56.444313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:56.444313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:56.444313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:56.444313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:56.444313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:56.444313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:56.444313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:09:56.444313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:56.444313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 246/483] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 21:09:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:56.449784 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99291bd2-62f3-45e8-b63a-817c666db726 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:56.644353 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99291bd2-62f3-45e8-b63a-817c666db726 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:56.683642 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4fdb5-4c88-49fc-889d-6510bff739fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:56.684720 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4fdb5-4c88-49fc-889d-6510bff739fa None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:56.685226 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4fdb5-4c88-49fc-889d-6510bff739fa None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:56.685675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4fdb5-4c88-49fc-889d-6510bff739fa None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:56.686645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4fdb5-4c88-49fc-889d-6510bff739fa None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:56.687117 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4fdb5-4c88-49fc-889d-6510bff739fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:56.688677 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4fdb5-4c88-49fc-889d-6510bff739fa None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:56.690583 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:56.699319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 238/484] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 21:09:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:56.707204 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee485afe-5531-4ecd-844f-2e50853b238a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:56.724224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e3ea0-134a-4343-99e8-917d8b8cdc39 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:56.724809 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e3ea0-134a-4343-99e8-917d8b8cdc39 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:56.725307 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e3ea0-134a-4343-99e8-917d8b8cdc39 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:56.727720 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 239/485] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:09:56.734208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf95274-2f69-4242-8351-472163989cb5 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:56.735056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf95274-2f69-4242-8351-472163989cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:56.735551 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf95274-2f69-4242-8351-472163989cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:56.753500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-edf95274-2f69-4242-8351-472163989cb5 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:56.755391 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-edf95274-2f69-4242-8351-472163989cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:56.836453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 240/486] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:09:56.862739 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf95274-2f69-4242-8351-472163989cb5 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:56.924231 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee485afe-5531-4ecd-844f-2e50853b238a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:56.977239 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf95274-2f69-4242-8351-472163989cb5 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:56.995767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c8ff4-fede-461f-95cb-4ee74d70c27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:56.996666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c8ff4-fede-461f-95cb-4ee74d70c27c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:56.997108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c8ff4-fede-461f-95cb-4ee74d70c27c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:56.997630 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c8ff4-fede-461f-95cb-4ee74d70c27c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:57.011315 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:57.021318 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c8ff4-fede-461f-95cb-4ee74d70c27c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:57.022913 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559e005-3996-465d-8ca1-8f8e1fc604e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:57.023945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559e005-3996-465d-8ca1-8f8e1fc604e7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:57.024422 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559e005-3996-465d-8ca1-8f8e1fc604e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:57.024895 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559e005-3996-465d-8ca1-8f8e1fc604e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:57.026142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c8ff4-fede-461f-95cb-4ee74d70c27c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:57.050264 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6559e005-3996-465d-8ca1-8f8e1fc604e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:57.066144 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-6559e005-3996-465d-8ca1-8f8e1fc604e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:09:57.066144 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:57.066144 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:57.066144 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:57.066144 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:57.066144 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:57.066144 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:57.066144 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:57.066144 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:57.066144 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:57.066144 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:57.066144 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:57.066144 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:57.066144 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:57.066144 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:57.066144 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:57.067062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:57.067062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:57.067062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:57.067062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:57.067062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:57.067062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:57.067062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:57.067062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:57.067062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:57.067062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:57.067062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:57.067062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:57.067062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:57.067062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:57.067062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:57.067062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:57.067902 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:57.067902 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:57.067902 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:57.067902 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:57.067902 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:57.067902 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:57.067902 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:57.067902 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:57.067902 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:57.067902 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:57.067902 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:09:57.067902 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:09:57.069865 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-0c1c8ff4-fede-461f-95cb-4ee74d70c27c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:57.069865 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:57.069865 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:57.069865 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:57.069865 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:57.069865 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:57.069865 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:57.069865 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:57.069865 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:57.069865 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:57.069865 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:57.069865 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:57.069865 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:09:57.069865 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:09:57.069865 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:09:57.070733 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:09:57.070733 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:57.070733 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:57.070733 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:57.070733 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:57.070733 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:57.070733 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:57.070733 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:57.070733 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:57.070733 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:57.070733 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:57.070733 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:57.070733 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:57.070733 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:57.070733 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:57.070733 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:57.070733 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:57.071611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:09:57.071611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:09:57.071611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:57.071611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:57.073479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 247/487] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:57.078158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 241/488] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 21:09:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:57.084332 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c8ff4-fede-461f-95cb-4ee74d70c27c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:57.090223 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559e005-3996-465d-8ca1-8f8e1fc604e7 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:57.150256 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:57.254718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559e005-3996-465d-8ca1-8f8e1fc604e7 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:57.262142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c8ff4-fede-461f-95cb-4ee74d70c27c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:57.311910 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7a8f5-f10f-4102-955b-b9bfedb931bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:57.312592 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7a8f5-f10f-4102-955b-b9bfedb931bf None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:57.312875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7a8f5-f10f-4102-955b-b9bfedb931bf None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:57.313152 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7a8f5-f10f-4102-955b-b9bfedb931bf None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:57.313890 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c7a8f5-f10f-4102-955b-b9bfedb931bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:57.314224 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c7a8f5-f10f-4102-955b-b9bfedb931bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:57.315619 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c7a8f5-f10f-4102-955b-b9bfedb931bf None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:57.328787 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70faba4-9546-4e08-b957-1a7e0b5c056f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:57.329466 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70faba4-9546-4e08-b957-1a7e0b5c056f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:57.329750 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70faba4-9546-4e08-b957-1a7e0b5c056f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:57.330023 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70faba4-9546-4e08-b957-1a7e0b5c056f None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:57.330814 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70faba4-9546-4e08-b957-1a7e0b5c056f None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:57.331118 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70faba4-9546-4e08-b957-1a7e0b5c056f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:57.332483 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70faba4-9546-4e08-b957-1a7e0b5c056f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:57.343624 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 248/489] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:57.348417 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 242/490] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 21:09:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:57.350180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7a8f5-f10f-4102-955b-b9bfedb931bf None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:57.353869 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70faba4-9546-4e08-b957-1a7e0b5c056f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:57.450698 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:57.508716 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70faba4-9546-4e08-b957-1a7e0b5c056f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:57.542377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:57.558358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f3686-1d63-4078-b037-61e32dd4d3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:57.559184 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f3686-1d63-4078-b037-61e32dd4d3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:57.559520 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f3686-1d63-4078-b037-61e32dd4d3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:57.559795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f3686-1d63-4078-b037-61e32dd4d3c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:57.572991 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7a8f5-f10f-4102-955b-b9bfedb931bf None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:57.593657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f3686-1d63-4078-b037-61e32dd4d3c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:57.594063 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f3686-1d63-4078-b037-61e32dd4d3c5 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:57.611498 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4d170-7a87-46a5-8ebd-7417501883ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:57.612302 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4d170-7a87-46a5-8ebd-7417501883ce None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:57.612583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4d170-7a87-46a5-8ebd-7417501883ce None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:57.612861 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4d170-7a87-46a5-8ebd-7417501883ce None admin] PATH_INFO: `/v3/users/nova` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:57.620774 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4d170-7a87-46a5-8ebd-7417501883ce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:57.622577 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4d170-7a87-46a5-8ebd-7417501883ce None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:57.638259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-b4e4d170-7a87-46a5-8ebd-7417501883ce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:09:57.638259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:57.638259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:57.638259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:57.638259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:57.638259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:57.638259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:57.638259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:57.638259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:57.638259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:57.638259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:57.638259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:57.638259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:09:57.638259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:09:57.638259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:09:57.638259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:09:57.639319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:57.639319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:57.639319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:09:57.639319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:09:57.639319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:09:57.639319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:09:57.639319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:57.639319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:57.639319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:57.639319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:57.639319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:57.639319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:57.639319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:57.639319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:57.639319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:57.639319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:57.639319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:57.639319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:57.640255 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:57.640255 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:57.640255 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:09:57.640255 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:09:57.640255 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:09:57.640255 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:09:57.640255 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:09:57.640255 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:09:57.640255 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:09:57.640255 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:57.641155 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-397f3686-1d63-4078-b037-61e32dd4d3c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:57.641155 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:57.641155 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:57.641155 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:57.641155 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:57.641155 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:57.641155 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:57.641155 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:57.641155 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:57.641155 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:57.641155 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:57.641155 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:57.641155 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:09:57.641155 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:09:57.641155 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:09:57.641960 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:09:57.641960 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:57.641960 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:57.641960 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:57.641960 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:57.641960 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:57.641960 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:57.641960 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:57.641960 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:57.641960 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:57.641960 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:57.641960 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:57.641960 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:57.641960 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:57.641960 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:57.641960 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:57.641960 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:57.642869 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:09:57.642869 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:09:57.642869 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:57.642869 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:09:57.643092 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 249/491] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Jul 5 21:09:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:57.645465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 243/492] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:57.649713 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4d170-7a87-46a5-8ebd-7417501883ce None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:57.650771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f3686-1d63-4078-b037-61e32dd4d3c5 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:57.781131 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:57.783418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4d170-7a87-46a5-8ebd-7417501883ce None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:57.784371 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f3686-1d63-4078-b037-61e32dd4d3c5 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:57.817403 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a6e3d-b5b4-483e-882a-54466f8f7672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:57.818074 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a6e3d-b5b4-483e-882a-54466f8f7672 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:57.818389 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a6e3d-b5b4-483e-882a-54466f8f7672 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:57.818665 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a6e3d-b5b4-483e-882a-54466f8f7672 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:57.819513 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a6e3d-b5b4-483e-882a-54466f8f7672 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:57.819824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a6e3d-b5b4-483e-882a-54466f8f7672 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:57.821000 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aac3df-f6e5-424d-a0c1-235edb0ae6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:57.821285 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a6e3d-b5b4-483e-882a-54466f8f7672 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:57.822096 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aac3df-f6e5-424d-a0c1-235edb0ae6ea None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:57.822645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aac3df-f6e5-424d-a0c1-235edb0ae6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:57.823145 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aac3df-f6e5-424d-a0c1-235edb0ae6ea None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:57.823969 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aac3df-f6e5-424d-a0c1-235edb0ae6ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:57.824453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aac3df-f6e5-424d-a0c1-235edb0ae6ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:57.826811 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aac3df-f6e5-424d-a0c1-235edb0ae6ea None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:57.843536 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 244/493] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:57.843536 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be5443-757e-4e8b-8b61-0d372db3c130 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:57.843536 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be5443-757e-4e8b-8b61-0d372db3c130 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:57.843536 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be5443-757e-4e8b-8b61-0d372db3c130 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:57.843536 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 245/494] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:57.844523 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba0c0b-7fe8-4a2e-bb42-701a6608558d None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:57.844523 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba0c0b-7fe8-4a2e-bb42-701a6608558d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:57.844701 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba0c0b-7fe8-4a2e-bb42-701a6608558d None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:57.845963 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 246/495] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:57.850434 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba0c0b-7fe8-4a2e-bb42-701a6608558d None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:57.866427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 250/496] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Jul 5 21:09:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:57.867561 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738f642-7980-41e9-8b9b-e159c6c4c71f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:57.867847 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738f642-7980-41e9-8b9b-e159c6c4c71f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:57.868126 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738f642-7980-41e9-8b9b-e159c6c4c71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:57.874188 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:57.885244 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-a738f642-7980-41e9-8b9b-e159c6c4c71f None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:57.886487 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a738f642-7980-41e9-8b9b-e159c6c4c71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:57.953170 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 251/497] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:57.954472 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7f497-2ecd-4a57-9c40-3793e445fa5a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:57.954763 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7f497-2ecd-4a57-9c40-3793e445fa5a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:57.955043 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7f497-2ecd-4a57-9c40-3793e445fa5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:57.960845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba0c0b-7fe8-4a2e-bb42-701a6608558d None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:57.975609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-01c7f497-2ecd-4a57-9c40-3793e445fa5a None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:57.976872 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-01c7f497-2ecd-4a57-9c40-3793e445fa5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:58.000244 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ace060-6965-4cc9-8771-fd923d5f2105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:58.001034 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ace060-6965-4cc9-8771-fd923d5f2105 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:58.001311 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ace060-6965-4cc9-8771-fd923d5f2105 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:58.001582 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ace060-6965-4cc9-8771-fd923d5f2105 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:58.008811 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ace060-6965-4cc9-8771-fd923d5f2105 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:58.010289 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ace060-6965-4cc9-8771-fd923d5f2105 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:58.026882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-c7ace060-6965-4cc9-8771-fd923d5f2105 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:09:58.026882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:58.026882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:58.026882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:58.026882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:58.026882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:58.026882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:58.026882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:58.026882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:58.026882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:58.026882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:58.026882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:58.026882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:09:58.026882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:09:58.026882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:09:58.026882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:09:58.027899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:58.027899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:58.027899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:09:58.027899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:09:58.027899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:09:58.027899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:09:58.027899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:58.027899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:58.027899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:58.027899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:58.027899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:58.027899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:58.027899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:58.027899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:58.027899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:58.027899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:58.027899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:58.027899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:58.029311 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:58.029311 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:58.029311 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:09:58.029311 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:09:58.029311 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:09:58.029311 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:09:58.029311 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:09:58.029311 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:09:58.029311 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:09:58.029311 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:09:58.029311 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 247/498] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:58.029882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ace060-6965-4cc9-8771-fd923d5f2105 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:58.044062 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 252/499] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:58.045310 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c95c8b-fd2f-48a9-986b-46dcebcf604a None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:58.045602 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c95c8b-fd2f-48a9-986b-46dcebcf604a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:58.045883 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c95c8b-fd2f-48a9-986b-46dcebcf604a None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:58.047214 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 253/500] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:58.051921 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c95c8b-fd2f-48a9-986b-46dcebcf604a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:58.052357 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:58.126567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:58.132782 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ace060-6965-4cc9-8771-fd923d5f2105 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:58.165246 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c95c8b-fd2f-48a9-986b-46dcebcf604a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:58.167103 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662a4e0-9594-4d13-9ee1-e1e1a95a6ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:58.167748 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662a4e0-9594-4d13-9ee1-e1e1a95a6ced None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:58.168027 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662a4e0-9594-4d13-9ee1-e1e1a95a6ced None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:58.168298 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662a4e0-9594-4d13-9ee1-e1e1a95a6ced None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:58.198501 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d76ac-22a2-43aa-a0c0-02ce9209890b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:58.199288 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d76ac-22a2-43aa-a0c0-02ce9209890b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:58.199570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d76ac-22a2-43aa-a0c0-02ce9209890b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:58.200400 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d76ac-22a2-43aa-a0c0-02ce9209890b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:58.210479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d76ac-22a2-43aa-a0c0-02ce9209890b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:58.218271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-829d76ac-22a2-43aa-a0c0-02ce9209890b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:09:58.218271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:58.218271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:58.218271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:58.218271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:58.218271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:58.218271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:58.218271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:58.218271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:58.218271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:58.218271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:58.218271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:58.218271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:58.218271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:58.218271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:58.218271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:58.219369 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:58.219369 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:58.219369 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:58.219369 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:58.219369 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:58.219369 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:58.219369 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:58.219369 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:58.219369 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:58.219369 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:58.219369 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:58.219369 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:58.219369 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:58.219369 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:58.219369 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:58.219369 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:58.220204 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:58.220204 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:58.220204 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:58.220204 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:58.220204 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:58.220204 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:58.220204 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:58.220204 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:58.220204 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:58.220204 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:58.220204 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:09:58.220204 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:58.220204 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 254/501] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 21:09:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:58.220880 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d76ac-22a2-43aa-a0c0-02ce9209890b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:58.238131 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662a4e0-9594-4d13-9ee1-e1e1a95a6ced None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:58.239609 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662a4e0-9594-4d13-9ee1-e1e1a95a6ced None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:58.260168 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:58.323116 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d76ac-22a2-43aa-a0c0-02ce9209890b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:58.337245 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 248/502] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:58.338539 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cbe4b-d6a7-41bf-b431-6550dcc87bdf None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:58.338830 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cbe4b-d6a7-41bf-b431-6550dcc87bdf None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:58.339109 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cbe4b-d6a7-41bf-b431-6550dcc87bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:58.349544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:58.356803 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-a21cbe4b-d6a7-41bf-b431-6550dcc87bdf None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:58.358075 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a21cbe4b-d6a7-41bf-b431-6550dcc87bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:58.364702 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783da348-64b6-4ba4-b199-1bf96e0c9d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:58.364702 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783da348-64b6-4ba4-b199-1bf96e0c9d13 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:58.364702 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783da348-64b6-4ba4-b199-1bf96e0c9d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:58.364702 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783da348-64b6-4ba4-b199-1bf96e0c9d13 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:58.365163 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783da348-64b6-4ba4-b199-1bf96e0c9d13 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:58.365163 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783da348-64b6-4ba4-b199-1bf96e0c9d13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:58.365163 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783da348-64b6-4ba4-b199-1bf96e0c9d13 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:58.380882 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 255/503] 10.222.0.13 () {56 vars in 1137 bytes} [Tue Jul 5 21:09:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:58.381675 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783da348-64b6-4ba4-b199-1bf96e0c9d13 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:58.425608 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 249/504] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:09:58.426691 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cbe4b-d6a7-41bf-b431-6550dcc87bdf None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:58.482784 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:58.493735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783da348-64b6-4ba4-b199-1bf96e0c9d13 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:58.531526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119584f0-d4da-4255-861b-b1fa5cce8587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:58.532179 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cbe4b-d6a7-41bf-b431-6550dcc87bdf None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:58.532319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119584f0-d4da-4255-861b-b1fa5cce8587 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:58.532608 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119584f0-d4da-4255-861b-b1fa5cce8587 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:58.532883 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119584f0-d4da-4255-861b-b1fa5cce8587 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:58.543018 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119584f0-d4da-4255-861b-b1fa5cce8587 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:58.551440 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-119584f0-d4da-4255-861b-b1fa5cce8587 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:09:58.551440 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:58.551440 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:58.551440 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:58.551440 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:58.551440 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:58.551440 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:58.551440 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:58.551440 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:58.551440 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:58.551440 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:58.551440 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:58.551440 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:58.551440 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:58.551440 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:58.551440 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:58.552514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:58.552514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:58.552514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:58.552514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:58.552514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:58.552514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:58.552514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:58.552514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:58.552514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:58.552514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:58.552514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:58.552514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:58.552514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:58.552514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:58.552514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:58.552514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:58.553383 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:58.553383 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:58.553383 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:58.553383 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:58.553383 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:58.553383 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:58.553383 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:58.553383 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:58.553383 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:58.553383 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:58.553383 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:09:58.553383 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:58.553383 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 256/505] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 21:09:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:58.553383 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119584f0-d4da-4255-861b-b1fa5cce8587 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:58.569007 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833ba7b-9735-45d7-bb69-c9009e8b4170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:58.569790 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833ba7b-9735-45d7-bb69-c9009e8b4170 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:58.570076 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833ba7b-9735-45d7-bb69-c9009e8b4170 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:58.570390 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833ba7b-9735-45d7-bb69-c9009e8b4170 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:58.571139 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833ba7b-9735-45d7-bb69-c9009e8b4170 None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:58.571446 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833ba7b-9735-45d7-bb69-c9009e8b4170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:58.572842 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833ba7b-9735-45d7-bb69-c9009e8b4170 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:58.582270 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 250/506] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 21:09:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:58.583090 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833ba7b-9735-45d7-bb69-c9009e8b4170 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:58.603105 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:58.660784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119584f0-d4da-4255-861b-b1fa5cce8587 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:58.685307 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833ba7b-9735-45d7-bb69-c9009e8b4170 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:58.694274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361a83e-318f-4369-ad07-de38cdc0fdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:58.695065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361a83e-318f-4369-ad07-de38cdc0fdf5 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:58.695348 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361a83e-318f-4369-ad07-de38cdc0fdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:58.695628 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361a83e-318f-4369-ad07-de38cdc0fdf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:58.699292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:58.706717 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361a83e-318f-4369-ad07-de38cdc0fdf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:58.708190 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361a83e-318f-4369-ad07-de38cdc0fdf5 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:58.719829 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffeff24-a557-4ae9-9381-9889ed91c580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:58.734040 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffeff24-a557-4ae9-9381-9889ed91c580 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:58.734040 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffeff24-a557-4ae9-9381-9889ed91c580 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:58.734040 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffeff24-a557-4ae9-9381-9889ed91c580 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:58.734363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-7361a83e-318f-4369-ad07-de38cdc0fdf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:58.734363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:58.734363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:58.734363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:58.734363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:58.734363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:58.734363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:58.734363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:58.734363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:58.734363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:58.734363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:58.734363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:58.734363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:09:58.734363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:09:58.734363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:09:58.735363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:09:58.735363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:58.735363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:58.735363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:58.735363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:58.735363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:58.735363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:58.735363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:58.735363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:58.735363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:58.735363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:58.735363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:58.735363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:58.735363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:58.735363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:58.735363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:58.735363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:58.736435 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:09:58.736435 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:09:58.736435 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:58.736435 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:58.736435 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 257/507] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:58.736435 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361a83e-318f-4369-ad07-de38cdc0fdf5 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:58.792786 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffeff24-a557-4ae9-9381-9889ed91c580 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:58.794623 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffeff24-a557-4ae9-9381-9889ed91c580 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:58.822851 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:58.829909 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361a83e-318f-4369-ad07-de38cdc0fdf5 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:58.865659 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fe91e-2624-4d88-b6af-3c37cb8c6fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:58.866764 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fe91e-2624-4d88-b6af-3c37cb8c6fea None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:58.867194 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fe91e-2624-4d88-b6af-3c37cb8c6fea None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:58.867605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fe91e-2624-4d88-b6af-3c37cb8c6fea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:58.880282 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fe91e-2624-4d88-b6af-3c37cb8c6fea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:58.881742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fe91e-2624-4d88-b6af-3c37cb8c6fea None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:58.895206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 251/508] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:58.896042 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffeff24-a557-4ae9-9381-9889ed91c580 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:58.899231 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-671fe91e-2624-4d88-b6af-3c37cb8c6fea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:58.899231 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:58.899231 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:58.899231 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:58.899231 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:58.899231 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:58.899231 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:58.899231 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:58.899231 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:58.899231 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:58.899231 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:58.899231 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:58.899231 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:09:58.899231 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:09:58.899231 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:09:58.900493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:09:58.900493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:58.900493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:58.900493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:58.900493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:58.900493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:58.900493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:58.900493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:58.900493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:58.900493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:58.900493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:58.900493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:58.900493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:58.900493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:58.900493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:58.900493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:58.900493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:58.901760 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:09:58.901760 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:09:58.901760 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:58.901760 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:58.901760 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 258/509] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:58.901760 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fe91e-2624-4d88-b6af-3c37cb8c6fea None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:58.916097 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:58.999305 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffeff24-a557-4ae9-9381-9889ed91c580 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:58.999710 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fe91e-2624-4d88-b6af-3c37cb8c6fea None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:59.033900 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981105d2-dab0-4bc8-9ae9-a2b411bb8fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:59.034216 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3dd0af-5ee1-4839-922b-400e7fdb180e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:59.034583 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981105d2-dab0-4bc8-9ae9-a2b411bb8fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:59.034861 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981105d2-dab0-4bc8-9ae9-a2b411bb8fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:59.035004 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3dd0af-5ee1-4839-922b-400e7fdb180e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:59.035131 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981105d2-dab0-4bc8-9ae9-a2b411bb8fa5 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:59.035289 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3dd0af-5ee1-4839-922b-400e7fdb180e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:59.035568 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3dd0af-5ee1-4839-922b-400e7fdb180e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:59.035865 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981105d2-dab0-4bc8-9ae9-a2b411bb8fa5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:59.036167 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981105d2-dab0-4bc8-9ae9-a2b411bb8fa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:59.037534 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981105d2-dab0-4bc8-9ae9-a2b411bb8fa5 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:59.045257 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 252/510] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 21:09:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:59.045840 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3dd0af-5ee1-4839-922b-400e7fdb180e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:59.046031 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981105d2-dab0-4bc8-9ae9-a2b411bb8fa5 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:59.047403 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3dd0af-5ee1-4839-922b-400e7fdb180e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:59.054728 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:59.067525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-ec3dd0af-5ee1-4839-922b-400e7fdb180e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:59.067525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:59.067525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:59.067525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:59.067525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:59.067525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:59.067525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:59.067525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:59.067525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:59.067525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:59.067525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:59.067525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:59.067525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:09:59.067525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:09:59.067525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:09:59.068479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:09:59.068479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:59.068479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:59.068479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:59.068479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:59.068479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:59.068479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:59.068479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:59.068479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:59.068479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:59.068479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:59.068479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:59.068479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:59.068479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:59.068479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:59.068479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:59.068479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:59.069414 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:09:59.069414 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:09:59.069414 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:59.069414 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:59.069414 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 259/511] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:59.069695 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3dd0af-5ee1-4839-922b-400e7fdb180e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:59.125841 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:59.151157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981105d2-dab0-4bc8-9ae9-a2b411bb8fa5 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:59.172845 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3dd0af-5ee1-4839-922b-400e7fdb180e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:59.187957 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe86a2-bc83-40b8-aec4-5dd368be4853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:59.188622 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe86a2-bc83-40b8-aec4-5dd368be4853 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:59.188909 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe86a2-bc83-40b8-aec4-5dd368be4853 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:59.189188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe86a2-bc83-40b8-aec4-5dd368be4853 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:59.189921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe86a2-bc83-40b8-aec4-5dd368be4853 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:59.190267 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe86a2-bc83-40b8-aec4-5dd368be4853 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:59.191662 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe86a2-bc83-40b8-aec4-5dd368be4853 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:59.204148 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 253/512] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:59.204936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe86a2-bc83-40b8-aec4-5dd368be4853 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:59.213115 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c6742-8340-40cd-94ee-d2fab1c02117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:59.213909 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c6742-8340-40cd-94ee-d2fab1c02117 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:59.214223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c6742-8340-40cd-94ee-d2fab1c02117 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:59.214502 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c6742-8340-40cd-94ee-d2fab1c02117 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:59.225318 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c6742-8340-40cd-94ee-d2fab1c02117 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:59.226824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c6742-8340-40cd-94ee-d2fab1c02117 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:59.243715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-b05c6742-8340-40cd-94ee-d2fab1c02117 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:59.243715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:59.243715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:59.243715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:59.243715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:59.243715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:59.243715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:59.243715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:59.243715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:59.243715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:59.243715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:59.243715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:59.243715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:09:59.243715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:09:59.243715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:09:59.244603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:09:59.244603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:59.244603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:59.244603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:59.244603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:59.244603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:59.244603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:59.244603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:59.244603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:59.244603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:59.244603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:59.244603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:59.244603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:59.244603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:59.244603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:59.244603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:59.244603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:59.245506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:09:59.245506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:09:59.245506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:59.245506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:59.245506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 260/513] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:59.245771 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c6742-8340-40cd-94ee-d2fab1c02117 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:59.294392 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:59.305952 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe86a2-bc83-40b8-aec4-5dd368be4853 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:59.340480 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716fb98-7e86-4201-8195-c36fed5e9b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:59.341140 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716fb98-7e86-4201-8195-c36fed5e9b98 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:59.341417 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716fb98-7e86-4201-8195-c36fed5e9b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:59.341691 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716fb98-7e86-4201-8195-c36fed5e9b98 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:59.342427 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716fb98-7e86-4201-8195-c36fed5e9b98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:59.342733 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716fb98-7e86-4201-8195-c36fed5e9b98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:59.343093 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c6742-8340-40cd-94ee-d2fab1c02117 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:59.344110 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716fb98-7e86-4201-8195-c36fed5e9b98 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:59.345505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:59.360416 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 254/514] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:59.360416 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716fb98-7e86-4201-8195-c36fed5e9b98 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:59.377863 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fe880-dffb-4fc5-923d-344644ecaf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:59.378621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fe880-dffb-4fc5-923d-344644ecaf15 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:59.378901 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fe880-dffb-4fc5-923d-344644ecaf15 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:59.379176 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fe880-dffb-4fc5-923d-344644ecaf15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:59.389665 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5fe880-dffb-4fc5-923d-344644ecaf15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:59.391437 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5fe880-dffb-4fc5-923d-344644ecaf15 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:59.408151 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-4b5fe880-dffb-4fc5-923d-344644ecaf15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:59.408151 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:59.408151 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:59.408151 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:59.408151 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:59.408151 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:59.408151 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:59.408151 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:59.408151 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:59.408151 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:59.408151 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:59.408151 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:59.408151 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:09:59.408151 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:09:59.408151 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:09:59.409113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:09:59.409113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:59.409113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:59.409113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:59.409113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:59.409113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:59.409113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:59.409113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:59.409113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:59.409113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:59.409113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:59.409113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:59.409113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:59.409113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:59.409113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:59.409113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:59.409113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:59.410012 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:09:59.410012 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:09:59.410012 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:59.410012 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:59.410012 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 261/515] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:59.410336 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fe880-dffb-4fc5-923d-344644ecaf15 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:59.459986 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716fb98-7e86-4201-8195-c36fed5e9b98 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:59.492908 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e9696-e6f3-4e07-b43b-c8f2d1742474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:59.493562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e9696-e6f3-4e07-b43b-c8f2d1742474 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:59.493841 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e9696-e6f3-4e07-b43b-c8f2d1742474 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:59.494145 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e9696-e6f3-4e07-b43b-c8f2d1742474 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:59.494853 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e9696-e6f3-4e07-b43b-c8f2d1742474 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:59.495158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e9696-e6f3-4e07-b43b-c8f2d1742474 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:59.497192 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e9696-e6f3-4e07-b43b-c8f2d1742474 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:59.508809 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 255/516] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:59.509593 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e9696-e6f3-4e07-b43b-c8f2d1742474 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:59.517611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fe880-dffb-4fc5-923d-344644ecaf15 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:59.519249 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:59.550631 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f924a6a-7a74-45fb-b417-4da26d36fd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:59.551423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f924a6a-7a74-45fb-b417-4da26d36fd0c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:59.551708 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f924a6a-7a74-45fb-b417-4da26d36fd0c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:59.551986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f924a6a-7a74-45fb-b417-4da26d36fd0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:59.558744 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f924a6a-7a74-45fb-b417-4da26d36fd0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:59.560770 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f924a6a-7a74-45fb-b417-4da26d36fd0c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:59.564926 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:59.576605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-1f924a6a-7a74-45fb-b417-4da26d36fd0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:09:59.576605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:59.576605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:59.576605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:59.576605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:59.576605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:59.576605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:59.576605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:59.576605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:59.576605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:59.576605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:59.576605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:59.576605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:09:59.576605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:09:59.576605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:09:59.577649 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:09:59.577649 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:59.577649 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:59.577649 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:59.577649 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:59.577649 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:59.577649 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:59.577649 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:59.577649 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:59.577649 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:59.577649 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:59.577649 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:59.577649 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:59.577649 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:59.577649 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:59.577649 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:59.577649 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:59.578765 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:09:59.578765 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:09:59.578765 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:09:59.578765 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:09:59.578765 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:09:59.578765 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:09:59.578765 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:09:59.578765 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:09:59.578765 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 262/517] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:09:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:59.578765 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f924a6a-7a74-45fb-b417-4da26d36fd0c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:59.613767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e9696-e6f3-4e07-b43b-c8f2d1742474 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:59.653330 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c7db6-b4c3-40d4-a3da-08134e0f0d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:59.653330 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c7db6-b4c3-40d4-a3da-08134e0f0d55 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:59.653330 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c7db6-b4c3-40d4-a3da-08134e0f0d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:59.653330 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c7db6-b4c3-40d4-a3da-08134e0f0d55 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:59.653746 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c7db6-b4c3-40d4-a3da-08134e0f0d55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:59.653746 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c7db6-b4c3-40d4-a3da-08134e0f0d55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:59.653746 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c7db6-b4c3-40d4-a3da-08134e0f0d55 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:59.664389 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 256/518] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:59.665208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c7db6-b4c3-40d4-a3da-08134e0f0d55 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:59.686159 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f924a6a-7a74-45fb-b417-4da26d36fd0c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:59.720493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971af235-038a-44c4-8a48-5809e6164af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:59.721166 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971af235-038a-44c4-8a48-5809e6164af0 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:59.721447 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971af235-038a-44c4-8a48-5809e6164af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:59.721726 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971af235-038a-44c4-8a48-5809e6164af0 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:59.722470 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971af235-038a-44c4-8a48-5809e6164af0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:59.723913 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971af235-038a-44c4-8a48-5809e6164af0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:59.763647 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c7db6-b4c3-40d4-a3da-08134e0f0d55 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:59.776884 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:59.797047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a47905-e93b-4465-8614-4a92aa1caf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:59.797697 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a47905-e93b-4465-8614-4a92aa1caf9c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:59.797981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a47905-e93b-4465-8614-4a92aa1caf9c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:59.798286 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a47905-e93b-4465-8614-4a92aa1caf9c None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:59.799000 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a47905-e93b-4465-8614-4a92aa1caf9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:59.799307 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a47905-e93b-4465-8614-4a92aa1caf9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:59.800662 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a47905-e93b-4465-8614-4a92aa1caf9c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:59.811866 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 257/519] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:59.812638 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a47905-e93b-4465-8614-4a92aa1caf9c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:59.830211 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 263/520] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 21:09:59 2022] POST /identity/v3/users => generated 247 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:09:59.830211 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971af235-038a-44c4-8a48-5809e6164af0 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:59.846028 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:59.926794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a47905-e93b-4465-8614-4a92aa1caf9c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:59.948206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971af235-038a-44c4-8a48-5809e6164af0 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:59.963125 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add43de7-e7c7-4931-b3cc-7a2ca9970e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:59.963923 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add43de7-e7c7-4931-b3cc-7a2ca9970e91 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:59.964201 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add43de7-e7c7-4931-b3cc-7a2ca9970e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:59.964494 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add43de7-e7c7-4931-b3cc-7a2ca9970e91 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:59.975669 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add43de7-e7c7-4931-b3cc-7a2ca9970e91 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:59.977130 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add43de7-e7c7-4931-b3cc-7a2ca9970e91 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:59.991180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750be6f-ab62-4e93-91f0-13c35c5f0d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:59.991840 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750be6f-ab62-4e93-91f0-13c35c5f0d77 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:59.992133 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750be6f-ab62-4e93-91f0-13c35c5f0d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:59.992407 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750be6f-ab62-4e93-91f0-13c35c5f0d77 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:59.993541 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750be6f-ab62-4e93-91f0-13c35c5f0d77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:59.993656 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-add43de7-e7c7-4931-b3cc-7a2ca9970e91 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 21:09:59.993656 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:59.993656 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:59.993656 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:59.993656 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:59.993656 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:59.993656 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:59.993656 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:59.993656 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:59.993656 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:59.993656 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:59.993656 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:59.993656 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:09:59.993656 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:09:59.993656 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:09:59.993656 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:09:59.994778 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:59.994778 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:59.994778 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:09:59.994778 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:09:59.994778 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:09:59.994778 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:09:59.994778 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:59.994778 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:59.994778 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:59.994778 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:59.994778 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:59.994778 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:59.994778 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:59.994778 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:59.994778 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:59.994778 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:59.994778 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:59.994778 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:59.995816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:59.995816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:59.995816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:09:59.995816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:09:59.995816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:09:59.995816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:09:59.995816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:09:59.995816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:09:59.995816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 21:09:59.995816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:09:59.996325 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750be6f-ab62-4e93-91f0-13c35c5f0d77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:59.996325 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750be6f-ab62-4e93-91f0-13c35c5f0d77 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:59.997764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 258/521] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:59.998782 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add43de7-e7c7-4931-b3cc-7a2ca9970e91 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:00.017530 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 264/522] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:09:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:00.019482 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750be6f-ab62-4e93-91f0-13c35c5f0d77 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:00.043876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:00.111659 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:00.112512 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add43de7-e7c7-4931-b3cc-7a2ca9970e91 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:00.133495 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750be6f-ab62-4e93-91f0-13c35c5f0d77 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:00.150347 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47600257-71a6-4764-aa83-2c8b2f16c9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:00.151141 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47600257-71a6-4764-aa83-2c8b2f16c9fd None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:00.151422 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47600257-71a6-4764-aa83-2c8b2f16c9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:00.151946 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47600257-71a6-4764-aa83-2c8b2f16c9fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:00.158779 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47600257-71a6-4764-aa83-2c8b2f16c9fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:00.160299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47600257-71a6-4764-aa83-2c8b2f16c9fd None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:00.172228 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfc332-e195-4b17-8923-7be4cd014440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:00.173291 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfc332-e195-4b17-8923-7be4cd014440 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:00.174236 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfc332-e195-4b17-8923-7be4cd014440 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:00.174686 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfc332-e195-4b17-8923-7be4cd014440 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:00.175522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-47600257-71a6-4764-aa83-2c8b2f16c9fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:00.175522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:00.175522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:00.175522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:00.175522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:00.175522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:00.175522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:00.175522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:00.175522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:00.175522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:00.175522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:00.175522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:00.175522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:10:00.175522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:10:00.175522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:10:00.176347 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:10:00.176347 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:00.176347 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:00.176347 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:00.176347 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:00.176347 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:00.176347 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:00.176347 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:00.176347 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:00.176347 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:00.176347 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:00.176347 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:00.176347 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:00.176347 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:00.176347 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:00.176347 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:00.176347 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:00.177346 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:10:00.177346 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:10:00.177346 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:10:00.177346 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:10:00.177346 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:10:00.177346 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:10:00.177346 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:00.177346 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:00.177346 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 259/523] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:09:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:00.177836 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47600257-71a6-4764-aa83-2c8b2f16c9fd None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:00.189901 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cfc332-e195-4b17-8923-7be4cd014440 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:00.192114 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cfc332-e195-4b17-8923-7be4cd014440 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:00.209065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-26cfc332-e195-4b17-8923-7be4cd014440 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 21:10:00.209065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:00.209065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:00.209065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:00.209065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:00.209065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:00.209065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:00.209065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:00.209065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:00.209065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:00.209065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:00.209065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:00.209065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:10:00.209065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:10:00.209065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:10:00.209065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:10:00.210024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:00.210024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:00.210024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:10:00.210024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:00.210024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:10:00.210024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:00.210024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:00.210024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:00.210024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:00.210024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:00.210024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:00.210024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:00.210024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:00.210024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:00.210024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:00.210024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:00.210024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:00.210024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:00.211013 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:00.211013 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:00.211013 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:10:00.211013 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:10:00.211013 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:10:00.211013 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:10:00.211013 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:10:00.211013 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:10:00.211013 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 21:10:00.211013 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:00.218104 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 265/524] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 21:10:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:00.218104 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfc332-e195-4b17-8923-7be4cd014440 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:00.284003 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:00.290545 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47600257-71a6-4764-aa83-2c8b2f16c9fd None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:00.326774 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfc332-e195-4b17-8923-7be4cd014440 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:00.328185 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389e20e-c4f0-4fa4-a5a7-8dce16c8bb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:00.328927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389e20e-c4f0-4fa4-a5a7-8dce16c8bb38 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:00.329947 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389e20e-c4f0-4fa4-a5a7-8dce16c8bb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:00.329947 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389e20e-c4f0-4fa4-a5a7-8dce16c8bb38 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:00.330408 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389e20e-c4f0-4fa4-a5a7-8dce16c8bb38 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:00.330723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389e20e-c4f0-4fa4-a5a7-8dce16c8bb38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:00.332277 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389e20e-c4f0-4fa4-a5a7-8dce16c8bb38 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:00.365338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68b838-4d62-4915-85e3-17cdc83e1add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:00.365994 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68b838-4d62-4915-85e3-17cdc83e1add None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:00.366327 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68b838-4d62-4915-85e3-17cdc83e1add None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:00.366587 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68b838-4d62-4915-85e3-17cdc83e1add None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:00.367449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c68b838-4d62-4915-85e3-17cdc83e1add None admin] RBAC: Adding query filter params (role.id=c641ed689379413190e5e4ff94eb90ba, scope.project.id=1076c94b43b2483eb4fc06173f9204c3, user.id=910cd341df8943f18af2765e2a30b238) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:00.367757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c68b838-4d62-4915-85e3-17cdc83e1add None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:00.369198 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c68b838-4d62-4915-85e3-17cdc83e1add None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:00.386153 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 266/525] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:10:00 2022] GET /identity/v3/role_assignments?user.id=910cd341df8943f18af2765e2a30b238&scope.project.id=1076c94b43b2483eb4fc06173f9204c3&role.id=c641ed689379413190e5e4ff94eb90ba => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:00.386153 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68b838-4d62-4915-85e3-17cdc83e1add None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:00.388461 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 260/526] 10.222.0.13 () {56 vars in 1137 bytes} [Tue Jul 5 21:10:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:00.388461 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389e20e-c4f0-4fa4-a5a7-8dce16c8bb38 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:00.388650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:00.509049 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389e20e-c4f0-4fa4-a5a7-8dce16c8bb38 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:00.520469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68b838-4d62-4915-85e3-17cdc83e1add None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:00.558157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ddc77-af18-439b-ad93-ab89ffd4db82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:00.559972 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ddc77-af18-439b-ad93-ab89ffd4db82 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:00.560260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ddc77-af18-439b-ad93-ab89ffd4db82 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:00.560541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ddc77-af18-439b-ad93-ab89ffd4db82 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:00.561406 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ddc77-af18-439b-ad93-ab89ffd4db82 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:00.561716 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ddc77-af18-439b-ad93-ab89ffd4db82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:00.563202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ddc77-af18-439b-ad93-ab89ffd4db82 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:00.564751 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e2ea5-e783-423a-b919-9a1dc4bb89a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:00.565707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e2ea5-e783-423a-b919-9a1dc4bb89a5 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:00.567046 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e2ea5-e783-423a-b919-9a1dc4bb89a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:00.567432 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e2ea5-e783-423a-b919-9a1dc4bb89a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:00.568325 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e2ea5-e783-423a-b919-9a1dc4bb89a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:00.568736 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e2ea5-e783-423a-b919-9a1dc4bb89a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:00.570603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e2ea5-e783-423a-b919-9a1dc4bb89a5 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:00.582110 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 261/527] 10.222.0.13 () {56 vars in 1139 bytes} [Tue Jul 5 21:10:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:00.583412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ddc77-af18-439b-ad93-ab89ffd4db82 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:00.603662 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 267/528] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:10:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:00.603662 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e2ea5-e783-423a-b919-9a1dc4bb89a5 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:00.612077 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:00.678241 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:00.713708 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ddc77-af18-439b-ad93-ab89ffd4db82 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:00.732176 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e2ea5-e783-423a-b919-9a1dc4bb89a5 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:00.762773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95885c13-ec32-4fd9-9d99-954e2be51de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:00.763341 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95885c13-ec32-4fd9-9d99-954e2be51de5 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:00.763616 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95885c13-ec32-4fd9-9d99-954e2be51de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:00.763886 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95885c13-ec32-4fd9-9d99-954e2be51de5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:00.781450 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e08ee-a61e-46c4-90bf-e7b644a9a7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:00.781827 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e08ee-a61e-46c4-90bf-e7b644a9a7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:00.782079 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e08ee-a61e-46c4-90bf-e7b644a9a7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:00.782413 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e08ee-a61e-46c4-90bf-e7b644a9a7d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:00.855452 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e08ee-a61e-46c4-90bf-e7b644a9a7d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:00.857330 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e08ee-a61e-46c4-90bf-e7b644a9a7d1 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:00.868331 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95885c13-ec32-4fd9-9d99-954e2be51de5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:00.870833 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95885c13-ec32-4fd9-9d99-954e2be51de5 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:00.888918 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:00.926677 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:00.987798 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 268/529] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:10:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:10:00.987798 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e08ee-a61e-46c4-90bf-e7b644a9a7d1 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:01.020405 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 262/530] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:10:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:10:01.021865 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95885c13-ec32-4fd9-9d99-954e2be51de5 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:01.124808 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e08ee-a61e-46c4-90bf-e7b644a9a7d1 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:01.141994 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95885c13-ec32-4fd9-9d99-954e2be51de5 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:01.156460 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:01.172591 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf18a3a-2d3b-4329-a36c-481eff85ed3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:01.175368 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf18a3a-2d3b-4329-a36c-481eff85ed3f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:01.175368 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf18a3a-2d3b-4329-a36c-481eff85ed3f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:01.175368 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf18a3a-2d3b-4329-a36c-481eff85ed3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:01.175368 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf18a3a-2d3b-4329-a36c-481eff85ed3f None admin] RBAC: Adding query filter params (role.id=c641ed689379413190e5e4ff94eb90ba, scope.project.id=1076c94b43b2483eb4fc06173f9204c3, user.id=6d59037633db47efa1ed340055bf520a) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:01.176119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf18a3a-2d3b-4329-a36c-481eff85ed3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:01.177498 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf18a3a-2d3b-4329-a36c-481eff85ed3f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:01.185259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 269/531] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:10:00 2022] GET /identity/v3/role_assignments?user.id=6d59037633db47efa1ed340055bf520a&scope.project.id=1076c94b43b2483eb4fc06173f9204c3&role.id=c641ed689379413190e5e4ff94eb90ba => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:01.186017 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7bc38-13a9-4356-887f-de389b500fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:01.186486 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf18a3a-2d3b-4329-a36c-481eff85ed3f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:01.187422 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7bc38-13a9-4356-887f-de389b500fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:01.187921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7bc38-13a9-4356-887f-de389b500fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:01.188386 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7bc38-13a9-4356-887f-de389b500fb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:01.205098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7bc38-13a9-4356-887f-de389b500fb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:01.207917 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7bc38-13a9-4356-887f-de389b500fb9 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:01.244585 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-47c7bc38-13a9-4356-887f-de389b500fb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:01.244585 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:01.244585 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:01.244585 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:01.244585 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:01.244585 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:01.244585 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:01.244585 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:01.244585 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:01.244585 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:01.244585 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:01.244585 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:01.244585 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:01.244585 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:01.244585 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:01.245541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:01.245541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:01.245541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:01.245541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:01.245541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:01.245541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:01.245541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:01.245541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:01.245541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:01.245541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:01.245541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:01.245541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:01.245541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:01.245541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:01.245541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:01.245541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:01.245541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:01.246967 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:01.246967 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:01.246967 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:01.246967 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:01.254835 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 263/532] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:01.261069 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7bc38-13a9-4356-887f-de389b500fb9 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:01.273174 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:01.395659 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7bc38-13a9-4356-887f-de389b500fb9 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:01.444869 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf18a3a-2d3b-4329-a36c-481eff85ed3f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:01.451139 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57d6f9-d414-4c64-852d-bb8c05b80e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:01.452076 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57d6f9-d414-4c64-852d-bb8c05b80e99 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:01.452444 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57d6f9-d414-4c64-852d-bb8c05b80e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:01.452726 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57d6f9-d414-4c64-852d-bb8c05b80e99 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:01.453471 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57d6f9-d414-4c64-852d-bb8c05b80e99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:01.453782 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57d6f9-d414-4c64-852d-bb8c05b80e99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:01.455239 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57d6f9-d414-4c64-852d-bb8c05b80e99 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:01.475047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 264/533] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:01.480949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57d6f9-d414-4c64-852d-bb8c05b80e99 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:01.489385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdddd7-14e6-4e67-9e33-7e2c5ffda884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:01.490550 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdddd7-14e6-4e67-9e33-7e2c5ffda884 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:01.491050 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdddd7-14e6-4e67-9e33-7e2c5ffda884 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:01.491523 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdddd7-14e6-4e67-9e33-7e2c5ffda884 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:01.505042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdddd7-14e6-4e67-9e33-7e2c5ffda884 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:01.506977 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdddd7-14e6-4e67-9e33-7e2c5ffda884 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:01.526988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-8cbdddd7-14e6-4e67-9e33-7e2c5ffda884 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:01.526988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:01.526988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:01.526988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:01.526988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:01.526988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:01.526988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:01.526988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:01.526988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:01.526988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:01.526988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:01.526988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:01.526988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:01.526988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:01.526988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:01.528199 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:01.528199 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:01.528199 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:01.528199 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:01.528199 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:01.528199 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:01.528199 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:01.528199 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:01.528199 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:01.528199 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:01.528199 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:01.528199 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:01.528199 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:01.528199 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:01.528199 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:01.528199 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:01.528199 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:01.529387 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:01.529387 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:01.529387 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:01.529387 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:01.531370 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 270/534] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:01.538570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:01.541239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdddd7-14e6-4e67-9e33-7e2c5ffda884 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:01.692181 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57d6f9-d414-4c64-852d-bb8c05b80e99 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:01.721012 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:01.744586 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdddd7-14e6-4e67-9e33-7e2c5ffda884 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:01.771384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e11682-7e69-4f30-b00e-0b5ea4297ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:01.772199 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e11682-7e69-4f30-b00e-0b5ea4297ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:01.772483 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e11682-7e69-4f30-b00e-0b5ea4297ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:01.772760 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e11682-7e69-4f30-b00e-0b5ea4297ff5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:01.782665 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d08895-d66a-490c-b82c-85865d58281b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:01.783271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d08895-d66a-490c-b82c-85865d58281b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:01.783558 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d08895-d66a-490c-b82c-85865d58281b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:01.783841 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d08895-d66a-490c-b82c-85865d58281b None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:01.784635 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d08895-d66a-490c-b82c-85865d58281b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:01.784953 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d08895-d66a-490c-b82c-85865d58281b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:01.786431 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d08895-d66a-490c-b82c-85865d58281b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:01.787492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e11682-7e69-4f30-b00e-0b5ea4297ff5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:01.788947 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e11682-7e69-4f30-b00e-0b5ea4297ff5 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:01.800080 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 271/535] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:01.805385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d08895-d66a-490c-b82c-85865d58281b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:01.816118 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-22e11682-7e69-4f30-b00e-0b5ea4297ff5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:01.816118 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:01.816118 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:01.816118 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:01.816118 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:01.816118 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:01.816118 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:01.816118 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:01.816118 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:01.816118 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:01.816118 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:01.816118 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:01.816118 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:10:01.816118 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:10:01.816118 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:10:01.817077 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:10:01.817077 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:01.817077 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:01.817077 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:01.817077 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:01.817077 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:01.817077 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:01.817077 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:01.817077 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:01.817077 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:01.817077 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:01.817077 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:01.817077 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:01.817077 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:01.817077 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:01.817077 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:01.817077 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:01.817954 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:10:01.817954 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:10:01.817954 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:10:01.817954 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:10:01.817954 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:10:01.817954 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:10:01.817954 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:01.817954 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:01.823346 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 265/536] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:01.827082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e11682-7e69-4f30-b00e-0b5ea4297ff5 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:01.942046 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:01.955206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e11682-7e69-4f30-b00e-0b5ea4297ff5 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:01.990308 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d08895-d66a-490c-b82c-85865d58281b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:02.015005 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b42cf-e12c-44d2-9afd-777c3b9416c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:02.015934 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b42cf-e12c-44d2-9afd-777c3b9416c9 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:02.016219 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b42cf-e12c-44d2-9afd-777c3b9416c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:02.016494 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b42cf-e12c-44d2-9afd-777c3b9416c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:02.017294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b42cf-e12c-44d2-9afd-777c3b9416c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:02.017605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b42cf-e12c-44d2-9afd-777c3b9416c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:02.019078 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b42cf-e12c-44d2-9afd-777c3b9416c9 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:02.048332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 266/537] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:10:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:02.053887 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b42cf-e12c-44d2-9afd-777c3b9416c9 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:02.065857 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa76fe-b99c-4e16-b455-525f0e36b532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:02.066689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa76fe-b99c-4e16-b455-525f0e36b532 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:02.066968 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa76fe-b99c-4e16-b455-525f0e36b532 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:02.067239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa76fe-b99c-4e16-b455-525f0e36b532 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:02.081496 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa76fe-b99c-4e16-b455-525f0e36b532 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:02.083883 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa76fe-b99c-4e16-b455-525f0e36b532 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:02.087149 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:02.103968 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-d7fa76fe-b99c-4e16-b455-525f0e36b532 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:02.103968 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:02.103968 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:02.103968 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:02.103968 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:02.103968 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:02.103968 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:02.103968 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:02.103968 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:02.103968 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:02.103968 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:02.103968 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:02.103968 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:10:02.103968 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:10:02.103968 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:10:02.106599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:10:02.106599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:02.106599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:02.106599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:02.106599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:02.106599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:02.106599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:02.106599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:02.106599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:02.106599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:02.106599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:02.106599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:02.106599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:02.106599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:02.106599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:02.106599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:02.106599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:02.107545 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:10:02.107545 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:10:02.107545 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:10:02.107545 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:10:02.107545 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:10:02.107545 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:10:02.107545 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:02.107545 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:02.107545 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 272/538] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:02.111187 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a10d99-539d-4a26-a722-2a8d1747f9f8 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:02.111472 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a10d99-539d-4a26-a722-2a8d1747f9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:02.111751 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a10d99-539d-4a26-a722-2a8d1747f9f8 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:02.113078 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 273/539] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:02.115518 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a10d99-539d-4a26-a722-2a8d1747f9f8 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:02.197978 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b42cf-e12c-44d2-9afd-777c3b9416c9 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:02.228597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a10d99-539d-4a26-a722-2a8d1747f9f8 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:02.246284 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da3f95-d76c-4a4d-880b-b05b4eff3506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:02.247529 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da3f95-d76c-4a4d-880b-b05b4eff3506 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:02.247924 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da3f95-d76c-4a4d-880b-b05b4eff3506 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:02.248314 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da3f95-d76c-4a4d-880b-b05b4eff3506 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:02.249260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da3f95-d76c-4a4d-880b-b05b4eff3506 None admin] RBAC: Adding query filter params (role.id=c641ed689379413190e5e4ff94eb90ba, scope.project.id=1076c94b43b2483eb4fc06173f9204c3, user.id=97b6b7c15770400cad4e2b52b13ad354) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:02.249684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da3f95-d76c-4a4d-880b-b05b4eff3506 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:02.252071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da3f95-d76c-4a4d-880b-b05b4eff3506 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:02.260928 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 267/540] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:10:02 2022] GET /identity/v3/role_assignments?user.id=97b6b7c15770400cad4e2b52b13ad354&scope.project.id=1076c94b43b2483eb4fc06173f9204c3&role.id=c641ed689379413190e5e4ff94eb90ba => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:02.262610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57372f6d-2e64-4dd8-8e77-4b8da1682950 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:02.263096 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57372f6d-2e64-4dd8-8e77-4b8da1682950 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:02.263478 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57372f6d-2e64-4dd8-8e77-4b8da1682950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:02.265064 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddd736-d176-4af9-b0fd-aa015e9d80ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:02.265989 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddd736-d176-4af9-b0fd-aa015e9d80ff None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:02.266320 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddd736-d176-4af9-b0fd-aa015e9d80ff None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:02.266654 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddd736-d176-4af9-b0fd-aa015e9d80ff None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:02.267458 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddd736-d176-4af9-b0fd-aa015e9d80ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:02.267819 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddd736-d176-4af9-b0fd-aa015e9d80ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:02.269354 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddd736-d176-4af9-b0fd-aa015e9d80ff None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:02.282499 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:02.286900 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-57372f6d-2e64-4dd8-8e77-4b8da1682950 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:02.288377 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-57372f6d-2e64-4dd8-8e77-4b8da1682950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:02.311334 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 274/541] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:10:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:02.323289 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddd736-d176-4af9-b0fd-aa015e9d80ff None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:02.382872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 268/542] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:10:02.405689 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57372f6d-2e64-4dd8-8e77-4b8da1682950 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:02.471056 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:02.516670 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57372f6d-2e64-4dd8-8e77-4b8da1682950 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:02.518688 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddd736-d176-4af9-b0fd-aa015e9d80ff None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:02.553499 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c8269-7da5-4eb0-8d51-9118c3b62110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:02.554359 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c8269-7da5-4eb0-8d51-9118c3b62110 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:02.554728 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c8269-7da5-4eb0-8d51-9118c3b62110 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:02.555014 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c8269-7da5-4eb0-8d51-9118c3b62110 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:02.574024 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c8269-7da5-4eb0-8d51-9118c3b62110 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:10:02.579573 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:02.581090 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f42592-d5ce-4d5f-891e-64c5c0e9a4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:02.581751 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f42592-d5ce-4d5f-891e-64c5c0e9a4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:02.582038 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f42592-d5ce-4d5f-891e-64c5c0e9a4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:02.582374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f42592-d5ce-4d5f-891e-64c5c0e9a4a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:02.584047 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f42592-d5ce-4d5f-891e-64c5c0e9a4a5 None admin] RBAC: Adding query filter params (role.id=c641ed689379413190e5e4ff94eb90ba, scope.project.id=1076c94b43b2483eb4fc06173f9204c3, user.id=436d7cc587bc4b2a8a3242fc39876ade) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:02.584491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f42592-d5ce-4d5f-891e-64c5c0e9a4a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:02.587780 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f42592-d5ce-4d5f-891e-64c5c0e9a4a5 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:02.591012 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-2f9c8269-7da5-4eb0-8d51-9118c3b62110 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:10:02.591012 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:02.591012 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:02.591012 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:02.591012 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:02.591012 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:02.591012 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:02.591012 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:02.591012 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:02.591012 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:02.591012 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:02.591012 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:02.591012 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:10:02.591012 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:10:02.591012 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:10:02.591012 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:10:02.608577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:10:02.608577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:10:02.608577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:10:02.608577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:10:02.608577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:02.608577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:02.608577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:02.608577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:02.608577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:02.608577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:02.608577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:02.608577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:02.608577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:02.608577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:02.608577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:02.608577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:02.609899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:02.609899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:02.609899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:02.609899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:02.609899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:10:02.609899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:10:02.609899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:10:02.609899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:10:02.609899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:10:02.609899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:10:02.609899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:10:02.609899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:02.609899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 269/543] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 21:10:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:02.611290 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 275/544] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:10:02 2022] GET /identity/v3/role_assignments?user.id=436d7cc587bc4b2a8a3242fc39876ade&scope.project.id=1076c94b43b2483eb4fc06173f9204c3&role.id=c641ed689379413190e5e4ff94eb90ba => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:02.611378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c8269-7da5-4eb0-8d51-9118c3b62110 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:02.720854 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1312158-b260-401a-aebd-032525ceaee9 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:02.721234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1312158-b260-401a-aebd-032525ceaee9 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:02.721433 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1312158-b260-401a-aebd-032525ceaee9 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:02.723179 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 276/545] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:02.733047 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa78a6-6cd8-4be5-bc65-31629c3fd5a3 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:02.733342 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa78a6-6cd8-4be5-bc65-31629c3fd5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:02.733621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa78a6-6cd8-4be5-bc65-31629c3fd5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:02.765410 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e8fa78a6-6cd8-4be5-bc65-31629c3fd5a3 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:02.766939 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e8fa78a6-6cd8-4be5-bc65-31629c3fd5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:02.771150 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c8269-7da5-4eb0-8d51-9118c3b62110 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:02.831836 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862306a-320f-41f8-9362-70decadb01d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:02.832416 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862306a-320f-41f8-9362-70decadb01d4 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:02.832707 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862306a-320f-41f8-9362-70decadb01d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:02.832988 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862306a-320f-41f8-9362-70decadb01d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:02.834367 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862306a-320f-41f8-9362-70decadb01d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:02.834367 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862306a-320f-41f8-9362-70decadb01d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:02.835662 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862306a-320f-41f8-9362-70decadb01d4 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:02.844812 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 270/546] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 21:10:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:02.850269 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862306a-320f-41f8-9362-70decadb01d4 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:02.879606 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 277/547] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:10:02.914098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa78a6-6cd8-4be5-bc65-31629c3fd5a3 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:02.937724 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:02.983837 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862306a-320f-41f8-9362-70decadb01d4 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:03.014239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:03.040677 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26cb85-5b62-4349-836c-c7b1a0e6d32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:03.041481 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26cb85-5b62-4349-836c-c7b1a0e6d32c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:03.041765 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26cb85-5b62-4349-836c-c7b1a0e6d32c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:03.042041 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26cb85-5b62-4349-836c-c7b1a0e6d32c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:03.064961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26cb85-5b62-4349-836c-c7b1a0e6d32c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:03.067647 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26cb85-5b62-4349-836c-c7b1a0e6d32c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:03.072832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa78a6-6cd8-4be5-bc65-31629c3fd5a3 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:03.099794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-9e26cb85-5b62-4349-836c-c7b1a0e6d32c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:03.099794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:03.099794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:03.099794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:03.099794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:03.099794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:03.099794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:03.099794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:03.099794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:03.099794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:03.099794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:03.099794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:03.099794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:03.099794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:03.099794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:03.100773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:03.100773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:03.100773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:03.100773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:03.100773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:03.100773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:03.100773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:03.100773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:03.100773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:03.100773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:03.100773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:03.100773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:03.100773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:03.100773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:03.100773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:03.100773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:03.100773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:03.101633 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:03.101633 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:03.101633 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:03.101633 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:03.109648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 271/548] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:03.110642 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26cb85-5b62-4349-836c-c7b1a0e6d32c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:03.133987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de2c2b-735a-4d2e-9db3-637920de0b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:03.134981 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de2c2b-735a-4d2e-9db3-637920de0b27 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:03.135340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de2c2b-735a-4d2e-9db3-637920de0b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:03.135695 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de2c2b-735a-4d2e-9db3-637920de0b27 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:03.154389 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de2c2b-735a-4d2e-9db3-637920de0b27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:10:03.170408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-34de2c2b-735a-4d2e-9db3-637920de0b27 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:10:03.170408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:03.170408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:03.170408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:03.170408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:03.170408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:03.170408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:03.170408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:03.170408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:03.170408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:03.170408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:03.170408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:03.170408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:10:03.170408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:10:03.170408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:10:03.170408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:10:03.171573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:10:03.171573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:10:03.171573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:10:03.171573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:10:03.171573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:03.171573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:03.171573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:03.171573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:03.171573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:03.171573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:03.171573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:03.171573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:03.171573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:03.171573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:03.171573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:03.171573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:03.172421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:03.172421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:03.172421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:03.172421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:03.172421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:10:03.172421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:10:03.172421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:10:03.172421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:10:03.172421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:10:03.172421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:10:03.172421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:10:03.172421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:03.176492 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 278/549] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 21:10:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:03.180308 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de2c2b-735a-4d2e-9db3-637920de0b27 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:03.277069 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26cb85-5b62-4349-836c-c7b1a0e6d32c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:03.292169 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:03.336027 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32391bb6-6c5f-4d86-aef9-55723a16dbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:03.336690 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32391bb6-6c5f-4d86-aef9-55723a16dbd8 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:03.336974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32391bb6-6c5f-4d86-aef9-55723a16dbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:03.337252 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32391bb6-6c5f-4d86-aef9-55723a16dbd8 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:03.337981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32391bb6-6c5f-4d86-aef9-55723a16dbd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:03.338314 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32391bb6-6c5f-4d86-aef9-55723a16dbd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:03.339686 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32391bb6-6c5f-4d86-aef9-55723a16dbd8 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:03.362618 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 272/550] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:03.368380 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32391bb6-6c5f-4d86-aef9-55723a16dbd8 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:03.385766 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de2c2b-735a-4d2e-9db3-637920de0b27 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:03.426466 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:03.493582 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32391bb6-6c5f-4d86-aef9-55723a16dbd8 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:03.523434 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e28261-f2d5-416d-a466-7ccc247f4bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:03.524127 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e28261-f2d5-416d-a466-7ccc247f4bad None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:03.524417 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e28261-f2d5-416d-a466-7ccc247f4bad None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:03.524698 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e28261-f2d5-416d-a466-7ccc247f4bad None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:03.525466 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e28261-f2d5-416d-a466-7ccc247f4bad None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:03.525778 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e28261-f2d5-416d-a466-7ccc247f4bad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:03.527349 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e28261-f2d5-416d-a466-7ccc247f4bad None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:03.530100 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6474df-1bf5-459c-bcf0-ede0108289a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:03.530933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6474df-1bf5-459c-bcf0-ede0108289a7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:03.531211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6474df-1bf5-459c-bcf0-ede0108289a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:03.531493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6474df-1bf5-459c-bcf0-ede0108289a7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:03.539368 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6474df-1bf5-459c-bcf0-ede0108289a7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:03.540832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6474df-1bf5-459c-bcf0-ede0108289a7 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:03.557206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-ac6474df-1bf5-459c-bcf0-ede0108289a7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:10:03.557206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:03.557206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:03.557206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:03.557206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:03.557206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:03.557206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:03.557206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:03.557206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:03.557206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:03.557206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:03.557206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:03.557206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:10:03.557206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:10:03.557206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:10:03.557206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:10:03.558202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:03.558202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:03.558202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:10:03.558202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:03.558202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:10:03.558202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:03.558202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:03.558202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:03.558202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:03.558202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:03.558202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:03.558202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:03.558202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:03.558202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:03.558202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:03.558202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:03.558202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:03.558202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:03.559674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:03.559674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:03.559674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:10:03.559674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:10:03.559674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:10:03.559674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:10:03.559674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:10:03.559674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:10:03.559674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:10:03.559674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:03.559674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 273/551] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:10:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:03.561162 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 279/552] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 21:10:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:03.567146 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6474df-1bf5-459c-bcf0-ede0108289a7 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:03.568383 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e28261-f2d5-416d-a466-7ccc247f4bad None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:03.604239 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:03.693144 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6474df-1bf5-459c-bcf0-ede0108289a7 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:03.734667 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d92f8d-737a-4227-96b9-657d9fd50be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:03.735971 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d92f8d-737a-4227-96b9-657d9fd50be9 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:03.736268 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d92f8d-737a-4227-96b9-657d9fd50be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:03.736550 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d92f8d-737a-4227-96b9-657d9fd50be9 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:03.737526 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d92f8d-737a-4227-96b9-657d9fd50be9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:03.737984 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d92f8d-737a-4227-96b9-657d9fd50be9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:03.742141 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d92f8d-737a-4227-96b9-657d9fd50be9 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:03.765043 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 274/553] 10.222.0.13 () {56 vars in 1135 bytes} [Tue Jul 5 21:10:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:03.768301 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d92f8d-737a-4227-96b9-657d9fd50be9 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:03.809105 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e28261-f2d5-416d-a466-7ccc247f4bad None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:03.851580 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152c7c8-a800-4bd9-8d39-ba4c63d560a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:03.853587 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152c7c8-a800-4bd9-8d39-ba4c63d560a1 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:03.854082 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152c7c8-a800-4bd9-8d39-ba4c63d560a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:03.854871 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152c7c8-a800-4bd9-8d39-ba4c63d560a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:03.868160 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152c7c8-a800-4bd9-8d39-ba4c63d560a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:03.870864 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152c7c8-a800-4bd9-8d39-ba4c63d560a1 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:03.876648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:03.891744 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d92f8d-737a-4227-96b9-657d9fd50be9 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:03.895096 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-2152c7c8-a800-4bd9-8d39-ba4c63d560a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:03.895096 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:03.895096 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:03.895096 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:03.895096 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:03.895096 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:03.895096 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:03.895096 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:03.895096 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:03.895096 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:03.895096 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:03.895096 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:03.895096 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:03.895096 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:03.895096 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:03.906780 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:03.906780 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:03.906780 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:03.906780 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:03.906780 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:03.906780 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:03.906780 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:03.906780 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:03.906780 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:03.906780 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:03.906780 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:03.906780 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:03.906780 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:03.906780 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:03.906780 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:03.906780 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:03.906780 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:03.907681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:03.907681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:03.907681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:03.907681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:03.907681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 280/554] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:03.907681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5621a4f-3810-4898-a021-f4e077a5e189 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:03.907681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5621a4f-3810-4898-a021-f4e077a5e189 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:03.907681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5621a4f-3810-4898-a021-f4e077a5e189 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:03.907681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 281/555] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:03.911138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5621a4f-3810-4898-a021-f4e077a5e189 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:03.940910 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517f1b4-8922-45e0-a882-2bf76c23fb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:03.941593 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517f1b4-8922-45e0-a882-2bf76c23fb51 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:03.941882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517f1b4-8922-45e0-a882-2bf76c23fb51 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:03.942204 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517f1b4-8922-45e0-a882-2bf76c23fb51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:03.946612 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:04.036293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517f1b4-8922-45e0-a882-2bf76c23fb51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:04.038593 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517f1b4-8922-45e0-a882-2bf76c23fb51 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:04.048137 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5621a4f-3810-4898-a021-f4e077a5e189 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:04.095960 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8dd601-4ca6-4660-8af8-f07e6facc1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:04.096696 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dd601-4ca6-4660-8af8-f07e6facc1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:04.097052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dd601-4ca6-4660-8af8-f07e6facc1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:04.097405 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dd601-4ca6-4660-8af8-f07e6facc1f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:04.098241 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dd601-4ca6-4660-8af8-f07e6facc1f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:04.098624 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dd601-4ca6-4660-8af8-f07e6facc1f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:04.100295 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dd601-4ca6-4660-8af8-f07e6facc1f0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:04.115563 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 282/556] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:04.117185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fea948-4952-4ac8-92c5-04993cdac6ed None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:04.117549 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fea948-4952-4ac8-92c5-04993cdac6ed None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:04.117919 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fea948-4952-4ac8-92c5-04993cdac6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:04.137379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-39fea948-4952-4ac8-92c5-04993cdac6ed None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:04.139137 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-39fea948-4952-4ac8-92c5-04993cdac6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:04.145722 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:04.159650 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 275/557] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:10:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:10:04.160527 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517f1b4-8922-45e0-a882-2bf76c23fb51 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:04.216772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 283/558] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:10:04.217937 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fea948-4952-4ac8-92c5-04993cdac6ed None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:04.236992 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:04.273982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517f1b4-8922-45e0-a882-2bf76c23fb51 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:04.308292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa05c1f-69ab-4ab6-9da5-6d3da939f202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:04.309801 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa05c1f-69ab-4ab6-9da5-6d3da939f202 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:04.310090 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa05c1f-69ab-4ab6-9da5-6d3da939f202 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:04.310394 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa05c1f-69ab-4ab6-9da5-6d3da939f202 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:04.318579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa05c1f-69ab-4ab6-9da5-6d3da939f202 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:04.320026 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa05c1f-69ab-4ab6-9da5-6d3da939f202 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:04.333486 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fea948-4952-4ac8-92c5-04993cdac6ed None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:04.335451 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-caa05c1f-69ab-4ab6-9da5-6d3da939f202 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:10:04.335451 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:04.335451 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:04.335451 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:04.335451 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:04.335451 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:04.335451 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:04.335451 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:04.335451 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:04.335451 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:04.335451 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:04.335451 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:04.335451 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:10:04.335451 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:10:04.335451 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:10:04.335451 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:10:04.336467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:04.336467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:04.336467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:10:04.336467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:04.336467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:10:04.336467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:04.336467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:04.336467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:04.336467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:04.336467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:04.336467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:04.336467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:04.336467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:04.336467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:04.336467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:04.336467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:04.336467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:04.336467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:04.337471 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:04.337471 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:04.337471 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:10:04.337471 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:10:04.337471 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:10:04.337471 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:10:04.337471 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:10:04.337471 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:10:04.337471 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:10:04.337471 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:04.341525 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 276/559] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Jul 5 21:10:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:04.342427 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa05c1f-69ab-4ab6-9da5-6d3da939f202 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:04.377746 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9420d-7bbf-4012-8957-43eb43beb631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:04.380061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9420d-7bbf-4012-8957-43eb43beb631 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:04.380581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9420d-7bbf-4012-8957-43eb43beb631 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:04.381068 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9420d-7bbf-4012-8957-43eb43beb631 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:04.394697 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:04.397834 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9420d-7bbf-4012-8957-43eb43beb631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:04.400741 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9420d-7bbf-4012-8957-43eb43beb631 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:04.422284 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-89b9420d-7bbf-4012-8957-43eb43beb631 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:04.422284 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:04.422284 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:04.422284 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:04.422284 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:04.422284 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:04.422284 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:04.422284 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:04.422284 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:04.422284 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:04.422284 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:04.422284 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:04.422284 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:04.422284 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:04.422284 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:04.423362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:04.423362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:04.423362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:04.423362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:04.423362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:04.423362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:04.423362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:04.423362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:04.423362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:04.423362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:04.423362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:04.423362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:04.423362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:04.423362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:04.423362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:04.423362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:04.423362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:04.424328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:04.424328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:04.424328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:04.424328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:04.424328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 284/560] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:04.424328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9420d-7bbf-4012-8957-43eb43beb631 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:04.470335 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa05c1f-69ab-4ab6-9da5-6d3da939f202 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:04.500200 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:04.520445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420a672-b52c-4622-9a47-0b15d3328e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:04.521598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420a672-b52c-4622-9a47-0b15d3328e78 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:04.522138 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420a672-b52c-4622-9a47-0b15d3328e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:04.522643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420a672-b52c-4622-9a47-0b15d3328e78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:04.536273 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9420d-7bbf-4012-8957-43eb43beb631 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:04.538429 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420a672-b52c-4622-9a47-0b15d3328e78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:10:04.549949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-a420a672-b52c-4622-9a47-0b15d3328e78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:10:04.549949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:04.549949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:04.549949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:04.549949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:04.549949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:04.549949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:04.549949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:04.549949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:04.549949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:04.549949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:04.549949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:04.549949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:10:04.549949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:10:04.549949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:10:04.549949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:10:04.550981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:10:04.550981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:10:04.550981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:10:04.550981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:10:04.550981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:04.550981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:04.550981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:04.550981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:04.550981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:04.550981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:04.550981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:04.550981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:04.550981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:04.550981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:04.550981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:04.550981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:04.551912 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:04.551912 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:04.551912 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:04.551912 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:04.551912 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:10:04.551912 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:10:04.551912 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:10:04.551912 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:10:04.551912 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:10:04.551912 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:10:04.551912 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:10:04.551912 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:04.555490 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 277/561] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 21:10:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:04.556508 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420a672-b52c-4622-9a47-0b15d3328e78 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:04.600210 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8e558-e76f-4fc7-a419-5c026b9af51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:04.601426 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8e558-e76f-4fc7-a419-5c026b9af51b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:04.602388 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8e558-e76f-4fc7-a419-5c026b9af51b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:04.602946 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8e558-e76f-4fc7-a419-5c026b9af51b None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:04.604112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8e558-e76f-4fc7-a419-5c026b9af51b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:04.604628 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8e558-e76f-4fc7-a419-5c026b9af51b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:04.608158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8e558-e76f-4fc7-a419-5c026b9af51b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:04.633512 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 285/562] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Jul 5 21:10:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:04.634755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8e558-e76f-4fc7-a419-5c026b9af51b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:04.684355 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420a672-b52c-4622-9a47-0b15d3328e78 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:04.694045 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:04.720729 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d087f-c516-42dd-aedc-60fa75862d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:04.721315 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d087f-c516-42dd-aedc-60fa75862d81 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:04.721604 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d087f-c516-42dd-aedc-60fa75862d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:04.721937 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d087f-c516-42dd-aedc-60fa75862d81 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:04.722706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d087f-c516-42dd-aedc-60fa75862d81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:04.723017 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d087f-c516-42dd-aedc-60fa75862d81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:04.724398 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d087f-c516-42dd-aedc-60fa75862d81 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:04.738583 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 278/563] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:04.739461 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d087f-c516-42dd-aedc-60fa75862d81 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:04.745267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8e558-e76f-4fc7-a419-5c026b9af51b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:04.774227 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:04.782392 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c0ec4-cafa-41cf-9f2a-3376bb404054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:04.783058 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c0ec4-cafa-41cf-9f2a-3376bb404054 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:04.783343 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c0ec4-cafa-41cf-9f2a-3376bb404054 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:04.783626 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c0ec4-cafa-41cf-9f2a-3376bb404054 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:04.784368 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c0ec4-cafa-41cf-9f2a-3376bb404054 None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:04.788398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c0ec4-cafa-41cf-9f2a-3376bb404054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:04.788398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c0ec4-cafa-41cf-9f2a-3376bb404054 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:04.800623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 286/564] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 21:10:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:04.801767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d389bfd-08c9-4e0f-9bb0-1e6f3992ba71 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:04.802061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d389bfd-08c9-4e0f-9bb0-1e6f3992ba71 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:04.802373 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d389bfd-08c9-4e0f-9bb0-1e6f3992ba71 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:04.807617 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 287/565] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:04.808368 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d389bfd-08c9-4e0f-9bb0-1e6f3992ba71 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:04.859796 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d087f-c516-42dd-aedc-60fa75862d81 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:04.895471 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a1034-13bf-4bdd-8fb1-bda6abd0074b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:04.896271 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a1034-13bf-4bdd-8fb1-bda6abd0074b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:04.896556 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a1034-13bf-4bdd-8fb1-bda6abd0074b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:04.896841 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a1034-13bf-4bdd-8fb1-bda6abd0074b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:04.907756 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a1034-13bf-4bdd-8fb1-bda6abd0074b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:04.909220 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a1034-13bf-4bdd-8fb1-bda6abd0074b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:04.921290 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d389bfd-08c9-4e0f-9bb0-1e6f3992ba71 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:04.927507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-3e3a1034-13bf-4bdd-8fb1-bda6abd0074b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:04.927507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:04.927507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:04.927507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:04.927507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:04.927507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:04.927507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:04.927507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:04.927507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:04.927507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:04.927507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:04.927507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:04.927507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:04.927507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:04.927507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:04.928547 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:04.928547 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:04.928547 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:04.928547 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:04.928547 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:04.928547 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:04.928547 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:04.928547 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:04.928547 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:04.928547 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:04.928547 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:04.928547 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:04.928547 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:04.928547 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:04.928547 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:04.928547 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:04.928547 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:04.929498 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:04.929498 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:04.929498 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:04.929498 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:04.929498 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 279/566] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:04.929498 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a1034-13bf-4bdd-8fb1-bda6abd0074b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:04.955080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:04.959108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63838c-aff4-4c40-9434-08a294fcec3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:04.959907 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63838c-aff4-4c40-9434-08a294fcec3f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:04.960195 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63838c-aff4-4c40-9434-08a294fcec3f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:04.960469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63838c-aff4-4c40-9434-08a294fcec3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:04.967311 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63838c-aff4-4c40-9434-08a294fcec3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:04.968769 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63838c-aff4-4c40-9434-08a294fcec3f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:04.983761 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-6a63838c-aff4-4c40-9434-08a294fcec3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:04.983761 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:04.983761 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:04.983761 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:04.983761 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:04.983761 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:04.983761 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:04.983761 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:04.983761 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:04.983761 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:04.983761 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:04.983761 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:04.983761 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:10:04.983761 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:10:04.983761 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:10:04.984783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:10:04.984783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:04.984783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:04.984783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:04.984783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:04.984783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:04.984783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:04.984783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:04.984783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:04.984783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:04.984783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:04.984783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:04.984783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:04.984783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:04.984783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:04.984783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:04.984783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:04.985810 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:10:04.985810 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:10:04.985810 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:10:04.985810 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:10:04.985810 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:10:04.985810 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:10:04.985810 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:04.985810 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:04.985810 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 288/567] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:04.986565 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b575f-813d-46b7-8378-c7880197e9e6 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:04.986565 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b575f-813d-46b7-8378-c7880197e9e6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:04.986565 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b575f-813d-46b7-8378-c7880197e9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:05.002972 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-149b575f-813d-46b7-8378-c7880197e9e6 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:05.004165 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-149b575f-813d-46b7-8378-c7880197e9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:05.038205 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a1034-13bf-4bdd-8fb1-bda6abd0074b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:05.047096 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:05.070101 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 289/568] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:10:05.071550 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4c755-d6b0-4ab3-9b51-01f08fd5be73 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:05.071843 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4c755-d6b0-4ab3-9b51-01f08fd5be73 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:05.072119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4c755-d6b0-4ab3-9b51-01f08fd5be73 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:05.072219 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd88218-a88b-4764-9575-a726c398689a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:05.072899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd88218-a88b-4764-9575-a726c398689a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:05.073180 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd88218-a88b-4764-9575-a726c398689a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:05.074168 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd88218-a88b-4764-9575-a726c398689a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:05.074311 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 290/569] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:05.075053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4c755-d6b0-4ab3-9b51-01f08fd5be73 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:05.089482 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd88218-a88b-4764-9575-a726c398689a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:05.091486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd88218-a88b-4764-9575-a726c398689a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:05.109381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-fdd88218-a88b-4764-9575-a726c398689a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:05.109381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:05.109381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:05.109381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:05.109381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:05.109381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:05.109381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:05.109381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:05.109381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:05.109381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:05.109381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:05.109381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:05.109381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:05.109381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:05.109381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:05.110376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:05.110376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:05.110376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:05.110376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:05.110376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:05.110376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:05.110376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:05.110376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:05.110376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:05.110376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:05.110376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:05.110376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:05.110376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:05.110376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:05.110376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:05.110376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:05.110376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:05.111294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:05.111294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:05.111294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:05.111294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:05.111294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 280/570] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:05.111675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd88218-a88b-4764-9575-a726c398689a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:05.177956 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4c755-d6b0-4ab3-9b51-01f08fd5be73 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:05.180458 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:05.210558 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd88218-a88b-4764-9575-a726c398689a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:05.211993 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4cc9d-9698-44b7-9ddf-9800e1838519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:05.212655 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4cc9d-9698-44b7-9ddf-9800e1838519 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:05.212938 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4cc9d-9698-44b7-9ddf-9800e1838519 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:05.213214 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4cc9d-9698-44b7-9ddf-9800e1838519 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:05.213924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4cc9d-9698-44b7-9ddf-9800e1838519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:05.214258 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4cc9d-9698-44b7-9ddf-9800e1838519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:05.215780 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4cc9d-9698-44b7-9ddf-9800e1838519 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:05.227168 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 291/571] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:05.228343 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9da83-dc8a-4f4c-8629-fbc01ea290d5 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:05.228631 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9da83-dc8a-4f4c-8629-fbc01ea290d5 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:05.228907 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9da83-dc8a-4f4c-8629-fbc01ea290d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:05.244440 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f0d9da83-dc8a-4f4c-8629-fbc01ea290d5 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:05.245553 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f0d9da83-dc8a-4f4c-8629-fbc01ea290d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:05.249468 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703af20-0ce1-4020-b0d9-3c4b3a16e0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:05.250136 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703af20-0ce1-4020-b0d9-3c4b3a16e0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:05.250430 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703af20-0ce1-4020-b0d9-3c4b3a16e0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:05.250702 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703af20-0ce1-4020-b0d9-3c4b3a16e0e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:05.251485 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703af20-0ce1-4020-b0d9-3c4b3a16e0e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:05.251786 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703af20-0ce1-4020-b0d9-3c4b3a16e0e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:05.253209 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703af20-0ce1-4020-b0d9-3c4b3a16e0e5 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:05.265276 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 281/572] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:10:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:05.266368 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703af20-0ce1-4020-b0d9-3c4b3a16e0e5 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:05.275707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:05.312137 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 292/573] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:10:05.312953 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9da83-dc8a-4f4c-8629-fbc01ea290d5 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:05.371330 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703af20-0ce1-4020-b0d9-3c4b3a16e0e5 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:05.400358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:05.406303 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c849e1b-a8b9-4300-921e-3d56f98f3460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:05.407164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c849e1b-a8b9-4300-921e-3d56f98f3460 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:05.407471 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c849e1b-a8b9-4300-921e-3d56f98f3460 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:05.407749 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c849e1b-a8b9-4300-921e-3d56f98f3460 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:05.411329 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9da83-dc8a-4f4c-8629-fbc01ea290d5 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:05.418067 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c849e1b-a8b9-4300-921e-3d56f98f3460 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:10:05.425819 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-1c849e1b-a8b9-4300-921e-3d56f98f3460 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:10:05.425819 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:05.425819 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:05.425819 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:05.425819 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:05.425819 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:05.425819 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:05.425819 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:05.425819 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:05.425819 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:05.425819 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:05.425819 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:05.425819 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:10:05.425819 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:10:05.425819 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:10:05.425819 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:10:05.426981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:10:05.426981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:10:05.426981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:10:05.426981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:10:05.426981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:05.426981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:05.426981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:05.426981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:05.426981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:05.426981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:05.426981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:05.426981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:05.426981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:05.426981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:05.426981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:05.426981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:05.427870 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:05.427870 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:05.427870 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:05.427870 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:05.427870 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:10:05.427870 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:10:05.427870 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:10:05.427870 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:10:05.427870 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:10:05.427870 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:10:05.427870 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:10:05.427870 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:05.427870 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 282/574] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 21:10:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:05.427870 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c849e1b-a8b9-4300-921e-3d56f98f3460 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:05.447536 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84288b66-5616-4e07-8117-b601c3d2f01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:05.448204 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84288b66-5616-4e07-8117-b601c3d2f01b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:05.448487 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84288b66-5616-4e07-8117-b601c3d2f01b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:05.448766 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84288b66-5616-4e07-8117-b601c3d2f01b None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:05.450022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84288b66-5616-4e07-8117-b601c3d2f01b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:05.450464 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84288b66-5616-4e07-8117-b601c3d2f01b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:05.451841 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84288b66-5616-4e07-8117-b601c3d2f01b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:05.463123 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 293/575] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:05.463913 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84288b66-5616-4e07-8117-b601c3d2f01b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:05.491212 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:05.530164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c849e1b-a8b9-4300-921e-3d56f98f3460 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:05.560614 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84288b66-5616-4e07-8117-b601c3d2f01b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:05.564093 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf012e-3945-4bf8-a93a-88b23da1bfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:05.564876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf012e-3945-4bf8-a93a-88b23da1bfab None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:05.565161 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf012e-3945-4bf8-a93a-88b23da1bfab None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:05.565437 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf012e-3945-4bf8-a93a-88b23da1bfab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:05.572005 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf012e-3945-4bf8-a93a-88b23da1bfab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:05.573449 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf012e-3945-4bf8-a93a-88b23da1bfab None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:05.587839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-0caf012e-3945-4bf8-a93a-88b23da1bfab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:05.587839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:05.587839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:05.587839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:05.587839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:05.587839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:05.587839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:05.587839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:05.587839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:05.587839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:05.587839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:05.587839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:05.587839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:10:05.587839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:10:05.587839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:10:05.588753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:10:05.588753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:05.588753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:05.588753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:05.588753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:05.588753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:05.588753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:05.588753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:05.588753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:05.588753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:05.588753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:05.588753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:05.588753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:05.588753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:05.588753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:05.588753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:05.588753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:05.589706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:10:05.589706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:10:05.589706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:10:05.589706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:10:05.589706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:10:05.589706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:10:05.589706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:05.589706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:05.589706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 283/576] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:05.591318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf012e-3945-4bf8-a93a-88b23da1bfab None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:05.599331 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6d076-eb3d-4218-8117-49860780ba86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:05.599974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6d076-eb3d-4218-8117-49860780ba86 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:05.600257 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6d076-eb3d-4218-8117-49860780ba86 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:05.600534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6d076-eb3d-4218-8117-49860780ba86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:05.601395 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6d076-eb3d-4218-8117-49860780ba86 None admin] RBAC: Adding query filter params (role.id=c641ed689379413190e5e4ff94eb90ba, scope.project.id=1076c94b43b2483eb4fc06173f9204c3, user.id=441be62a077444b9b9f78714e24a760a) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:05.601707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6d076-eb3d-4218-8117-49860780ba86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:05.603190 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6d076-eb3d-4218-8117-49860780ba86 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:05.608986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 294/577] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:10:05 2022] GET /identity/v3/role_assignments?user.id=441be62a077444b9b9f78714e24a760a&scope.project.id=1076c94b43b2483eb4fc06173f9204c3&role.id=c641ed689379413190e5e4ff94eb90ba => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:05.609771 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6d076-eb3d-4218-8117-49860780ba86 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:05.662472 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:05.714062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf012e-3945-4bf8-a93a-88b23da1bfab None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:05.750261 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:05.759515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6d076-eb3d-4218-8117-49860780ba86 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:05.763386 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb750f8-5484-4132-a0c8-ee540202beb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:05.764704 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb750f8-5484-4132-a0c8-ee540202beb8 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:05.764704 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb750f8-5484-4132-a0c8-ee540202beb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:05.764704 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb750f8-5484-4132-a0c8-ee540202beb8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:05.776150 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb750f8-5484-4132-a0c8-ee540202beb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:10:05.784237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-fdb750f8-5484-4132-a0c8-ee540202beb8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:10:05.784237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:05.784237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:05.784237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:05.784237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:05.784237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:05.784237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:05.784237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:05.784237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:05.784237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:05.784237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:05.784237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:05.784237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:10:05.784237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:10:05.784237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:10:05.784237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:10:05.785272 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:10:05.785272 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:10:05.785272 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:10:05.785272 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:10:05.785272 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:05.785272 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:05.785272 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:05.785272 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:05.785272 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:05.785272 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:05.785272 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:05.785272 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:05.785272 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:05.785272 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:05.785272 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:05.785272 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:05.786165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:05.786165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:05.786165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:05.786165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:05.786165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:10:05.786165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:10:05.786165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:10:05.786165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:10:05.786165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:10:05.786165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:10:05.786165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:10:05.786165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:05.786165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 284/578] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 21:10:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:05.786905 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb750f8-5484-4132-a0c8-ee540202beb8 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:05.804329 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5625f-7700-4225-9711-e9d290bc4704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:05.805003 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5625f-7700-4225-9711-e9d290bc4704 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:05.805287 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5625f-7700-4225-9711-e9d290bc4704 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:05.805564 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5625f-7700-4225-9711-e9d290bc4704 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:05.806364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5625f-7700-4225-9711-e9d290bc4704 None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:05.806670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5625f-7700-4225-9711-e9d290bc4704 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:05.808039 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5625f-7700-4225-9711-e9d290bc4704 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:05.821120 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 295/579] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 21:10:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:05.821120 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5625f-7700-4225-9711-e9d290bc4704 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:05.902841 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb750f8-5484-4132-a0c8-ee540202beb8 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:05.915755 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:05.924960 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5625f-7700-4225-9711-e9d290bc4704 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:05.939366 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79549b0e-600b-4737-915a-e4ab1e258b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:05.940223 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79549b0e-600b-4737-915a-e4ab1e258b4c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:05.940510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79549b0e-600b-4737-915a-e4ab1e258b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:05.940796 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79549b0e-600b-4737-915a-e4ab1e258b4c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:05.949542 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79549b0e-600b-4737-915a-e4ab1e258b4c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:05.951068 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79549b0e-600b-4737-915a-e4ab1e258b4c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:05.962239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb2d4f-4aca-42f9-bcfe-da147d345252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:05.962898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb2d4f-4aca-42f9-bcfe-da147d345252 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:05.963183 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb2d4f-4aca-42f9-bcfe-da147d345252 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:05.963458 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb2d4f-4aca-42f9-bcfe-da147d345252 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:05.964240 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb2d4f-4aca-42f9-bcfe-da147d345252 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:05.964578 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb2d4f-4aca-42f9-bcfe-da147d345252 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:05.966074 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb2d4f-4aca-42f9-bcfe-da147d345252 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:05.966543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-79549b0e-600b-4737-915a-e4ab1e258b4c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:10:05.966543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:05.966543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:05.966543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:05.966543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:05.966543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:05.966543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:05.966543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:05.966543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:05.966543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:05.966543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:05.966543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:05.966543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:10:05.966543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:10:05.966543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:10:05.966543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:10:05.967500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:05.967500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:05.967500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:10:05.967500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:05.967500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:10:05.967500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:05.967500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:05.967500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:05.967500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:05.967500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:05.967500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:05.967500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:05.967500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:05.967500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:05.967500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:05.967500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:05.967500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:05.967500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:05.968595 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:05.968595 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:05.968595 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:10:05.968595 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:10:05.968595 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:10:05.968595 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:10:05.968595 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:10:05.968595 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:10:05.968595 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:10:05.968595 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:05.968595 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 285/580] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:10:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:05.968595 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79549b0e-600b-4737-915a-e4ab1e258b4c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:05.984067 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 296/581] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:10:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:05.987327 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb2d4f-4aca-42f9-bcfe-da147d345252 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:06.009027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:06.078743 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79549b0e-600b-4737-915a-e4ab1e258b4c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:06.110595 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb2d4f-4aca-42f9-bcfe-da147d345252 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:06.115980 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab74f7-7117-4591-884e-0a09e780ed92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:06.116654 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab74f7-7117-4591-884e-0a09e780ed92 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:06.116940 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab74f7-7117-4591-884e-0a09e780ed92 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:06.117217 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab74f7-7117-4591-884e-0a09e780ed92 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:06.118092 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab74f7-7117-4591-884e-0a09e780ed92 None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:06.118429 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab74f7-7117-4591-884e-0a09e780ed92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:06.119918 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab74f7-7117-4591-884e-0a09e780ed92 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:06.134259 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 286/582] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 21:10:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:06.134259 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab74f7-7117-4591-884e-0a09e780ed92 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:06.150466 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b34d9-a64e-44d1-822a-058737b6dd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:06.151279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b34d9-a64e-44d1-822a-058737b6dd1e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:06.151564 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b34d9-a64e-44d1-822a-058737b6dd1e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:06.151841 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b34d9-a64e-44d1-822a-058737b6dd1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:06.162425 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b34d9-a64e-44d1-822a-058737b6dd1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:06.163871 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b34d9-a64e-44d1-822a-058737b6dd1e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:06.170864 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:06.184400 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-fe7b34d9-a64e-44d1-822a-058737b6dd1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:06.184400 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:06.184400 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:06.184400 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:06.184400 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:06.184400 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:06.184400 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:06.184400 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:06.184400 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:06.184400 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:06.184400 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:06.184400 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:06.184400 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:06.184400 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:06.184400 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:06.185317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:06.185317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:06.185317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:06.185317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:06.185317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:06.185317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:06.185317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:06.185317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:06.185317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:06.185317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:06.185317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:06.185317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:06.185317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:06.185317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:06.185317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:06.185317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:06.185317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:06.186976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:06.186976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:06.186976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:06.186976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:06.186976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 297/583] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:06.186976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b34d9-a64e-44d1-822a-058737b6dd1e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:06.247588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab74f7-7117-4591-884e-0a09e780ed92 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:06.255055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:06.285463 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10baac-7a4f-480b-998d-66b652e554ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:06.286160 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10baac-7a4f-480b-998d-66b652e554ad None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:06.286703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10baac-7a4f-480b-998d-66b652e554ad None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:06.286703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10baac-7a4f-480b-998d-66b652e554ad None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:06.287552 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10baac-7a4f-480b-998d-66b652e554ad None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:06.287861 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10baac-7a4f-480b-998d-66b652e554ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:06.289294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10baac-7a4f-480b-998d-66b652e554ad None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:06.293462 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b34d9-a64e-44d1-822a-058737b6dd1e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:06.308150 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 287/584] 10.222.0.13 () {56 vars in 1137 bytes} [Tue Jul 5 21:10:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:06.309682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10baac-7a4f-480b-998d-66b652e554ad None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:06.333547 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d75341-33ab-4113-89fa-556aadf3951e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:06.334448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d75341-33ab-4113-89fa-556aadf3951e None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:06.334736 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d75341-33ab-4113-89fa-556aadf3951e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:06.335015 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d75341-33ab-4113-89fa-556aadf3951e None admin] PATH_INFO: `/v3/projects/1076c94b43b2483eb4fc06173f9204c3/users/910cd341df8943f18af2765e2a30b238/roles/c641ed689379413190e5e4ff94eb90ba` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:06.350279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d75341-33ab-4113-89fa-556aadf3951e None admin] RBAC: Authorizing `identity:create_grant(project_id=1076c94b43b2483eb4fc06173f9204c3, user_id=910cd341df8943f18af2765e2a30b238, role_id=c641ed689379413190e5e4ff94eb90ba)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:06.351739 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d75341-33ab-4113-89fa-556aadf3951e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:06.403229 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:06.411804 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10baac-7a4f-480b-998d-66b652e554ad None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:06.435074 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 298/585] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 21:10:06 2022] PUT /identity/v3/projects/1076c94b43b2483eb4fc06173f9204c3/users/910cd341df8943f18af2765e2a30b238/roles/c641ed689379413190e5e4ff94eb90ba => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:10:06.447546 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d75341-33ab-4113-89fa-556aadf3951e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:06.448576 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550c622-19df-44ab-a7b7-828fea2119fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:06.449684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550c622-19df-44ab-a7b7-828fea2119fa None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:06.450207 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550c622-19df-44ab-a7b7-828fea2119fa None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:06.450994 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550c622-19df-44ab-a7b7-828fea2119fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:06.464322 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550c622-19df-44ab-a7b7-828fea2119fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:06.466654 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550c622-19df-44ab-a7b7-828fea2119fa None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:06.487195 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-3550c622-19df-44ab-a7b7-828fea2119fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:06.487195 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:06.487195 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:06.487195 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:06.487195 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:06.487195 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:06.487195 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:06.487195 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:06.487195 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:06.487195 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:06.487195 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:06.487195 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:06.487195 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:06.487195 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:06.487195 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:06.488211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:06.488211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:06.488211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:06.488211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:06.488211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:06.488211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:06.488211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:06.488211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:06.488211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:06.488211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:06.488211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:06.488211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:06.488211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:06.488211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:06.488211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:06.488211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:06.488211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:06.489125 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:06.489125 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:06.489125 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:06.489125 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:06.489125 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 288/586] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:06.489401 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550c622-19df-44ab-a7b7-828fea2119fa None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:06.602550 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d75341-33ab-4113-89fa-556aadf3951e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:06.626976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:06.648351 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42fe8c-f928-414a-908c-79fc500dfd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:06.649023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42fe8c-f928-414a-908c-79fc500dfd36 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:06.649345 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42fe8c-f928-414a-908c-79fc500dfd36 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:06.649604 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42fe8c-f928-414a-908c-79fc500dfd36 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:06.650936 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42fe8c-f928-414a-908c-79fc500dfd36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:06.651261 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42fe8c-f928-414a-908c-79fc500dfd36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:06.652724 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42fe8c-f928-414a-908c-79fc500dfd36 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:06.653708 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550c622-19df-44ab-a7b7-828fea2119fa None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:06.670085 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 299/587] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:06.671072 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42fe8c-f928-414a-908c-79fc500dfd36 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:06.694793 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a54ad-e191-4b70-b7f1-075619120392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:06.695947 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a54ad-e191-4b70-b7f1-075619120392 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:06.696376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a54ad-e191-4b70-b7f1-075619120392 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:06.697244 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a54ad-e191-4b70-b7f1-075619120392 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:06.712465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a54ad-e191-4b70-b7f1-075619120392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:06.713943 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a54ad-e191-4b70-b7f1-075619120392 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:06.717248 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:06.734281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-d54a54ad-e191-4b70-b7f1-075619120392 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:06.734281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:06.734281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:06.734281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:06.734281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:06.734281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:06.734281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:06.734281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:06.734281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:06.734281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:06.734281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:06.734281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:06.734281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:06.734281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:06.734281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:06.735318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:06.735318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:06.735318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:06.735318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:06.735318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:06.735318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:06.735318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:06.735318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:06.735318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:06.735318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:06.735318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:06.735318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:06.735318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:06.735318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:06.735318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:06.735318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:06.735318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:06.736217 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:06.736217 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:06.736217 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:06.736217 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:06.736441 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 289/588] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:06.737235 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a54ad-e191-4b70-b7f1-075619120392 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:06.886664 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42fe8c-f928-414a-908c-79fc500dfd36 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:06.917069 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a54ad-e191-4b70-b7f1-075619120392 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:06.923307 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbe011-dee5-4df7-8193-f23b6d210765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:06.924217 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbe011-dee5-4df7-8193-f23b6d210765 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:06.924770 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbe011-dee5-4df7-8193-f23b6d210765 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:06.925262 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbe011-dee5-4df7-8193-f23b6d210765 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:06.926246 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbe011-dee5-4df7-8193-f23b6d210765 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:06.926755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbe011-dee5-4df7-8193-f23b6d210765 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:06.928323 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbe011-dee5-4df7-8193-f23b6d210765 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:06.942238 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 300/589] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:06.943361 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbe011-dee5-4df7-8193-f23b6d210765 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:06.954764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af710529-d00c-4717-a283-f98a2a3b01f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:06.955557 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af710529-d00c-4717-a283-f98a2a3b01f4 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:06.955835 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af710529-d00c-4717-a283-f98a2a3b01f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:06.956107 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af710529-d00c-4717-a283-f98a2a3b01f4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:06.965452 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af710529-d00c-4717-a283-f98a2a3b01f4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:06.967274 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af710529-d00c-4717-a283-f98a2a3b01f4 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:06.983332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-af710529-d00c-4717-a283-f98a2a3b01f4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 21:10:06.983332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:06.983332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:06.983332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:06.983332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:06.983332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:06.983332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:06.983332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:06.983332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:06.983332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:06.983332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:06.983332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:06.983332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:10:06.983332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:10:06.983332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:10:06.983332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:10:06.984480 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:06.984480 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:06.984480 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:10:06.984480 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:06.984480 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:10:06.984480 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:06.984480 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:06.984480 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:06.984480 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:06.984480 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:06.984480 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:06.984480 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:06.984480 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:06.984480 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:06.984480 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:06.984480 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:06.984480 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:06.984480 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:06.985735 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:06.985735 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:06.985735 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:10:06.985735 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:10:06.985735 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:10:06.985735 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:10:06.985735 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:10:06.985735 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:10:06.985735 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 21:10:06.985735 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:06.986421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:06.991900 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 290/590] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 21:10:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:06.991900 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af710529-d00c-4717-a283-f98a2a3b01f4 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:07.049738 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:07.079353 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbe011-dee5-4df7-8193-f23b6d210765 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:07.099769 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af710529-d00c-4717-a283-f98a2a3b01f4 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:07.133680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5c3d0-7c11-430b-be31-b9bd2f02836e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:07.135248 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5c3d0-7c11-430b-be31-b9bd2f02836e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:07.135703 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5c3d0-7c11-430b-be31-b9bd2f02836e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:07.136157 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5c3d0-7c11-430b-be31-b9bd2f02836e None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:07.137644 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5c3d0-7c11-430b-be31-b9bd2f02836e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:07.139113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5c3d0-7c11-430b-be31-b9bd2f02836e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:07.140773 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5c3d0-7c11-430b-be31-b9bd2f02836e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:07.147048 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a10fa-0781-4524-ba07-90cba9ca50a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:07.148090 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a10fa-0781-4524-ba07-90cba9ca50a5 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:07.149162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a10fa-0781-4524-ba07-90cba9ca50a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:07.149675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a10fa-0781-4524-ba07-90cba9ca50a5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:07.159417 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 301/591] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:07.159914 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a10fa-0781-4524-ba07-90cba9ca50a5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:07.160338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5c3d0-7c11-430b-be31-b9bd2f02836e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:07.161869 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a10fa-0781-4524-ba07-90cba9ca50a5 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:07.182881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-466a10fa-0781-4524-ba07-90cba9ca50a5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 21:10:07.182881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:07.182881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:07.182881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:07.182881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:07.182881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:07.182881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:07.182881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:07.182881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:07.182881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:07.182881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:07.182881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:07.182881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:10:07.182881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:10:07.182881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:10:07.182881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:10:07.184197 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:07.184197 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:07.184197 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:10:07.184197 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:07.184197 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:10:07.184197 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:07.184197 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:07.184197 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:07.184197 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:07.184197 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:07.184197 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:07.184197 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:07.184197 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:07.184197 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:07.184197 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:07.184197 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:07.184197 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:07.184197 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:07.185135 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:07.185135 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:07.185135 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:10:07.185135 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:10:07.185135 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:10:07.185135 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:10:07.185135 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:10:07.185135 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:10:07.185135 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 21:10:07.185135 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:07.188071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 291/592] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:10:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:07.189266 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a10fa-0781-4524-ba07-90cba9ca50a5 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:07.275078 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:07.283234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5c3d0-7c11-430b-be31-b9bd2f02836e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:07.311766 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a10fa-0781-4524-ba07-90cba9ca50a5 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:07.330041 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:07.330463 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d201417-04fb-4b16-95d4-aa76d4e79a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:07.332295 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d201417-04fb-4b16-95d4-aa76d4e79a4b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:07.332779 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d201417-04fb-4b16-95d4-aa76d4e79a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:07.333251 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d201417-04fb-4b16-95d4-aa76d4e79a4b None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:07.334588 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d201417-04fb-4b16-95d4-aa76d4e79a4b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:07.334908 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d201417-04fb-4b16-95d4-aa76d4e79a4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:07.336380 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d201417-04fb-4b16-95d4-aa76d4e79a4b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:07.354073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06982a-fe2d-45fe-8c8e-edc72072e59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:07.354898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06982a-fe2d-45fe-8c8e-edc72072e59c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:07.355735 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06982a-fe2d-45fe-8c8e-edc72072e59c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:07.356128 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06982a-fe2d-45fe-8c8e-edc72072e59c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:07.366077 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 302/593] 10.222.0.13 () {56 vars in 1139 bytes} [Tue Jul 5 21:10:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:07.366077 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d201417-04fb-4b16-95d4-aa76d4e79a4b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:07.368584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06982a-fe2d-45fe-8c8e-edc72072e59c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:07.370136 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06982a-fe2d-45fe-8c8e-edc72072e59c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:07.392706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-1d06982a-fe2d-45fe-8c8e-edc72072e59c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:07.392706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:07.392706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:07.392706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:07.392706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:07.392706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:07.392706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:07.392706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:07.392706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:07.392706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:07.392706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:07.392706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:07.392706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:10:07.392706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:10:07.392706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:10:07.393610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:10:07.393610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:07.393610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:07.393610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:07.393610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:07.393610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:07.393610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:07.393610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:07.393610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:07.393610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:07.393610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:07.393610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:07.393610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:07.393610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:07.393610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:07.393610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:07.393610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:07.394940 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:10:07.394940 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:10:07.394940 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:10:07.394940 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:10:07.394940 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:10:07.394940 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:10:07.394940 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:07.394940 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:07.400434 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 292/594] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:07.400434 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06982a-fe2d-45fe-8c8e-edc72072e59c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:07.478864 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d201417-04fb-4b16-95d4-aa76d4e79a4b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:07.516323 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fbef5-5bfb-47a0-a741-ac8e09d6abfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:07.516723 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fbef5-5bfb-47a0-a741-ac8e09d6abfd None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:07.517005 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fbef5-5bfb-47a0-a741-ac8e09d6abfd None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:07.517281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fbef5-5bfb-47a0-a741-ac8e09d6abfd None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:07.518150 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fbef5-5bfb-47a0-a741-ac8e09d6abfd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:07.518490 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fbef5-5bfb-47a0-a741-ac8e09d6abfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:07.519907 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fbef5-5bfb-47a0-a741-ac8e09d6abfd None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:07.537147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06982a-fe2d-45fe-8c8e-edc72072e59c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:07.538685 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 303/595] 10.222.0.13 () {56 vars in 1137 bytes} [Tue Jul 5 21:10:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:07.539617 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fbef5-5bfb-47a0-a741-ac8e09d6abfd None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:07.555162 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:07.582554 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d2ea8-900a-42a9-8cba-60c46db2b687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:07.583721 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d2ea8-900a-42a9-8cba-60c46db2b687 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:07.584559 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d2ea8-900a-42a9-8cba-60c46db2b687 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:07.585038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d2ea8-900a-42a9-8cba-60c46db2b687 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:07.600728 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d2ea8-900a-42a9-8cba-60c46db2b687 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:07.603205 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d2ea8-900a-42a9-8cba-60c46db2b687 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:07.626453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-218d2ea8-900a-42a9-8cba-60c46db2b687 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:07.626453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:07.626453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:07.626453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:07.626453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:07.626453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:07.626453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:07.626453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:07.626453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:07.626453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:07.626453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:07.626453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:07.626453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:07.626453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:07.626453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:07.627392 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:07.627392 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:07.627392 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:07.627392 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:07.627392 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:07.627392 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:07.627392 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:07.627392 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:07.627392 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:07.627392 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:07.627392 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:07.627392 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:07.627392 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:07.627392 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:07.627392 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:07.627392 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:07.627392 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:07.628289 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:07.628289 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:07.628289 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:07.628289 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:07.635369 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 293/596] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:07.635369 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d2ea8-900a-42a9-8cba-60c46db2b687 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:07.661242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fbef5-5bfb-47a0-a741-ac8e09d6abfd None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:07.677474 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:07.699469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c5d64-78fb-4e3f-b4f8-c843800e2888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:07.700328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c5d64-78fb-4e3f-b4f8-c843800e2888 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:07.700615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c5d64-78fb-4e3f-b4f8-c843800e2888 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:07.700929 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c5d64-78fb-4e3f-b4f8-c843800e2888 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:07.701929 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c5d64-78fb-4e3f-b4f8-c843800e2888 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:07.702317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c5d64-78fb-4e3f-b4f8-c843800e2888 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:07.703757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c5d64-78fb-4e3f-b4f8-c843800e2888 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:07.718242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 304/597] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:10:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:07.718242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c5d64-78fb-4e3f-b4f8-c843800e2888 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:07.755025 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d2ea8-900a-42a9-8cba-60c46db2b687 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:07.789267 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c941b-a9fa-4b13-b192-beacb47f2ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:07.790054 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c941b-a9fa-4b13-b192-beacb47f2ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:07.790404 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c941b-a9fa-4b13-b192-beacb47f2ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:07.790677 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c941b-a9fa-4b13-b192-beacb47f2ab6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:07.793792 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:07.800671 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c941b-a9fa-4b13-b192-beacb47f2ab6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:07.802108 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c941b-a9fa-4b13-b192-beacb47f2ab6 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:07.819634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-137c941b-a9fa-4b13-b192-beacb47f2ab6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:07.819634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:07.819634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:07.819634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:07.819634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:07.819634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:07.819634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:07.819634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:07.819634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:07.819634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:07.819634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:07.819634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:07.819634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:07.819634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:07.819634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:07.820655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:07.820655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:07.820655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:07.820655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:07.820655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:07.820655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:07.820655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:07.820655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:07.820655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:07.820655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:07.820655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:07.820655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:07.820655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:07.820655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:07.820655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:07.820655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:07.820655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:07.821584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:07.821584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:07.821584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:07.821584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:07.821584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 294/598] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:07.822408 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a647fb-3524-41c3-b988-84dc396e0f7f None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:07.822408 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a647fb-3524-41c3-b988-84dc396e0f7f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:07.822548 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a647fb-3524-41c3-b988-84dc396e0f7f None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:07.829196 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 295/599] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:07.829196 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a647fb-3524-41c3-b988-84dc396e0f7f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:07.833515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c5d64-78fb-4e3f-b4f8-c843800e2888 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:07.870595 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bec12-84e9-45c5-9ee2-de8e377bd359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:07.871289 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bec12-84e9-45c5-9ee2-de8e377bd359 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:07.871571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bec12-84e9-45c5-9ee2-de8e377bd359 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:07.871849 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bec12-84e9-45c5-9ee2-de8e377bd359 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:07.872677 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2bec12-84e9-45c5-9ee2-de8e377bd359 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:07.872984 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2bec12-84e9-45c5-9ee2-de8e377bd359 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:07.874510 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2bec12-84e9-45c5-9ee2-de8e377bd359 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:07.892205 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 305/600] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:07.892205 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bec12-84e9-45c5-9ee2-de8e377bd359 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:07.912500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:07.932443 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a647fb-3524-41c3-b988-84dc396e0f7f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:07.966947 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac449f-ba7a-462c-aba4-1f3b879f4442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:07.967790 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac449f-ba7a-462c-aba4-1f3b879f4442 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:07.968073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac449f-ba7a-462c-aba4-1f3b879f4442 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:07.968349 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac449f-ba7a-462c-aba4-1f3b879f4442 None admin] PATH_INFO: `/v3/projects/1076c94b43b2483eb4fc06173f9204c3/users/6d59037633db47efa1ed340055bf520a/roles/c641ed689379413190e5e4ff94eb90ba` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:07.982654 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac449f-ba7a-462c-aba4-1f3b879f4442 None admin] RBAC: Authorizing `identity:create_grant(project_id=1076c94b43b2483eb4fc06173f9204c3, user_id=6d59037633db47efa1ed340055bf520a, role_id=c641ed689379413190e5e4ff94eb90ba)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:07.984092 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac449f-ba7a-462c-aba4-1f3b879f4442 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:07.999849 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bec12-84e9-45c5-9ee2-de8e377bd359 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:08.030085 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:08.034832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7773d-4247-4148-ba5f-54ebd69a9189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:08.035486 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7773d-4247-4148-ba5f-54ebd69a9189 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:08.035767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7773d-4247-4148-ba5f-54ebd69a9189 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:08.036038 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7773d-4247-4148-ba5f-54ebd69a9189 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:08.036748 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7773d-4247-4148-ba5f-54ebd69a9189 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:08.037050 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7773d-4247-4148-ba5f-54ebd69a9189 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:08.038460 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7773d-4247-4148-ba5f-54ebd69a9189 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:08.054073 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 306/601] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:08.054073 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dc595-23cb-49ba-a339-e1a8992a20d9 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:08.054073 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dc595-23cb-49ba-a339-e1a8992a20d9 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:08.054073 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dc595-23cb-49ba-a339-e1a8992a20d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:08.063638 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 296/602] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 21:10:07 2022] PUT /identity/v3/projects/1076c94b43b2483eb4fc06173f9204c3/users/6d59037633db47efa1ed340055bf520a/roles/c641ed689379413190e5e4ff94eb90ba => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:10:08.064678 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac449f-ba7a-462c-aba4-1f3b879f4442 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:08.076133 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-780dc595-23cb-49ba-a339-e1a8992a20d9 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:08.077374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-780dc595-23cb-49ba-a339-e1a8992a20d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:08.164718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 307/603] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:10:08.165862 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780dc595-23cb-49ba-a339-e1a8992a20d9 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:08.207233 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac449f-ba7a-462c-aba4-1f3b879f4442 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:08.243761 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:08.251253 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65303f40-1041-4939-9e85-cd8be79d1b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:08.252387 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65303f40-1041-4939-9e85-cd8be79d1b16 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:08.252673 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65303f40-1041-4939-9e85-cd8be79d1b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:08.252949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65303f40-1041-4939-9e85-cd8be79d1b16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:08.262005 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65303f40-1041-4939-9e85-cd8be79d1b16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:08.263926 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65303f40-1041-4939-9e85-cd8be79d1b16 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:08.278358 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780dc595-23cb-49ba-a339-e1a8992a20d9 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:08.280807 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-65303f40-1041-4939-9e85-cd8be79d1b16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:08.280807 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:08.280807 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:08.280807 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:08.280807 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:08.280807 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:08.280807 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:08.280807 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:08.280807 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:08.280807 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:08.280807 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:08.280807 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:08.280807 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:10:08.280807 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:10:08.280807 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:10:08.281872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:10:08.281872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:08.281872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:08.281872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:08.281872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:08.281872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:08.281872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:08.281872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:08.281872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:08.281872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:08.281872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:08.281872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:08.281872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:08.281872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:08.281872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:08.281872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:08.281872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:08.283470 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:10:08.283470 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:10:08.283470 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:10:08.283470 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:10:08.283470 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:10:08.283470 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:10:08.283470 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:08.283470 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:08.283470 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 297/604] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:08.283470 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65303f40-1041-4939-9e85-cd8be79d1b16 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:08.321528 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:08.329743 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dacbc-939a-4eae-abf1-3108b7b6bdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:08.330589 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dacbc-939a-4eae-abf1-3108b7b6bdea None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:08.330873 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dacbc-939a-4eae-abf1-3108b7b6bdea None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:08.331154 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dacbc-939a-4eae-abf1-3108b7b6bdea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:08.340567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82dacbc-939a-4eae-abf1-3108b7b6bdea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:08.342291 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82dacbc-939a-4eae-abf1-3108b7b6bdea None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:08.361615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-b82dacbc-939a-4eae-abf1-3108b7b6bdea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:08.361615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:08.361615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:08.361615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:08.361615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:08.361615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:08.361615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:08.361615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:08.361615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:08.361615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:08.361615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:08.361615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:08.361615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:10:08.361615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:10:08.361615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:10:08.362630 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:10:08.362630 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:08.362630 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:08.362630 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:08.362630 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:08.362630 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:08.362630 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:08.362630 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:08.362630 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:08.362630 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:08.362630 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:08.362630 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:08.362630 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:08.362630 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:08.362630 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:08.362630 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:08.362630 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:08.363551 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:10:08.363551 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:10:08.363551 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:10:08.363551 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:10:08.363551 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:10:08.363551 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:10:08.363551 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:08.363551 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:08.363551 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 308/605] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:08.364515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dacbc-939a-4eae-abf1-3108b7b6bdea None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:08.413197 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65303f40-1041-4939-9e85-cd8be79d1b16 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:08.459094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41fb384-9308-4a8e-962c-63b77e6bf96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:08.460256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fb384-9308-4a8e-962c-63b77e6bf96d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:08.461264 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fb384-9308-4a8e-962c-63b77e6bf96d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:08.461749 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fb384-9308-4a8e-962c-63b77e6bf96d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:08.475692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41fb384-9308-4a8e-962c-63b77e6bf96d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:10:08.485083 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-d41fb384-9308-4a8e-962c-63b77e6bf96d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:10:08.485083 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:08.485083 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:08.485083 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:08.485083 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:08.485083 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:08.485083 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:08.485083 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:08.485083 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:08.485083 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:08.485083 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:08.485083 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:08.485083 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:10:08.485083 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:10:08.485083 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:10:08.485083 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:10:08.486047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:10:08.486047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:10:08.486047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:10:08.486047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:10:08.486047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:08.486047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:08.486047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:08.486047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:08.486047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:08.486047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:08.486047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:08.486047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:08.486047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:08.486047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:08.486047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:08.486047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:08.486944 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:08.486944 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:08.486944 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:08.486944 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:08.486944 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:10:08.486944 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:10:08.486944 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:10:08.486944 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:10:08.486944 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:10:08.486944 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:10:08.486944 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:10:08.486944 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:08.491262 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 298/606] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 21:10:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:08.492140 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41fb384-9308-4a8e-962c-63b77e6bf96d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:08.498599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dacbc-939a-4eae-abf1-3108b7b6bdea None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:08.536252 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f45fc-db79-4027-a561-54e7bf803d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:08.537338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f45fc-db79-4027-a561-54e7bf803d95 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:08.537820 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f45fc-db79-4027-a561-54e7bf803d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:08.538322 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f45fc-db79-4027-a561-54e7bf803d95 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:08.539322 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f45fc-db79-4027-a561-54e7bf803d95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:08.539829 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f45fc-db79-4027-a561-54e7bf803d95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:08.541497 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f45fc-db79-4027-a561-54e7bf803d95 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:08.556815 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:08.558104 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 309/607] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:10:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:08.559890 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f45fc-db79-4027-a561-54e7bf803d95 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:08.606659 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:08.619626 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41fb384-9308-4a8e-962c-63b77e6bf96d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:08.657479 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2b9ac-6ae4-45e3-837c-7b6491e5d826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:08.658575 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2b9ac-6ae4-45e3-837c-7b6491e5d826 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:08.659036 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2b9ac-6ae4-45e3-837c-7b6491e5d826 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:08.659496 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2b9ac-6ae4-45e3-837c-7b6491e5d826 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:08.660678 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2b9ac-6ae4-45e3-837c-7b6491e5d826 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:08.661269 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2b9ac-6ae4-45e3-837c-7b6491e5d826 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:08.662931 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2b9ac-6ae4-45e3-837c-7b6491e5d826 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:08.663785 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f45fc-db79-4027-a561-54e7bf803d95 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:08.682836 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 299/608] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:10:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:08.684801 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2b9ac-6ae4-45e3-837c-7b6491e5d826 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:08.699253 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05345400-6034-411e-9588-90d3d154fb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:08.699920 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05345400-6034-411e-9588-90d3d154fb40 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:08.700207 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05345400-6034-411e-9588-90d3d154fb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:08.700486 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05345400-6034-411e-9588-90d3d154fb40 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:08.701233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05345400-6034-411e-9588-90d3d154fb40 None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:08.701533 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05345400-6034-411e-9588-90d3d154fb40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:08.702945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05345400-6034-411e-9588-90d3d154fb40 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:08.711526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 310/609] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 21:10:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:08.712699 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ce326-5b67-44eb-8131-bd059727a4d1 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:08.712988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ce326-5b67-44eb-8131-bd059727a4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:08.713265 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ce326-5b67-44eb-8131-bd059727a4d1 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:08.715330 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 311/610] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:08.718983 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ce326-5b67-44eb-8131-bd059727a4d1 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:08.798222 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2b9ac-6ae4-45e3-837c-7b6491e5d826 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:08.809602 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:08.826852 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ce326-5b67-44eb-8131-bd059727a4d1 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:08.829166 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:08.834574 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85969a9-8cc7-4eaa-b913-c2738e94fc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:08.835507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85969a9-8cc7-4eaa-b913-c2738e94fc9a None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:08.835796 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85969a9-8cc7-4eaa-b913-c2738e94fc9a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:08.836073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85969a9-8cc7-4eaa-b913-c2738e94fc9a None admin] PATH_INFO: `/v3/projects/1076c94b43b2483eb4fc06173f9204c3/users/97b6b7c15770400cad4e2b52b13ad354/roles/c641ed689379413190e5e4ff94eb90ba` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:08.853380 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85969a9-8cc7-4eaa-b913-c2738e94fc9a None admin] RBAC: Authorizing `identity:create_grant(project_id=1076c94b43b2483eb4fc06173f9204c3, user_id=97b6b7c15770400cad4e2b52b13ad354, role_id=c641ed689379413190e5e4ff94eb90ba)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:08.854918 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85969a9-8cc7-4eaa-b913-c2738e94fc9a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:08.863424 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873109c-bcbe-4940-a86a-5d0974e2bfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:08.864364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873109c-bcbe-4940-a86a-5d0974e2bfc5 None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:08.864717 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873109c-bcbe-4940-a86a-5d0974e2bfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:08.864996 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873109c-bcbe-4940-a86a-5d0974e2bfc5 None admin] PATH_INFO: `/v3/projects/1076c94b43b2483eb4fc06173f9204c3/users/436d7cc587bc4b2a8a3242fc39876ade/roles/c641ed689379413190e5e4ff94eb90ba` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:08.879560 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873109c-bcbe-4940-a86a-5d0974e2bfc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=1076c94b43b2483eb4fc06173f9204c3, user_id=436d7cc587bc4b2a8a3242fc39876ade, role_id=c641ed689379413190e5e4ff94eb90ba)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:08.880994 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873109c-bcbe-4940-a86a-5d0974e2bfc5 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:08.951304 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 300/611] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 21:10:08 2022] PUT /identity/v3/projects/1076c94b43b2483eb4fc06173f9204c3/users/97b6b7c15770400cad4e2b52b13ad354/roles/c641ed689379413190e5e4ff94eb90ba => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:10:08.952134 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85969a9-8cc7-4eaa-b913-c2738e94fc9a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:08.975865 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 312/612] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 21:10:08 2022] PUT /identity/v3/projects/1076c94b43b2483eb4fc06173f9204c3/users/436d7cc587bc4b2a8a3242fc39876ade/roles/c641ed689379413190e5e4ff94eb90ba => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:10:08.977709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46fe86-3c67-4078-821c-edd77678ace1 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:08.978298 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46fe86-3c67-4078-821c-edd77678ace1 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:08.978764 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46fe86-3c67-4078-821c-edd77678ace1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:08.998599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-2c46fe86-3c67-4078-821c-edd77678ace1 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:09.000446 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2c46fe86-3c67-4078-821c-edd77678ace1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:09.075410 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85969a9-8cc7-4eaa-b913-c2738e94fc9a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:09.096814 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 313/613] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:10:09.118876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efedbcc6-ac34-47f1-bbee-97de4fdca2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:09.120165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedbcc6-ac34-47f1-bbee-97de4fdca2fb None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:09.120846 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedbcc6-ac34-47f1-bbee-97de4fdca2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:09.121320 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedbcc6-ac34-47f1-bbee-97de4fdca2fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:09.133933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efedbcc6-ac34-47f1-bbee-97de4fdca2fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:09.135840 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efedbcc6-ac34-47f1-bbee-97de4fdca2fb None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:09.138449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46fe86-3c67-4078-821c-edd77678ace1 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:09.186639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-efedbcc6-ac34-47f1-bbee-97de4fdca2fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:09.186639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:09.186639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:09.186639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:09.186639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:09.186639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:09.186639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:09.186639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:09.186639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:09.186639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:09.186639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:09.186639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:09.186639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:09.186639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:09.186639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:09.187783 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:09.187783 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:09.187783 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:09.187783 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:09.187783 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:09.187783 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:09.187783 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:09.187783 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:09.187783 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:09.187783 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:09.187783 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:09.187783 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:09.187783 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:09.187783 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:09.187783 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:09.187783 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:09.187783 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:09.188873 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:09.188873 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:09.188873 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:09.188873 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:09.198151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 301/614] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:09.201104 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efedbcc6-ac34-47f1-bbee-97de4fdca2fb None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:09.225370 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:09.274000 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:09.293784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46fe86-3c67-4078-821c-edd77678ace1 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:09.357335 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efedbcc6-ac34-47f1-bbee-97de4fdca2fb None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:09.363038 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44e522-f72a-4251-b3e9-52840a313735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:09.363854 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44e522-f72a-4251-b3e9-52840a313735 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:09.364135 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44e522-f72a-4251-b3e9-52840a313735 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:09.364411 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44e522-f72a-4251-b3e9-52840a313735 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:09.385178 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec44e522-f72a-4251-b3e9-52840a313735 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:10:09.394267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-ec44e522-f72a-4251-b3e9-52840a313735 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:10:09.394267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:09.394267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:09.394267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:09.394267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:09.394267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:09.394267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:09.394267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:09.394267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:09.394267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:09.394267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:09.394267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:09.394267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:10:09.394267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:10:09.394267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:10:09.394267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:10:09.395206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:10:09.395206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:10:09.395206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:10:09.395206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:10:09.395206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:09.395206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:09.395206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:09.395206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:09.395206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:09.395206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:09.395206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:09.395206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:09.395206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:09.395206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:09.395206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:09.395206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:09.396057 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:09.396057 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:09.396057 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:09.396057 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:09.396057 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:10:09.396057 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:10:09.396057 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:10:09.396057 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:10:09.396057 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:10:09.396057 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:10:09.396057 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:10:09.396057 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:09.397410 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 314/615] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 21:10:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:09.401683 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44e522-f72a-4251-b3e9-52840a313735 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:09.434673 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581020f4-c8f9-4b9a-914f-bfadc7d0ba52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:09.435339 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581020f4-c8f9-4b9a-914f-bfadc7d0ba52 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:09.435622 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581020f4-c8f9-4b9a-914f-bfadc7d0ba52 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:09.435896 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581020f4-c8f9-4b9a-914f-bfadc7d0ba52 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:09.436623 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581020f4-c8f9-4b9a-914f-bfadc7d0ba52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:09.436930 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581020f4-c8f9-4b9a-914f-bfadc7d0ba52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:09.439672 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581020f4-c8f9-4b9a-914f-bfadc7d0ba52 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:09.467734 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 302/616] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:09.474108 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581020f4-c8f9-4b9a-914f-bfadc7d0ba52 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:09.577869 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44e522-f72a-4251-b3e9-52840a313735 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:09.599226 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:09.637247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98e87f-4c3a-4b61-8179-9b301d95d603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:09.637889 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98e87f-4c3a-4b61-8179-9b301d95d603 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:09.638192 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98e87f-4c3a-4b61-8179-9b301d95d603 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:09.638469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98e87f-4c3a-4b61-8179-9b301d95d603 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:09.639306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc98e87f-4c3a-4b61-8179-9b301d95d603 None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:09.639612 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc98e87f-4c3a-4b61-8179-9b301d95d603 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:09.650145 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc98e87f-4c3a-4b61-8179-9b301d95d603 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:09.651675 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 315/617] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 21:10:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:09.655637 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581020f4-c8f9-4b9a-914f-bfadc7d0ba52 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:09.657092 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98e87f-4c3a-4b61-8179-9b301d95d603 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:09.667462 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:09.710642 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc7d7f-f033-4460-812d-e6f6765370a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:09.712414 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc7d7f-f033-4460-812d-e6f6765370a2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:09.713463 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc7d7f-f033-4460-812d-e6f6765370a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:09.714050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc7d7f-f033-4460-812d-e6f6765370a2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:09.727919 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc7d7f-f033-4460-812d-e6f6765370a2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:09.733876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc7d7f-f033-4460-812d-e6f6765370a2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:09.761890 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-49bc7d7f-f033-4460-812d-e6f6765370a2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:10:09.761890 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:09.761890 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:09.761890 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:09.761890 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:09.761890 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:09.761890 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:09.761890 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:09.761890 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:09.761890 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:09.761890 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:09.761890 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:09.761890 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:10:09.761890 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:10:09.761890 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:10:09.761890 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:10:09.763085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:09.763085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:09.763085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:10:09.763085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:09.763085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:10:09.763085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:09.763085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:09.763085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:09.763085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:09.763085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:09.763085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:09.763085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:09.763085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:09.763085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:09.763085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:09.763085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:09.763085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:09.763085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:09.764261 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:09.764261 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:09.764261 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:10:09.764261 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:10:09.764261 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:10:09.764261 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:10:09.764261 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:10:09.764261 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:10:09.764261 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:10:09.764261 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:09.767858 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 303/618] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:10:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:09.774577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc7d7f-f033-4460-812d-e6f6765370a2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:09.876647 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98e87f-4c3a-4b61-8179-9b301d95d603 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:09.900193 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc7d7f-f033-4460-812d-e6f6765370a2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:09.935340 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:09.943882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60f7f7-43cd-4cc8-aa67-20170411bcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:09.952471 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60f7f7-43cd-4cc8-aa67-20170411bcb7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:09.952471 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60f7f7-43cd-4cc8-aa67-20170411bcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:09.952471 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60f7f7-43cd-4cc8-aa67-20170411bcb7 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:09.952471 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d60f7f7-43cd-4cc8-aa67-20170411bcb7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:09.952471 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d60f7f7-43cd-4cc8-aa67-20170411bcb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:09.952471 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d60f7f7-43cd-4cc8-aa67-20170411bcb7 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:09.954229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facce0c0-aa5b-4b23-a202-9ef9b1ad2b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:09.955038 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facce0c0-aa5b-4b23-a202-9ef9b1ad2b87 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:09.955324 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facce0c0-aa5b-4b23-a202-9ef9b1ad2b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:09.955600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facce0c0-aa5b-4b23-a202-9ef9b1ad2b87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:09.981771 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facce0c0-aa5b-4b23-a202-9ef9b1ad2b87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:09.983281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facce0c0-aa5b-4b23-a202-9ef9b1ad2b87 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:09.994804 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 304/619] 10.222.0.13 () {56 vars in 1135 bytes} [Tue Jul 5 21:10:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:10.000961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60f7f7-43cd-4cc8-aa67-20170411bcb7 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:10.021007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-facce0c0-aa5b-4b23-a202-9ef9b1ad2b87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:10.021007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:10.021007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:10.021007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:10.021007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:10.021007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:10.021007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:10.021007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:10.021007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:10.021007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:10.021007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:10.021007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:10.021007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:10.021007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:10.021007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:10.021986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:10.021986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:10.021986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:10.021986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:10.021986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:10.021986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:10.021986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:10.021986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:10.021986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:10.021986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:10.021986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:10.021986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:10.021986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:10.021986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:10.021986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:10.021986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:10.021986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:10.024084 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:10.024084 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:10.024084 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:10.024084 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:10.024084 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 316/620] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:10.027593 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facce0c0-aa5b-4b23-a202-9ef9b1ad2b87 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:10.135662 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60f7f7-43cd-4cc8-aa67-20170411bcb7 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:10.170510 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:10.178950 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb723f3c-3821-480b-8b67-8a5b9dec24d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:10.186857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb723f3c-3821-480b-8b67-8a5b9dec24d0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:10.186857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb723f3c-3821-480b-8b67-8a5b9dec24d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:10.186857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb723f3c-3821-480b-8b67-8a5b9dec24d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:10.207221 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb723f3c-3821-480b-8b67-8a5b9dec24d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:10.208693 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb723f3c-3821-480b-8b67-8a5b9dec24d0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:10.230786 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facce0c0-aa5b-4b23-a202-9ef9b1ad2b87 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:10.248328 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-fb723f3c-3821-480b-8b67-8a5b9dec24d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:10.248328 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:10.248328 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:10.248328 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:10.248328 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:10.248328 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:10.248328 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:10.248328 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:10.248328 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:10.248328 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:10.248328 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:10.248328 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:10.248328 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:10.248328 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:10.248328 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:10.249292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:10.249292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:10.249292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:10.249292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:10.249292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:10.249292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:10.249292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:10.249292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:10.249292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:10.249292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:10.249292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:10.249292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:10.249292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:10.249292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:10.249292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:10.249292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:10.249292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:10.250642 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:10.250642 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:10.250642 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:10.250642 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:10.250642 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 305/621] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:10.257366 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb723f3c-3821-480b-8b67-8a5b9dec24d0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:10.292132 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff788982-3224-44bc-b954-f69bf5bcbc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:10.293742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff788982-3224-44bc-b954-f69bf5bcbc52 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:10.294028 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff788982-3224-44bc-b954-f69bf5bcbc52 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:10.294334 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff788982-3224-44bc-b954-f69bf5bcbc52 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:10.295066 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff788982-3224-44bc-b954-f69bf5bcbc52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:10.295373 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff788982-3224-44bc-b954-f69bf5bcbc52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:10.296759 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff788982-3224-44bc-b954-f69bf5bcbc52 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:10.310982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 317/622] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:10.316237 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff788982-3224-44bc-b954-f69bf5bcbc52 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:10.340088 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:10.409522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb723f3c-3821-480b-8b67-8a5b9dec24d0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:10.434585 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff788982-3224-44bc-b954-f69bf5bcbc52 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:10.450017 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5babc1cb-71f3-4fb2-a9c2-ee037f8d4fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:10.450730 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babc1cb-71f3-4fb2-a9c2-ee037f8d4fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:10.451013 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babc1cb-71f3-4fb2-a9c2-ee037f8d4fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:10.451290 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babc1cb-71f3-4fb2-a9c2-ee037f8d4fe8 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:10.452018 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5babc1cb-71f3-4fb2-a9c2-ee037f8d4fe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:10.452326 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5babc1cb-71f3-4fb2-a9c2-ee037f8d4fe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:10.453703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5babc1cb-71f3-4fb2-a9c2-ee037f8d4fe8 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:10.453821 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:10.467317 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 306/623] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:10.468734 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde452e5-a6cb-4f01-80e0-dc49dcd37b66 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:10.469103 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde452e5-a6cb-4f01-80e0-dc49dcd37b66 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:10.475633 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde452e5-a6cb-4f01-80e0-dc49dcd37b66 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:10.475633 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 307/624] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:10.475818 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10683a7-4ade-4201-953d-32c07f3e6921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:10.475818 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10683a7-4ade-4201-953d-32c07f3e6921 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:10.475818 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10683a7-4ade-4201-953d-32c07f3e6921 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:10.475818 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10683a7-4ade-4201-953d-32c07f3e6921 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:10.476086 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbdaee-1da2-457c-8a16-0a1a69c803e6 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:10.476457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbdaee-1da2-457c-8a16-0a1a69c803e6 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:10.476567 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbdaee-1da2-457c-8a16-0a1a69c803e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:10.485908 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10683a7-4ade-4201-953d-32c07f3e6921 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:10.488361 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10683a7-4ade-4201-953d-32c07f3e6921 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:10.500219 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-74dbdaee-1da2-457c-8a16-0a1a69c803e6 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:10.501701 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-74dbdaee-1da2-457c-8a16-0a1a69c803e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:10.506007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-c10683a7-4ade-4201-953d-32c07f3e6921 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:10:10.506007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:10.506007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:10.506007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:10.506007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:10.506007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:10.506007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:10.506007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:10.506007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:10.506007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:10.506007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:10.506007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:10.506007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:10:10.506007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:10:10.506007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:10:10.506007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:10:10.506982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:10.506982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:10.506982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:10:10.506982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:10.506982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:10:10.506982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:10.506982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:10.506982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:10.506982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:10.506982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:10.506982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:10.506982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:10.506982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:10.506982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:10.506982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:10.506982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:10.506982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:10.506982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:10.507973 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:10.507973 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:10.507973 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:10:10.507973 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:10:10.507973 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:10:10.507973 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:10:10.507973 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:10:10.507973 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:10:10.507973 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:10:10.507973 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:10.507973 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 318/625] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Jul 5 21:10:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:10.508577 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10683a7-4ade-4201-953d-32c07f3e6921 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:10.594237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 308/626] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:10:10.595805 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbdaee-1da2-457c-8a16-0a1a69c803e6 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:10.640424 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10683a7-4ade-4201-953d-32c07f3e6921 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:10.641758 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:10.679999 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571760a-4679-4ecb-ac1c-e205361c9688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:10.681068 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571760a-4679-4ecb-ac1c-e205361c9688 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:10.681489 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571760a-4679-4ecb-ac1c-e205361c9688 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:10.681904 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571760a-4679-4ecb-ac1c-e205361c9688 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:10.691139 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571760a-4679-4ecb-ac1c-e205361c9688 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:10.692987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571760a-4679-4ecb-ac1c-e205361c9688 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:10.709063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-5571760a-4679-4ecb-ac1c-e205361c9688 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:10.709063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:10.709063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:10.709063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:10.709063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:10.709063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:10.709063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:10.709063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:10.709063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:10.709063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:10.709063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:10.709063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:10.709063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:10:10.709063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:10:10.709063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:10:10.710001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:10:10.710001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:10.710001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:10.710001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:10.710001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:10.710001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:10.710001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:10.710001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:10.710001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:10.710001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:10.710001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:10.710001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:10.710001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:10.710001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:10.710001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:10.710001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:10.710001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:10.711216 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:10:10.711216 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:10:10.711216 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:10:10.711216 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:10:10.711216 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:10:10.711216 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:10:10.711216 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:10.711216 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:10.712861 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbdaee-1da2-457c-8a16-0a1a69c803e6 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:10.713751 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 319/627] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:10.715798 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571760a-4679-4ecb-ac1c-e205361c9688 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:10.750205 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff946cb6-02a5-4770-8b26-7f786772f6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:10.751037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff946cb6-02a5-4770-8b26-7f786772f6ec None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:10.751524 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff946cb6-02a5-4770-8b26-7f786772f6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:10.751900 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff946cb6-02a5-4770-8b26-7f786772f6ec None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:10.752845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff946cb6-02a5-4770-8b26-7f786772f6ec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:10.753304 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff946cb6-02a5-4770-8b26-7f786772f6ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:10.755093 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff946cb6-02a5-4770-8b26-7f786772f6ec None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:10.765563 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:10.774397 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 309/628] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Jul 5 21:10:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:10.775446 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff946cb6-02a5-4770-8b26-7f786772f6ec None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:10.835390 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571760a-4679-4ecb-ac1c-e205361c9688 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:10.872544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5cd523-f721-4a9f-8dfe-30fb95254a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:10.873588 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cd523-f721-4a9f-8dfe-30fb95254a92 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:10.874015 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cd523-f721-4a9f-8dfe-30fb95254a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:10.874507 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cd523-f721-4a9f-8dfe-30fb95254a92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:10.878224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff946cb6-02a5-4770-8b26-7f786772f6ec None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:10.885810 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5cd523-f721-4a9f-8dfe-30fb95254a92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:10:10.890758 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:10.895462 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-0c5cd523-f721-4a9f-8dfe-30fb95254a92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:10:10.895462 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:10.895462 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:10.895462 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:10.895462 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:10.895462 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:10.895462 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:10.895462 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:10.895462 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:10.895462 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:10.895462 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:10.895462 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:10.895462 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:10:10.895462 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:10:10.895462 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:10:10.895462 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:10:10.896398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:10:10.896398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:10:10.896398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:10:10.896398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:10:10.896398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:10.896398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:10.896398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:10.896398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:10.896398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:10.896398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:10.896398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:10.896398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:10.896398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:10.896398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:10.896398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:10.896398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:10.897244 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:10.897244 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:10.897244 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:10.897244 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:10.897244 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:10:10.897244 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:10:10.897244 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:10:10.897244 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:10:10.897244 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:10:10.897244 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:10:10.897244 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:10:10.897244 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:10.899977 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 320/629] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 21:10:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:10.901078 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5cd523-f721-4a9f-8dfe-30fb95254a92 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:10.919599 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a9119-8a22-457f-b889-00907e3f3c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:10.920322 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a9119-8a22-457f-b889-00907e3f3c5f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:10.920606 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a9119-8a22-457f-b889-00907e3f3c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:10.920882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a9119-8a22-457f-b889-00907e3f3c5f None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:10.921844 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a9119-8a22-457f-b889-00907e3f3c5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:10.921963 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a9119-8a22-457f-b889-00907e3f3c5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:10.923497 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a9119-8a22-457f-b889-00907e3f3c5f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:10.936796 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 310/630] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:10:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:10.937728 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a9119-8a22-457f-b889-00907e3f3c5f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:11.010590 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:11.016205 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5cd523-f721-4a9f-8dfe-30fb95254a92 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:11.049760 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a9119-8a22-457f-b889-00907e3f3c5f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:11.051314 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d93cc-fb51-4ff9-ad6a-2b426a0fc99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:11.052182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d93cc-fb51-4ff9-ad6a-2b426a0fc99d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:11.052662 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d93cc-fb51-4ff9-ad6a-2b426a0fc99d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:11.053158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d93cc-fb51-4ff9-ad6a-2b426a0fc99d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:11.086564 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df9c67-cf29-4a7a-8cf0-3a1cc39803cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:11.087214 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df9c67-cf29-4a7a-8cf0-3a1cc39803cf None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:11.087503 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df9c67-cf29-4a7a-8cf0-3a1cc39803cf None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:11.087783 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df9c67-cf29-4a7a-8cf0-3a1cc39803cf None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:11.088541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df9c67-cf29-4a7a-8cf0-3a1cc39803cf None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:11.088850 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df9c67-cf29-4a7a-8cf0-3a1cc39803cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:11.090372 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df9c67-cf29-4a7a-8cf0-3a1cc39803cf None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:11.099666 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 311/631] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 21:10:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:11.100344 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df9c67-cf29-4a7a-8cf0-3a1cc39803cf None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:11.130487 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:11.131293 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d93cc-fb51-4ff9-ad6a-2b426a0fc99d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:11.132967 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d93cc-fb51-4ff9-ad6a-2b426a0fc99d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:11.206031 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df9c67-cf29-4a7a-8cf0-3a1cc39803cf None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:11.236745 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:11.241978 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ba791-a790-4a3e-8fd1-0250256ec2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:11.242903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ba791-a790-4a3e-8fd1-0250256ec2a0 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:11.243270 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ba791-a790-4a3e-8fd1-0250256ec2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:11.243462 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ba791-a790-4a3e-8fd1-0250256ec2a0 None admin] PATH_INFO: `/v3/projects/1076c94b43b2483eb4fc06173f9204c3/users/441be62a077444b9b9f78714e24a760a/roles/c641ed689379413190e5e4ff94eb90ba` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:11.244037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 321/632] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:10:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:10:11.246076 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d93cc-fb51-4ff9-ad6a-2b426a0fc99d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:11.260060 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ba791-a790-4a3e-8fd1-0250256ec2a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=1076c94b43b2483eb4fc06173f9204c3, user_id=441be62a077444b9b9f78714e24a760a, role_id=c641ed689379413190e5e4ff94eb90ba)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:11.262465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ba791-a790-4a3e-8fd1-0250256ec2a0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:11.351418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d93cc-fb51-4ff9-ad6a-2b426a0fc99d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:11.366162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 312/633] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 21:10:11 2022] PUT /identity/v3/projects/1076c94b43b2483eb4fc06173f9204c3/users/441be62a077444b9b9f78714e24a760a/roles/c641ed689379413190e5e4ff94eb90ba => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:10:11.374899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ba791-a790-4a3e-8fd1-0250256ec2a0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:11.394907 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c71f6-1421-4117-aabb-e95225257963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:11.395886 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c71f6-1421-4117-aabb-e95225257963 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:11.396318 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c71f6-1421-4117-aabb-e95225257963 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:11.396599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c71f6-1421-4117-aabb-e95225257963 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:11.411394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c71f6-1421-4117-aabb-e95225257963 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:11.413579 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c71f6-1421-4117-aabb-e95225257963 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:11.439687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-ed3c71f6-1421-4117-aabb-e95225257963 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:11.439687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:11.439687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:11.439687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:11.439687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:11.439687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:11.439687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:11.439687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:11.439687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:11.439687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:11.439687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:11.439687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:11.439687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:11.439687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:11.439687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:11.440680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:11.440680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:11.440680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:11.440680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:11.440680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:11.440680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:11.440680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:11.440680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:11.440680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:11.440680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:11.440680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:11.440680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:11.440680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:11.440680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:11.440680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:11.440680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:11.440680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:11.441643 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:11.441643 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:11.441643 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:11.441643 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:11.441643 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 322/634] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:11.443030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b38f7-6fd7-4b8f-baab-c0f615c56349 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:11.443316 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b38f7-6fd7-4b8f-baab-c0f615c56349 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:11.443588 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b38f7-6fd7-4b8f-baab-c0f615c56349 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:11.445924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 323/635] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:11.447530 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2be8b-4103-4d6e-acc3-1eaba7b09e27 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:11.447810 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2be8b-4103-4d6e-acc3-1eaba7b09e27 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:11.448082 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2be8b-4103-4d6e-acc3-1eaba7b09e27 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:11.450651 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 324/636] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:11.451128 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2be8b-4103-4d6e-acc3-1eaba7b09e27 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:11.454079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:11.499956 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ba791-a790-4a3e-8fd1-0250256ec2a0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:11.511057 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:11.545299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703733d3-0699-4113-a627-488ce171dd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:11.546106 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703733d3-0699-4113-a627-488ce171dd8e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:11.546476 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703733d3-0699-4113-a627-488ce171dd8e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:11.546755 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703733d3-0699-4113-a627-488ce171dd8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:11.557249 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703733d3-0699-4113-a627-488ce171dd8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:11.559363 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703733d3-0699-4113-a627-488ce171dd8e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:11.568252 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2be8b-4103-4d6e-acc3-1eaba7b09e27 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:11.577145 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-703733d3-0699-4113-a627-488ce171dd8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:11.577145 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:11.577145 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:11.577145 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:11.577145 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:11.577145 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:11.577145 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:11.577145 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:11.577145 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:11.577145 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:11.577145 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:11.577145 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:11.577145 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:11.577145 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:11.577145 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:11.578102 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:11.578102 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:11.578102 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:11.578102 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:11.578102 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:11.578102 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:11.578102 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:11.578102 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:11.578102 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:11.578102 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:11.578102 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:11.578102 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:11.578102 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:11.578102 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:11.578102 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:11.578102 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:11.578102 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:11.579110 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:11.579110 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:11.579110 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:11.579110 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:11.582189 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 313/637] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:11.584310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8eb3c-de4e-46f6-8fb3-74e9800ccc69 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:11.584756 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8eb3c-de4e-46f6-8fb3-74e9800ccc69 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:11.585025 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8eb3c-de4e-46f6-8fb3-74e9800ccc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:11.606144 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-25b8eb3c-de4e-46f6-8fb3-74e9800ccc69 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:11.607351 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-25b8eb3c-de4e-46f6-8fb3-74e9800ccc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:11.609621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1bb7a-3a28-431f-8737-c8c3bdf549a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:11.610413 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1bb7a-3a28-431f-8737-c8c3bdf549a0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:11.610766 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1bb7a-3a28-431f-8737-c8c3bdf549a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:11.611053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1bb7a-3a28-431f-8737-c8c3bdf549a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:11.611778 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1bb7a-3a28-431f-8737-c8c3bdf549a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:11.612086 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1bb7a-3a28-431f-8737-c8c3bdf549a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:11.613459 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1bb7a-3a28-431f-8737-c8c3bdf549a0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:11.630493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 325/638] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:11.630493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2999937-a649-4544-a3c3-58bf9f549181 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:11.630493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2999937-a649-4544-a3c3-58bf9f549181 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:11.630493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2999937-a649-4544-a3c3-58bf9f549181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:11.645154 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e2999937-a649-4544-a3c3-58bf9f549181 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:11.646382 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e2999937-a649-4544-a3c3-58bf9f549181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:11.694302 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 314/639] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:10:11.695232 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8eb3c-de4e-46f6-8fb3-74e9800ccc69 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:11.735538 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 326/640] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:10:11.742165 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2999937-a649-4544-a3c3-58bf9f549181 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:11.749198 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:11.783231 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:11.815878 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8eb3c-de4e-46f6-8fb3-74e9800ccc69 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:11.845080 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2999937-a649-4544-a3c3-58bf9f549181 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:11.858033 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd3b32-465c-4c1d-b2a9-288fdee9e896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:11.858845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd3b32-465c-4c1d-b2a9-288fdee9e896 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:11.859139 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd3b32-465c-4c1d-b2a9-288fdee9e896 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:11.859446 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd3b32-465c-4c1d-b2a9-288fdee9e896 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:11.860207 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd3b32-465c-4c1d-b2a9-288fdee9e896 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:11.860517 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd3b32-465c-4c1d-b2a9-288fdee9e896 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:11.861871 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd3b32-465c-4c1d-b2a9-288fdee9e896 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:11.874522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 315/641] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:11.875174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd3b32-465c-4c1d-b2a9-288fdee9e896 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:11.886795 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5dd5e-6294-43a6-be3e-af5ab64ce06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:11.887595 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5dd5e-6294-43a6-be3e-af5ab64ce06c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:11.887883 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5dd5e-6294-43a6-be3e-af5ab64ce06c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:11.888299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5dd5e-6294-43a6-be3e-af5ab64ce06c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:11.896019 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5dd5e-6294-43a6-be3e-af5ab64ce06c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:11.897452 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5dd5e-6294-43a6-be3e-af5ab64ce06c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:11.912571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-6ce5dd5e-6294-43a6-be3e-af5ab64ce06c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:10:11.912571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:11.912571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:11.912571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:11.912571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:11.912571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:11.912571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:11.912571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:11.912571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:11.912571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:11.912571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:11.912571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:11.912571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:10:11.912571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:10:11.912571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:10:11.912571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:10:11.913737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:11.913737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:11.913737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:10:11.913737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:11.913737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:10:11.913737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:11.913737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:11.913737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:11.913737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:11.913737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:11.913737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:11.913737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:11.913737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:11.913737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:11.913737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:11.913737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:11.913737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:11.913737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:11.914725 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:11.914725 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:11.914725 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:10:11.914725 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:10:11.914725 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:10:11.914725 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:10:11.914725 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:10:11.914725 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:10:11.914725 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:10:11.914725 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:11.914725 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 327/642] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:10:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:11.914725 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5dd5e-6294-43a6-be3e-af5ab64ce06c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:11.985341 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd3b32-465c-4c1d-b2a9-288fdee9e896 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:11.988794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:12.020283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:12.021397 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42fa57-66ed-44dc-91b7-ae968f59e00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:12.022224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42fa57-66ed-44dc-91b7-ae968f59e00c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:12.022507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42fa57-66ed-44dc-91b7-ae968f59e00c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:12.022779 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42fa57-66ed-44dc-91b7-ae968f59e00c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:12.024261 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5dd5e-6294-43a6-be3e-af5ab64ce06c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:12.034273 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42fa57-66ed-44dc-91b7-ae968f59e00c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:10:12.041448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-ad42fa57-66ed-44dc-91b7-ae968f59e00c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:10:12.041448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:12.041448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:12.041448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:12.041448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:12.041448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:12.041448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:12.041448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:12.041448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:12.041448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:12.041448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:12.041448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:12.041448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:10:12.041448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:10:12.041448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:10:12.041448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:10:12.043133 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:10:12.043133 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:10:12.043133 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:10:12.043133 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:10:12.043133 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:12.043133 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:12.043133 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:12.043133 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:12.043133 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:12.043133 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:12.043133 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:12.043133 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:12.043133 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:12.043133 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:12.043133 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:12.043133 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:12.049101 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:12.049101 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:12.049101 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:12.049101 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:12.049101 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:10:12.049101 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:10:12.049101 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:10:12.049101 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:10:12.049101 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:10:12.049101 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:10:12.049101 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:10:12.049101 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:12.049101 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 316/643] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 21:10:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:12.049101 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42fa57-66ed-44dc-91b7-ae968f59e00c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:12.064827 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e96fd0-7cbd-4a2c-b1c8-b1d689369468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:12.065631 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e96fd0-7cbd-4a2c-b1c8-b1d689369468 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:12.065918 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e96fd0-7cbd-4a2c-b1c8-b1d689369468 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:12.066223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e96fd0-7cbd-4a2c-b1c8-b1d689369468 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:12.077530 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e96fd0-7cbd-4a2c-b1c8-b1d689369468 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:10:12.085394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-a8e96fd0-7cbd-4a2c-b1c8-b1d689369468 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:10:12.085394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:12.085394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:12.085394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:12.085394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:12.085394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:12.085394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:12.085394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:12.085394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:12.085394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:12.085394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:12.085394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:12.085394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:10:12.085394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:10:12.085394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:10:12.085394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:10:12.086449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:10:12.086449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:10:12.086449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:10:12.086449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:10:12.086449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:12.086449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:12.086449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:12.086449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:12.086449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:12.086449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:12.086449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:12.086449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:12.086449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:12.086449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:12.086449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:12.086449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:12.087371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:12.087371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:12.087371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:12.087371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:12.087371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:10:12.087371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:10:12.087371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:10:12.087371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:10:12.087371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:10:12.087371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:10:12.087371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:10:12.087371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:12.087371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 328/644] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 21:10:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:12.087371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e96fd0-7cbd-4a2c-b1c8-b1d689369468 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:12.171465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42fa57-66ed-44dc-91b7-ae968f59e00c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:12.200205 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e96fd0-7cbd-4a2c-b1c8-b1d689369468 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:12.204245 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051af33e-1214-4a65-8a2a-357218e4f8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:12.205027 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051af33e-1214-4a65-8a2a-357218e4f8df None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:12.205307 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051af33e-1214-4a65-8a2a-357218e4f8df None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:12.205583 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051af33e-1214-4a65-8a2a-357218e4f8df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:12.212997 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051af33e-1214-4a65-8a2a-357218e4f8df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:12.215486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051af33e-1214-4a65-8a2a-357218e4f8df None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:12.230005 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-051af33e-1214-4a65-8a2a-357218e4f8df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:12.230005 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:12.230005 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:12.230005 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:12.230005 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:12.230005 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:12.230005 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:12.230005 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:12.230005 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:12.230005 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:12.230005 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:12.230005 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:12.230005 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:10:12.230005 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:10:12.230005 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:10:12.231183 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:10:12.231183 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:12.231183 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:12.231183 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:12.231183 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:12.231183 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:12.231183 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:12.231183 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:12.231183 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:12.231183 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:12.231183 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:12.231183 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:12.231183 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:12.231183 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:12.231183 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:12.231183 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:12.231183 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:12.232377 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:10:12.232377 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:10:12.232377 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:10:12.232377 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:10:12.232377 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:10:12.232377 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:10:12.232377 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:12.232377 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:12.235683 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 317/645] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:12.236495 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051af33e-1214-4a65-8a2a-357218e4f8df None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:12.239538 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6cc3e-5cf1-4c79-ac4d-9c2c4bfd4991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:12.240375 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6cc3e-5cf1-4c79-ac4d-9c2c4bfd4991 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:12.240669 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6cc3e-5cf1-4c79-ac4d-9c2c4bfd4991 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:12.240949 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6cc3e-5cf1-4c79-ac4d-9c2c4bfd4991 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:12.241782 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6cc3e-5cf1-4c79-ac4d-9c2c4bfd4991 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:12.242104 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6cc3e-5cf1-4c79-ac4d-9c2c4bfd4991 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:12.243547 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6cc3e-5cf1-4c79-ac4d-9c2c4bfd4991 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:12.260406 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:12.267082 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 329/646] 10.222.0.13 () {56 vars in 1137 bytes} [Tue Jul 5 21:10:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:12.267082 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6cc3e-5cf1-4c79-ac4d-9c2c4bfd4991 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:12.285151 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:12.350539 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051af33e-1214-4a65-8a2a-357218e4f8df None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:12.369470 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6cc3e-5cf1-4c79-ac4d-9c2c4bfd4991 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:12.388788 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5b6ca-deaf-4fa3-90bd-cba8e8997e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:12.389449 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5b6ca-deaf-4fa3-90bd-cba8e8997e0b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:12.389734 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5b6ca-deaf-4fa3-90bd-cba8e8997e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:12.390014 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5b6ca-deaf-4fa3-90bd-cba8e8997e0b None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:12.391203 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5b6ca-deaf-4fa3-90bd-cba8e8997e0b None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:12.391360 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5b6ca-deaf-4fa3-90bd-cba8e8997e0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:12.392784 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5b6ca-deaf-4fa3-90bd-cba8e8997e0b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:12.406856 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 318/647] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 21:10:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:12.406856 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5b6ca-deaf-4fa3-90bd-cba8e8997e0b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:12.413067 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4cf1a-5c7e-4e24-9d51-422a732f88ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:12.413817 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4cf1a-5c7e-4e24-9d51-422a732f88ad None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:12.414197 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4cf1a-5c7e-4e24-9d51-422a732f88ad None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:12.414477 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4cf1a-5c7e-4e24-9d51-422a732f88ad None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:12.415302 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4cf1a-5c7e-4e24-9d51-422a732f88ad None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:12.415610 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4cf1a-5c7e-4e24-9d51-422a732f88ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:12.416971 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4cf1a-5c7e-4e24-9d51-422a732f88ad None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:12.429522 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 330/648] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 21:10:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:12.429522 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4cf1a-5c7e-4e24-9d51-422a732f88ad None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:12.505710 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:12.518009 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:12.522526 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5b6ca-deaf-4fa3-90bd-cba8e8997e0b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:12.536324 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4cf1a-5c7e-4e24-9d51-422a732f88ad None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:12.557368 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d9a05-76b1-4bbc-9d95-69de843872c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:12.558660 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d9a05-76b1-4bbc-9d95-69de843872c0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:12.558948 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d9a05-76b1-4bbc-9d95-69de843872c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:12.559230 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d9a05-76b1-4bbc-9d95-69de843872c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:12.560022 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d9a05-76b1-4bbc-9d95-69de843872c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:12.560340 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d9a05-76b1-4bbc-9d95-69de843872c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:12.561785 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d9a05-76b1-4bbc-9d95-69de843872c0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:12.572282 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb858a-aaaf-4aa3-985a-a79303a7e31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:12.573001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb858a-aaaf-4aa3-985a-a79303a7e31c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:12.574030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb858a-aaaf-4aa3-985a-a79303a7e31c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:12.574414 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb858a-aaaf-4aa3-985a-a79303a7e31c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:12.580255 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 319/649] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:10:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:12.580255 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d9a05-76b1-4bbc-9d95-69de843872c0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:12.657540 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb858a-aaaf-4aa3-985a-a79303a7e31c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:12.659009 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb858a-aaaf-4aa3-985a-a79303a7e31c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:12.690782 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d9a05-76b1-4bbc-9d95-69de843872c0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:12.731885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ef63b-8e63-4cbf-acd9-70d23dc44074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:12.733504 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ef63b-8e63-4cbf-acd9-70d23dc44074 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:12.734010 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ef63b-8e63-4cbf-acd9-70d23dc44074 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:12.734529 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ef63b-8e63-4cbf-acd9-70d23dc44074 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:12.741504 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:12.747543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ef63b-8e63-4cbf-acd9-70d23dc44074 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:12.749026 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ef63b-8e63-4cbf-acd9-70d23dc44074 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:12.755913 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:12.767051 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 331/650] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:10:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:10:12.767051 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb858a-aaaf-4aa3-985a-a79303a7e31c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:12.768209 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-aa4ef63b-8e63-4cbf-acd9-70d23dc44074 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:12.768209 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:12.768209 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:12.768209 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:12.768209 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:12.768209 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:12.768209 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:12.768209 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:12.768209 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:12.768209 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:12.768209 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:12.768209 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:12.768209 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:12.768209 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:12.768209 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:12.769082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:12.769082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:12.769082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:12.769082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:12.769082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:12.769082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:12.769082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:12.769082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:12.769082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:12.769082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:12.769082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:12.769082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:12.769082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:12.769082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:12.769082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:12.769082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:12.769082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:12.769973 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:12.769973 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:12.769973 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:12.769973 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:12.769973 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 320/651] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:12.770293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ef63b-8e63-4cbf-acd9-70d23dc44074 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:12.873665 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb858a-aaaf-4aa3-985a-a79303a7e31c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:12.876501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ef63b-8e63-4cbf-acd9-70d23dc44074 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:12.908204 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021806f0-0588-432d-81b2-85419ea70f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:12.909324 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021806f0-0588-432d-81b2-85419ea70f14 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:12.909792 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021806f0-0588-432d-81b2-85419ea70f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:12.910285 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021806f0-0588-432d-81b2-85419ea70f14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:12.911028 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d26d71-a4e3-42de-867b-30a93341e185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:12.911677 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d26d71-a4e3-42de-867b-30a93341e185 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:12.911964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d26d71-a4e3-42de-867b-30a93341e185 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:12.912245 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d26d71-a4e3-42de-867b-30a93341e185 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:12.913066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d26d71-a4e3-42de-867b-30a93341e185 None admin] RBAC: Adding query filter params (role.id=c641ed689379413190e5e4ff94eb90ba, scope.project.id=1076c94b43b2483eb4fc06173f9204c3, user.id=910cd341df8943f18af2765e2a30b238) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:12.913381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d26d71-a4e3-42de-867b-30a93341e185 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:12.914834 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d26d71-a4e3-42de-867b-30a93341e185 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:12.921490 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 321/652] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:10:12 2022] GET /identity/v3/role_assignments?user.id=910cd341df8943f18af2765e2a30b238&scope.project.id=1076c94b43b2483eb4fc06173f9204c3&role.id=c641ed689379413190e5e4ff94eb90ba => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:12.922333 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d26d71-a4e3-42de-867b-30a93341e185 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:12.932005 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021806f0-0588-432d-81b2-85419ea70f14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:12.934404 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021806f0-0588-432d-81b2-85419ea70f14 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:12.954850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-021806f0-0588-432d-81b2-85419ea70f14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:12.954850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:12.954850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:12.954850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:12.954850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:12.954850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:12.954850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:12.954850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:12.954850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:12.954850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:12.954850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:12.954850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:12.954850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:12.954850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:12.954850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:12.955857 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:12.955857 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:12.955857 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:12.955857 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:12.955857 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:12.955857 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:12.955857 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:12.955857 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:12.955857 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:12.955857 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:12.955857 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:12.955857 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:12.955857 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:12.955857 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:12.955857 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:12.955857 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:12.955857 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:12.956775 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:12.956775 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:12.956775 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:12.956775 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:12.960879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 332/653] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:12.962032 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021806f0-0588-432d-81b2-85419ea70f14 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:13.004387 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:13.004968 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:13.051117 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d26d71-a4e3-42de-867b-30a93341e185 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:13.094033 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9275da-555d-450d-a2d3-a4334e8215bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:13.094272 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021806f0-0588-432d-81b2-85419ea70f14 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:13.095279 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9275da-555d-450d-a2d3-a4334e8215bb None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:13.095958 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9275da-555d-450d-a2d3-a4334e8215bb None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:13.096417 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9275da-555d-450d-a2d3-a4334e8215bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:13.110358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9275da-555d-450d-a2d3-a4334e8215bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:13.112203 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9275da-555d-450d-a2d3-a4334e8215bb None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:13.133242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0711a2-0218-4cf0-83b3-0e2c8a118b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:13.133840 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0711a2-0218-4cf0-83b3-0e2c8a118b9c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:13.134147 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0711a2-0218-4cf0-83b3-0e2c8a118b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:13.134445 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0711a2-0218-4cf0-83b3-0e2c8a118b9c None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:13.135177 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0711a2-0218-4cf0-83b3-0e2c8a118b9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:13.135484 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0711a2-0218-4cf0-83b3-0e2c8a118b9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:13.137144 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0711a2-0218-4cf0-83b3-0e2c8a118b9c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:13.139329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-0d9275da-555d-450d-a2d3-a4334e8215bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:13.139329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:13.139329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:13.139329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:13.139329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:13.139329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:13.139329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:13.139329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:13.139329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:13.139329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:13.139329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:13.139329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:13.139329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:13.139329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:13.139329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:13.140457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:13.140457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:13.140457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:13.140457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:13.140457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:13.140457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:13.140457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:13.140457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:13.140457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:13.140457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:13.140457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:13.140457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:13.140457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:13.140457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:13.140457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:13.140457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:13.140457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:13.142369 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:13.142369 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:13.142369 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:13.142369 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:13.142369 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 322/654] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:13.142369 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9275da-555d-450d-a2d3-a4334e8215bb None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:13.157772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 333/655] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:13.158717 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0711a2-0218-4cf0-83b3-0e2c8a118b9c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:13.281384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9275da-555d-450d-a2d3-a4334e8215bb None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:13.283348 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:13.297449 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:13.298665 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0711a2-0218-4cf0-83b3-0e2c8a118b9c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:13.318232 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6511d7-2a5d-43ba-9bcc-546d819c9222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:13.318998 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6511d7-2a5d-43ba-9bcc-546d819c9222 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:13.319355 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6511d7-2a5d-43ba-9bcc-546d819c9222 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:13.319709 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6511d7-2a5d-43ba-9bcc-546d819c9222 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:13.320558 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6511d7-2a5d-43ba-9bcc-546d819c9222 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:13.320958 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6511d7-2a5d-43ba-9bcc-546d819c9222 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:13.322498 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6511d7-2a5d-43ba-9bcc-546d819c9222 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:13.336825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154179e-af90-42fb-905a-8bbd28d3f584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:13.337058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 323/656] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:13.338104 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154179e-af90-42fb-905a-8bbd28d3f584 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:13.338591 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154179e-af90-42fb-905a-8bbd28d3f584 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:13.339554 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154179e-af90-42fb-905a-8bbd28d3f584 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:13.340454 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154179e-af90-42fb-905a-8bbd28d3f584 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:13.340932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154179e-af90-42fb-905a-8bbd28d3f584 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:13.342693 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6511d7-2a5d-43ba-9bcc-546d819c9222 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:13.343048 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154179e-af90-42fb-905a-8bbd28d3f584 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:13.356871 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 334/657] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:13.357973 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154179e-af90-42fb-905a-8bbd28d3f584 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:13.453292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6511d7-2a5d-43ba-9bcc-546d819c9222 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:13.459876 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154179e-af90-42fb-905a-8bbd28d3f584 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:13.487490 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb3d08-1e36-488a-a570-1a6b29785e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:13.488294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb3d08-1e36-488a-a570-1a6b29785e2d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:13.488577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb3d08-1e36-488a-a570-1a6b29785e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:13.488855 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb3d08-1e36-488a-a570-1a6b29785e2d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:13.497404 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb3d08-1e36-488a-a570-1a6b29785e2d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:13.500180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4e0f0-5666-4a9a-9678-b5589f61b6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:13.500299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb3d08-1e36-488a-a570-1a6b29785e2d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:13.500389 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4e0f0-5666-4a9a-9678-b5589f61b6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:13.500389 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4e0f0-5666-4a9a-9678-b5589f61b6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:13.500389 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4e0f0-5666-4a9a-9678-b5589f61b6f5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:13.508363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4e0f0-5666-4a9a-9678-b5589f61b6f5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:13.509862 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4e0f0-5666-4a9a-9678-b5589f61b6f5 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:13.514167 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-1dcb3d08-1e36-488a-a570-1a6b29785e2d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 21:10:13.514167 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:13.514167 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:13.514167 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:13.514167 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:13.514167 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:13.514167 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:13.514167 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:13.514167 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:13.514167 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:13.514167 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:13.514167 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:13.514167 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:10:13.514167 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:10:13.514167 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:10:13.514167 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:10:13.515445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:13.515445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:13.515445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:10:13.515445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:13.515445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:10:13.515445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:13.515445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:13.515445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:13.515445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:13.515445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:13.515445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:13.515445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:13.515445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:13.515445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:13.515445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:13.515445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:13.515445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:13.515445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:13.516465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:13.516465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:13.516465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:10:13.516465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:10:13.516465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:10:13.516465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:10:13.516465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:10:13.516465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:10:13.516465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 21:10:13.516465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:13.516465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 324/658] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:10:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:13.517118 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb3d08-1e36-488a-a570-1a6b29785e2d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:13.527986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-fcd4e0f0-5666-4a9a-9678-b5589f61b6f5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 21:10:13.527986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:13.527986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:13.527986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:13.527986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:13.527986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:13.527986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:13.527986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:13.527986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:13.527986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:13.527986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:13.527986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:13.527986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:10:13.527986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:10:13.527986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:10:13.527986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:10:13.529027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:13.529027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:13.529027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:10:13.529027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:13.529027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:10:13.529027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:13.529027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:13.529027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:13.529027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:13.529027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:13.529027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:13.529027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:13.529027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:13.529027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:13.529027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:13.529027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:13.529027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:13.529027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:13.530054 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:13.530054 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:13.530054 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:10:13.530054 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:10:13.530054 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:10:13.530054 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:10:13.530054 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:10:13.530054 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:10:13.530054 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 21:10:13.530054 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:13.530054 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 335/659] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 21:10:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:13.531643 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dab32d-ec01-4eb9-b3fe-31b8e21c1f95 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:13.531643 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dab32d-ec01-4eb9-b3fe-31b8e21c1f95 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:13.531643 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dab32d-ec01-4eb9-b3fe-31b8e21c1f95 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:13.536439 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 336/660] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:13.537203 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dab32d-ec01-4eb9-b3fe-31b8e21c1f95 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:13.555657 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:13.562578 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:13.638342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb3d08-1e36-488a-a570-1a6b29785e2d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:13.651005 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dab32d-ec01-4eb9-b3fe-31b8e21c1f95 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:13.675567 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26bbc0-0120-4cd8-aa8c-d339de1eee32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:13.676486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26bbc0-0120-4cd8-aa8c-d339de1eee32 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:13.676869 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26bbc0-0120-4cd8-aa8c-d339de1eee32 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:13.677249 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26bbc0-0120-4cd8-aa8c-d339de1eee32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:13.684851 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26bbc0-0120-4cd8-aa8c-d339de1eee32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:13.686413 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26bbc0-0120-4cd8-aa8c-d339de1eee32 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:13.689135 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309eb486-0cdf-4608-acae-6eb6dbbb5db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:13.689848 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309eb486-0cdf-4608-acae-6eb6dbbb5db0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:13.690154 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309eb486-0cdf-4608-acae-6eb6dbbb5db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:13.690477 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309eb486-0cdf-4608-acae-6eb6dbbb5db0 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:13.691304 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309eb486-0cdf-4608-acae-6eb6dbbb5db0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:13.691667 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309eb486-0cdf-4608-acae-6eb6dbbb5db0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:13.693098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309eb486-0cdf-4608-acae-6eb6dbbb5db0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:13.700570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-7a26bbc0-0120-4cd8-aa8c-d339de1eee32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:13.700570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:13.700570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:13.700570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:13.700570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:13.700570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:13.700570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:13.700570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:13.700570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:13.700570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:13.700570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:13.700570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:13.700570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:10:13.700570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:10:13.700570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:10:13.718970 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:10:13.718970 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:13.718970 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:13.718970 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:13.718970 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:13.718970 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:13.718970 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:13.718970 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:13.718970 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:13.718970 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:13.718970 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:13.718970 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:13.718970 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:13.718970 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:13.718970 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:13.718970 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:13.718970 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:13.720130 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:10:13.720130 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:10:13.720130 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:10:13.720130 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:10:13.720130 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:10:13.720130 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:10:13.720130 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:13.720130 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:13.720130 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 325/661] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:13.720130 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26bbc0-0120-4cd8-aa8c-d339de1eee32 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:13.721677 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 337/662] 10.222.0.13 () {56 vars in 1137 bytes} [Tue Jul 5 21:10:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:13.723160 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1364926-6702-4780-9ed6-350e167ee3ca None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:13.723456 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1364926-6702-4780-9ed6-350e167ee3ca None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:13.723760 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1364926-6702-4780-9ed6-350e167ee3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:13.741005 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-a1364926-6702-4780-9ed6-350e167ee3ca None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:13.742310 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a1364926-6702-4780-9ed6-350e167ee3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:13.805093 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:13.811192 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:13.813360 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26bbc0-0120-4cd8-aa8c-d339de1eee32 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:13.816161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 338/663] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:10:13.823474 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1364926-6702-4780-9ed6-350e167ee3ca None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:13.850661 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02cca2-b817-4c0c-b2dc-18157599456e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:13.851357 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02cca2-b817-4c0c-b2dc-18157599456e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:13.851634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02cca2-b817-4c0c-b2dc-18157599456e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:13.852159 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02cca2-b817-4c0c-b2dc-18157599456e None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:13.852735 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02cca2-b817-4c0c-b2dc-18157599456e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:13.853039 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02cca2-b817-4c0c-b2dc-18157599456e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:13.855008 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02cca2-b817-4c0c-b2dc-18157599456e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:13.874254 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 326/664] 10.222.0.13 () {56 vars in 1139 bytes} [Tue Jul 5 21:10:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:13.875066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02cca2-b817-4c0c-b2dc-18157599456e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:13.939000 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1364926-6702-4780-9ed6-350e167ee3ca None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:13.975966 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ce63e-c736-4ad8-b5eb-5d336f74fa1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:13.976559 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ce63e-c736-4ad8-b5eb-5d336f74fa1d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:13.976840 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ce63e-c736-4ad8-b5eb-5d336f74fa1d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:13.977116 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ce63e-c736-4ad8-b5eb-5d336f74fa1d None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:13.977891 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ce63e-c736-4ad8-b5eb-5d336f74fa1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:13.978223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ce63e-c736-4ad8-b5eb-5d336f74fa1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:13.980392 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ce63e-c736-4ad8-b5eb-5d336f74fa1d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:13.983322 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02cca2-b817-4c0c-b2dc-18157599456e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:13.996959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 339/665] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:10:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:13.996959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ce63e-c736-4ad8-b5eb-5d336f74fa1d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:14.024126 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9130596-50ce-4251-8786-1097af79248f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:14.024764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9130596-50ce-4251-8786-1097af79248f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:14.025094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9130596-50ce-4251-8786-1097af79248f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:14.025315 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9130596-50ce-4251-8786-1097af79248f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:14.049135 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:14.056373 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:14.098506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ce63e-c736-4ad8-b5eb-5d336f74fa1d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:14.101934 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9130596-50ce-4251-8786-1097af79248f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:14.103415 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9130596-50ce-4251-8786-1097af79248f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:14.136979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a741680-1000-43b9-b345-f11c396472d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:14.137768 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a741680-1000-43b9-b345-f11c396472d3 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:14.138048 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a741680-1000-43b9-b345-f11c396472d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:14.138358 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a741680-1000-43b9-b345-f11c396472d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:14.148676 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a741680-1000-43b9-b345-f11c396472d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:10:14.157059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-4a741680-1000-43b9-b345-f11c396472d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:10:14.157059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:14.157059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:14.157059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:14.157059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:14.157059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:14.157059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:14.157059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:14.157059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:14.157059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:14.157059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:14.157059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:14.157059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:10:14.157059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:10:14.157059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:10:14.157059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:10:14.158233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:10:14.158233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:10:14.158233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:10:14.158233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:10:14.158233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:14.158233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:14.158233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:14.158233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:14.158233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:14.158233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:14.158233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:14.158233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:14.158233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:14.158233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:14.158233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:14.158233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:14.159183 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:14.159183 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:14.159183 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:14.159183 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:14.159183 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:10:14.159183 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:10:14.159183 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:10:14.159183 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:10:14.159183 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:10:14.159183 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:10:14.159183 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:10:14.159183 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:14.162984 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 340/666] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 21:10:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:14.163823 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a741680-1000-43b9-b345-f11c396472d3 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:14.217069 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 327/667] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:10:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:10:14.218387 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9130596-50ce-4251-8786-1097af79248f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:14.275303 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a741680-1000-43b9-b345-f11c396472d3 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:14.280350 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:14.298100 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:14.312158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8fb20-de80-4927-87dd-f337c05c1dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:14.312953 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8fb20-de80-4927-87dd-f337c05c1dbb None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:14.313236 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8fb20-de80-4927-87dd-f337c05c1dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:14.313511 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8fb20-de80-4927-87dd-f337c05c1dbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:14.331358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9130596-50ce-4251-8786-1097af79248f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:14.366683 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03b002-e698-4861-a8c4-17c1528f5ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:14.367693 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03b002-e698-4861-a8c4-17c1528f5ebf None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:14.368208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03b002-e698-4861-a8c4-17c1528f5ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:14.368565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03b002-e698-4861-a8c4-17c1528f5ebf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:14.369405 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f03b002-e698-4861-a8c4-17c1528f5ebf None admin] RBAC: Adding query filter params (role.id=c641ed689379413190e5e4ff94eb90ba, scope.project.id=1076c94b43b2483eb4fc06173f9204c3, user.id=6d59037633db47efa1ed340055bf520a) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:14.369725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f03b002-e698-4861-a8c4-17c1528f5ebf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:14.371210 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f03b002-e698-4861-a8c4-17c1528f5ebf None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:14.377935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 328/668] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:10:14 2022] GET /identity/v3/role_assignments?user.id=6d59037633db47efa1ed340055bf520a&scope.project.id=1076c94b43b2483eb4fc06173f9204c3&role.id=c641ed689379413190e5e4ff94eb90ba => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:14.378802 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03b002-e698-4861-a8c4-17c1528f5ebf None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:14.393753 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8fb20-de80-4927-87dd-f337c05c1dbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:14.395323 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8fb20-de80-4927-87dd-f337c05c1dbb None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:14.517385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 341/669] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:10:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:10:14.517385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8fb20-de80-4927-87dd-f337c05c1dbb None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:14.524180 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03b002-e698-4861-a8c4-17c1528f5ebf None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:14.538697 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:14.548384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:14.567800 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11bdd0-5e6b-4709-9a31-0061d722ffd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:14.568722 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11bdd0-5e6b-4709-9a31-0061d722ffd2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:14.569304 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11bdd0-5e6b-4709-9a31-0061d722ffd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:14.569600 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11bdd0-5e6b-4709-9a31-0061d722ffd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:14.570398 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11bdd0-5e6b-4709-9a31-0061d722ffd2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:14.570710 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11bdd0-5e6b-4709-9a31-0061d722ffd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:14.572932 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11bdd0-5e6b-4709-9a31-0061d722ffd2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:14.584156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 329/670] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 21:10:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:14.584156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11bdd0-5e6b-4709-9a31-0061d722ffd2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:14.646260 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8fb20-de80-4927-87dd-f337c05c1dbb None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:14.690063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f4589-6faf-436e-bfa0-071c23873c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:14.691689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f4589-6faf-436e-bfa0-071c23873c4e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:14.692201 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f4589-6faf-436e-bfa0-071c23873c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:14.692693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f4589-6faf-436e-bfa0-071c23873c4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:14.705059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f4589-6faf-436e-bfa0-071c23873c4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:14.707000 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f4589-6faf-436e-bfa0-071c23873c4e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:14.722659 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11bdd0-5e6b-4709-9a31-0061d722ffd2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:14.726223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-794f4589-6faf-436e-bfa0-071c23873c4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:14.726223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:14.726223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:14.726223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:14.726223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:14.726223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:14.726223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:14.726223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:14.726223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:14.726223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:14.726223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:14.726223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:14.726223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:14.726223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:14.726223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:14.727137 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:14.727137 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:14.727137 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:14.727137 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:14.727137 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:14.727137 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:14.727137 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:14.727137 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:14.727137 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:14.727137 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:14.727137 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:14.727137 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:14.727137 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:14.727137 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:14.727137 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:14.727137 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:14.727137 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:14.728052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:14.728052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:14.728052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:14.728052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:14.730683 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 342/671] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:14.735094 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f4589-6faf-436e-bfa0-071c23873c4e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:14.765661 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c418092-4974-483d-85ec-5074598efff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:14.766493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c418092-4974-483d-85ec-5074598efff5 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:14.766771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c418092-4974-483d-85ec-5074598efff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:14.767040 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c418092-4974-483d-85ec-5074598efff5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:14.781032 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c418092-4974-483d-85ec-5074598efff5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:14.783503 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c418092-4974-483d-85ec-5074598efff5 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:14.805396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-2c418092-4974-483d-85ec-5074598efff5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:14.805396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:14.805396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:14.805396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:14.805396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:14.805396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:14.805396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:14.805396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:14.805396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:14.805396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:14.805396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:14.805396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:14.805396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:14.805396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:14.805396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:14.806791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:14.806791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:14.806791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:14.806791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:14.806791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:14.806791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:14.806791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:14.806791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:14.806791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:14.806791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:14.806791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:14.806791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:14.806791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:14.806791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:14.806791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:14.806791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:14.806791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:14.808250 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:14.808250 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:14.808250 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:14.808250 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:14.810540 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 330/672] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:14.811632 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c418092-4974-483d-85ec-5074598efff5 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:14.825516 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:14.845972 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:14.866161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f4589-6faf-436e-bfa0-071c23873c4e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:14.917117 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f8da3-1a23-4142-8eca-2942f8fee8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:14.919311 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f8da3-1a23-4142-8eca-2942f8fee8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:14.919600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f8da3-1a23-4142-8eca-2942f8fee8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:14.919884 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f8da3-1a23-4142-8eca-2942f8fee8d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:14.925143 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c418092-4974-483d-85ec-5074598efff5 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:14.933448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f8da3-1a23-4142-8eca-2942f8fee8d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:14.935012 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f8da3-1a23-4142-8eca-2942f8fee8d5 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:14.955035 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-511f8da3-1a23-4142-8eca-2942f8fee8d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:14.955035 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:14.955035 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:14.955035 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:14.955035 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:14.955035 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:14.955035 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:14.955035 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:14.955035 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:14.955035 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:14.955035 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:14.955035 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:14.955035 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:14.955035 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:14.955035 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:14.956022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:14.956022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:14.956022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:14.956022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:14.956022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:14.956022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:14.956022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:14.956022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:14.956022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:14.956022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:14.956022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:14.956022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:14.956022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:14.956022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:14.956022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:14.956022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:14.956022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:14.956933 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:14.956933 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:14.956933 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:14.956933 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:14.960999 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 343/673] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:14.961822 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f8da3-1a23-4142-8eca-2942f8fee8d5 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:14.966211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78673b90-970c-41b2-9e99-232a8272bd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:14.967136 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78673b90-970c-41b2-9e99-232a8272bd40 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:14.967624 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78673b90-970c-41b2-9e99-232a8272bd40 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:14.968128 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78673b90-970c-41b2-9e99-232a8272bd40 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:14.969066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78673b90-970c-41b2-9e99-232a8272bd40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:14.969580 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78673b90-970c-41b2-9e99-232a8272bd40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:14.971367 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78673b90-970c-41b2-9e99-232a8272bd40 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:14.988638 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 331/674] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:14.989849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78673b90-970c-41b2-9e99-232a8272bd40 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:15.071523 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f8da3-1a23-4142-8eca-2942f8fee8d5 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:15.086493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:15.096685 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78673b90-970c-41b2-9e99-232a8272bd40 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:15.098504 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:15.110761 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af212b-4ead-45c6-b573-9da83c2a16af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:15.111426 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af212b-4ead-45c6-b573-9da83c2a16af None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:15.111707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af212b-4ead-45c6-b573-9da83c2a16af None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:15.111979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af212b-4ead-45c6-b573-9da83c2a16af None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:15.112760 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af212b-4ead-45c6-b573-9da83c2a16af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:15.113150 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af212b-4ead-45c6-b573-9da83c2a16af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:15.114570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af212b-4ead-45c6-b573-9da83c2a16af None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:15.133382 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 344/675] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:15.140918 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af212b-4ead-45c6-b573-9da83c2a16af None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:15.141035 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d5059-54e9-44b8-9035-e4f8332cf2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:15.141035 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d5059-54e9-44b8-9035-e4f8332cf2cb None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:15.141035 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d5059-54e9-44b8-9035-e4f8332cf2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:15.141035 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d5059-54e9-44b8-9035-e4f8332cf2cb None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:15.141345 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d5059-54e9-44b8-9035-e4f8332cf2cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:15.141345 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d5059-54e9-44b8-9035-e4f8332cf2cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:15.141345 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d5059-54e9-44b8-9035-e4f8332cf2cb None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:15.154269 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 332/676] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:15.155459 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d5059-54e9-44b8-9035-e4f8332cf2cb None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:15.246840 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af212b-4ead-45c6-b573-9da83c2a16af None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:15.260556 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d5059-54e9-44b8-9035-e4f8332cf2cb None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:15.281770 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97820c-31a2-4f23-8e4e-97c55a8e652b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:15.282669 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97820c-31a2-4f23-8e4e-97c55a8e652b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:15.282950 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97820c-31a2-4f23-8e4e-97c55a8e652b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:15.283332 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97820c-31a2-4f23-8e4e-97c55a8e652b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:15.290281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97820c-31a2-4f23-8e4e-97c55a8e652b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:15.291746 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97820c-31a2-4f23-8e4e-97c55a8e652b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:15.295400 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e67d75-479e-4c3b-93c9-f9b1aaf060cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:15.296187 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e67d75-479e-4c3b-93c9-f9b1aaf060cc None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:15.296478 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e67d75-479e-4c3b-93c9-f9b1aaf060cc None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:15.296760 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e67d75-479e-4c3b-93c9-f9b1aaf060cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:15.303427 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e67d75-479e-4c3b-93c9-f9b1aaf060cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:15.304865 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e67d75-479e-4c3b-93c9-f9b1aaf060cc None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:15.306453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-fe97820c-31a2-4f23-8e4e-97c55a8e652b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:15.306453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:15.306453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:15.306453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:15.306453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:15.306453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:15.306453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:15.306453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:15.306453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:15.306453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:15.306453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:15.306453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:15.306453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:10:15.306453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:10:15.306453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:10:15.308098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:10:15.308098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:15.308098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:15.308098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:15.308098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:15.308098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:15.308098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:15.308098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:15.308098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:15.308098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:15.308098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:15.308098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:15.308098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:15.308098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:15.308098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:15.308098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:15.308098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:15.309302 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:10:15.309302 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:10:15.309302 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:10:15.309302 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:10:15.309302 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:10:15.309302 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:10:15.309302 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:15.309302 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:15.312903 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 345/677] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:15.314196 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483c23b-4930-489a-b282-e438037a0e29 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:15.314599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483c23b-4930-489a-b282-e438037a0e29 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:15.314856 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483c23b-4930-489a-b282-e438037a0e29 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:15.316109 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 346/678] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:15.316783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483c23b-4930-489a-b282-e438037a0e29 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:15.323412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-d0e67d75-479e-4c3b-93c9-f9b1aaf060cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:15.323412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:15.323412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:15.323412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:15.323412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:15.323412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:15.323412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:15.323412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:15.323412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:15.323412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:15.323412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:15.323412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:15.323412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:10:15.323412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:10:15.323412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:10:15.324510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:10:15.324510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:15.324510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:15.324510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:15.324510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:15.324510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:15.324510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:15.324510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:15.324510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:15.324510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:15.324510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:15.324510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:15.324510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:15.324510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:15.324510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:15.324510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:15.324510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:15.326021 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:10:15.326021 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:10:15.326021 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:10:15.326021 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:10:15.326021 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:10:15.326021 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:10:15.326021 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:15.326021 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:15.326021 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 333/679] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:15.326021 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e67d75-479e-4c3b-93c9-f9b1aaf060cc None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:15.338818 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:15.374344 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:15.431085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e67d75-479e-4c3b-93c9-f9b1aaf060cc None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:15.433088 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483c23b-4930-489a-b282-e438037a0e29 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:15.467845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db450cf3-8a00-4d54-8d05-ba008ce30c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:15.468180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f8f6e-8284-40f0-beb7-6a266f27d5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:15.468504 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db450cf3-8a00-4d54-8d05-ba008ce30c23 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:15.468787 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db450cf3-8a00-4d54-8d05-ba008ce30c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:15.468974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f8f6e-8284-40f0-beb7-6a266f27d5ae None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:15.469072 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db450cf3-8a00-4d54-8d05-ba008ce30c23 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:15.469235 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f8f6e-8284-40f0-beb7-6a266f27d5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:15.469491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f8f6e-8284-40f0-beb7-6a266f27d5ae None admin] PATH_INFO: `/v3/users/swift` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:15.469822 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db450cf3-8a00-4d54-8d05-ba008ce30c23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:15.470137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db450cf3-8a00-4d54-8d05-ba008ce30c23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:15.471605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db450cf3-8a00-4d54-8d05-ba008ce30c23 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:15.476853 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f8f6e-8284-40f0-beb7-6a266f27d5ae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:15.478300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f8f6e-8284-40f0-beb7-6a266f27d5ae None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:15.489277 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 334/680] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:10:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:15.489277 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9ff11-5615-445f-bae4-a54e0ebf6033 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:15.489277 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9ff11-5615-445f-bae4-a54e0ebf6033 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:15.489277 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9ff11-5615-445f-bae4-a54e0ebf6033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:15.493670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-281f8f6e-8284-40f0-beb7-6a266f27d5ae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:10:15.493670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:15.493670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:15.493670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:15.493670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:15.493670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:15.493670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:15.493670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:15.493670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:15.493670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:15.493670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:15.493670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:15.493670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:10:15.493670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:10:15.493670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:10:15.493670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:10:15.494656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:15.494656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:15.494656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:10:15.494656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:15.494656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:10:15.494656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:15.494656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:15.494656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:15.494656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:15.494656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:15.494656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:15.494656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:15.494656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:15.494656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:15.494656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:15.494656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:15.494656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:15.494656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:15.495965 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:15.495965 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:15.495965 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:10:15.495965 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:10:15.495965 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:10:15.495965 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:10:15.495965 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:10:15.495965 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:10:15.495965 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:10:15.495965 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:15.495965 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 347/681] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:10:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:15.495965 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f8f6e-8284-40f0-beb7-6a266f27d5ae None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:15.511861 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-07f9ff11-5615-445f-bae4-a54e0ebf6033 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:15.513059 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-07f9ff11-5615-445f-bae4-a54e0ebf6033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:15.580656 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:15.586179 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 335/682] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:10:15.586759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9ff11-5615-445f-bae4-a54e0ebf6033 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:15.623472 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f8f6e-8284-40f0-beb7-6a266f27d5ae None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:15.626678 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:15.661363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6d741-b398-4ac5-8111-0d8001f6a586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:15.662210 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6d741-b398-4ac5-8111-0d8001f6a586 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:15.662510 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6d741-b398-4ac5-8111-0d8001f6a586 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:15.662781 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6d741-b398-4ac5-8111-0d8001f6a586 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:15.664048 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c6d741-b398-4ac5-8111-0d8001f6a586 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:15.664376 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c6d741-b398-4ac5-8111-0d8001f6a586 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:15.665858 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c6d741-b398-4ac5-8111-0d8001f6a586 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:15.678611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 348/683] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:10:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:15.679422 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6d741-b398-4ac5-8111-0d8001f6a586 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:15.706105 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9ff11-5615-445f-bae4-a54e0ebf6033 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:15.743217 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9baae7-0c39-440a-9295-e3017c4cca25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:15.744256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9baae7-0c39-440a-9295-e3017c4cca25 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:15.744878 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9baae7-0c39-440a-9295-e3017c4cca25 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:15.745156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9baae7-0c39-440a-9295-e3017c4cca25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:15.745975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9baae7-0c39-440a-9295-e3017c4cca25 None admin] RBAC: Adding query filter params (role.id=c641ed689379413190e5e4ff94eb90ba, scope.project.id=1076c94b43b2483eb4fc06173f9204c3, user.id=436d7cc587bc4b2a8a3242fc39876ade) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:15.746320 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9baae7-0c39-440a-9295-e3017c4cca25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:15.747854 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9baae7-0c39-440a-9295-e3017c4cca25 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:15.762147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 336/684] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:10:15 2022] GET /identity/v3/role_assignments?user.id=436d7cc587bc4b2a8a3242fc39876ade&scope.project.id=1076c94b43b2483eb4fc06173f9204c3&role.id=c641ed689379413190e5e4ff94eb90ba => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:15.762147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9baae7-0c39-440a-9295-e3017c4cca25 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:15.803636 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6d741-b398-4ac5-8111-0d8001f6a586 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:15.835174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:15.860019 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5189c0-cafd-490e-8b07-c39a59fcb65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:15.861085 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5189c0-cafd-490e-8b07-c39a59fcb65c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:15.861438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5189c0-cafd-490e-8b07-c39a59fcb65c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:15.861782 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5189c0-cafd-490e-8b07-c39a59fcb65c None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:15.863258 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5189c0-cafd-490e-8b07-c39a59fcb65c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:15.863751 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5189c0-cafd-490e-8b07-c39a59fcb65c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:15.865466 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5189c0-cafd-490e-8b07-c39a59fcb65c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:15.882068 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9baae7-0c39-440a-9295-e3017c4cca25 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:15.890917 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 349/685] 10.222.0.13 () {56 vars in 1135 bytes} [Tue Jul 5 21:10:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:15.892425 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5189c0-cafd-490e-8b07-c39a59fcb65c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:15.928567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:15.934464 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf19bc-788c-4874-a9fc-0d6189f67253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:15.935274 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf19bc-788c-4874-a9fc-0d6189f67253 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:15.935558 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf19bc-788c-4874-a9fc-0d6189f67253 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:15.935836 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf19bc-788c-4874-a9fc-0d6189f67253 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:15.948680 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf19bc-788c-4874-a9fc-0d6189f67253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:10:15.956813 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-3bcf19bc-788c-4874-a9fc-0d6189f67253 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:10:15.956813 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:15.956813 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:15.956813 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:15.956813 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:15.956813 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:15.956813 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:15.956813 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:15.956813 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:15.956813 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:15.956813 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:15.956813 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:15.956813 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:10:15.956813 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:10:15.956813 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:10:15.956813 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:10:15.957788 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:10:15.957788 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:10:15.957788 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:10:15.957788 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:10:15.957788 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:15.957788 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:15.957788 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:15.957788 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:15.957788 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:15.957788 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:15.957788 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:15.957788 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:15.957788 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:15.957788 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:15.957788 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:15.957788 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:15.959094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:15.959094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:15.959094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:15.959094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:15.959094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:10:15.959094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:10:15.959094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:10:15.959094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:10:15.959094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:10:15.959094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:10:15.959094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:10:15.959094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:15.959094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 337/686] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:10:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:15.959094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf19bc-788c-4874-a9fc-0d6189f67253 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:16.034541 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5189c0-cafd-490e-8b07-c39a59fcb65c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:16.077877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a72a3c-bff2-4cfc-b0f5-22968ce20681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:16.079244 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a72a3c-bff2-4cfc-b0f5-22968ce20681 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:16.080155 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a72a3c-bff2-4cfc-b0f5-22968ce20681 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:16.080904 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a72a3c-bff2-4cfc-b0f5-22968ce20681 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:16.082242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a72a3c-bff2-4cfc-b0f5-22968ce20681 None admin] RBAC: Adding query filter params (role.id=c641ed689379413190e5e4ff94eb90ba, scope.project.id=1076c94b43b2483eb4fc06173f9204c3, user.id=97b6b7c15770400cad4e2b52b13ad354) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:16.083189 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a72a3c-bff2-4cfc-b0f5-22968ce20681 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:16.085444 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a72a3c-bff2-4cfc-b0f5-22968ce20681 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:16.088893 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf19bc-788c-4874-a9fc-0d6189f67253 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:16.095045 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 350/687] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:10:15 2022] GET /identity/v3/role_assignments?user.id=97b6b7c15770400cad4e2b52b13ad354&scope.project.id=1076c94b43b2483eb4fc06173f9204c3&role.id=c641ed689379413190e5e4ff94eb90ba => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:16.096105 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a72a3c-bff2-4cfc-b0f5-22968ce20681 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:16.155687 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:16.197866 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4913b5d-df5d-4a23-acf2-fa98acdea77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:16.199554 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4913b5d-df5d-4a23-acf2-fa98acdea77a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:16.199719 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4913b5d-df5d-4a23-acf2-fa98acdea77a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:16.200109 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4913b5d-df5d-4a23-acf2-fa98acdea77a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:16.207064 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:16.221905 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a72a3c-bff2-4cfc-b0f5-22968ce20681 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:16.263801 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4787e0-bbdc-4c8d-8bcb-6326ea30b5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:16.265323 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4787e0-bbdc-4c8d-8bcb-6326ea30b5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:16.265732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4787e0-bbdc-4c8d-8bcb-6326ea30b5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:16.266133 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4787e0-bbdc-4c8d-8bcb-6326ea30b5a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:16.267537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4787e0-bbdc-4c8d-8bcb-6326ea30b5a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:16.267953 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4787e0-bbdc-4c8d-8bcb-6326ea30b5a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:16.269754 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4787e0-bbdc-4c8d-8bcb-6326ea30b5a9 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:16.281007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 351/688] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:10:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:16.292681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4787e0-bbdc-4c8d-8bcb-6326ea30b5a9 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:16.337125 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4913b5d-df5d-4a23-acf2-fa98acdea77a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:16.338632 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4913b5d-df5d-4a23-acf2-fa98acdea77a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:16.424686 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4787e0-bbdc-4c8d-8bcb-6326ea30b5a9 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:16.454046 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 338/689] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:10:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:10:16.460740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4913b5d-df5d-4a23-acf2-fa98acdea77a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:16.466467 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c9da0-952f-4f5a-8dd2-853bd2b6310b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:16.467270 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c9da0-952f-4f5a-8dd2-853bd2b6310b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:16.467552 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c9da0-952f-4f5a-8dd2-853bd2b6310b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:16.467827 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c9da0-952f-4f5a-8dd2-853bd2b6310b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:16.481158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c9da0-952f-4f5a-8dd2-853bd2b6310b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:16.482675 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c9da0-952f-4f5a-8dd2-853bd2b6310b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:16.488919 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:16.491277 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:16.504707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-747c9da0-952f-4f5a-8dd2-853bd2b6310b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:16.504707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:16.504707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:16.504707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:16.504707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:16.504707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:16.504707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:16.504707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:16.504707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:16.504707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:16.504707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:16.504707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:16.504707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:16.504707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:16.504707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:16.506910 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:16.506910 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:16.506910 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:16.506910 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:16.506910 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:16.506910 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:16.506910 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:16.506910 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:16.506910 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:16.506910 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:16.506910 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:16.506910 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:16.506910 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:16.506910 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:16.506910 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:16.506910 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:16.506910 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:16.507828 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:16.507828 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:16.507828 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:16.507828 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:16.507828 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 352/690] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:16.513340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c9da0-952f-4f5a-8dd2-853bd2b6310b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:16.586834 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4913b5d-df5d-4a23-acf2-fa98acdea77a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:16.627252 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e9d55-2800-45f8-bfe2-fd815083eed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:16.628463 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e9d55-2800-45f8-bfe2-fd815083eed1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:16.628942 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e9d55-2800-45f8-bfe2-fd815083eed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:16.629423 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e9d55-2800-45f8-bfe2-fd815083eed1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:16.641340 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e9d55-2800-45f8-bfe2-fd815083eed1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:16.643258 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e9d55-2800-45f8-bfe2-fd815083eed1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:16.663224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-d08e9d55-2800-45f8-bfe2-fd815083eed1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:16.663224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:16.663224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:16.663224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:16.663224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:16.663224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:16.663224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:16.663224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:16.663224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:16.663224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:16.663224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:16.663224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:16.663224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:16.663224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:16.663224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:16.664256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:16.664256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:16.664256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:16.664256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:16.664256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:16.664256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:16.664256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:16.664256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:16.664256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:16.664256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:16.664256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:16.664256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:16.664256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:16.664256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:16.664256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:16.664256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:16.664256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:16.665188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:16.665188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:16.665188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:16.665188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:16.669653 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 339/691] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:16.670581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c9da0-952f-4f5a-8dd2-853bd2b6310b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:16.671628 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4283f6-eeb3-473b-8d84-6ac291c93f82 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:16.672208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4283f6-eeb3-473b-8d84-6ac291c93f82 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:16.672760 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4283f6-eeb3-473b-8d84-6ac291c93f82 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:16.674630 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 340/692] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:16.675537 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4283f6-eeb3-473b-8d84-6ac291c93f82 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:16.721101 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0719fd-e1a4-4716-98c2-fe99eb93e687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:16.721776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0719fd-e1a4-4716-98c2-fe99eb93e687 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:16.722063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0719fd-e1a4-4716-98c2-fe99eb93e687 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:16.722372 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0719fd-e1a4-4716-98c2-fe99eb93e687 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:16.723105 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0719fd-e1a4-4716-98c2-fe99eb93e687 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:16.723414 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0719fd-e1a4-4716-98c2-fe99eb93e687 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:16.724853 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0719fd-e1a4-4716-98c2-fe99eb93e687 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:16.741904 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 353/693] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:16.744202 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee97fd4-e677-4222-90ff-46da3adb725e None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:16.744503 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee97fd4-e677-4222-90ff-46da3adb725e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:16.745357 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee97fd4-e677-4222-90ff-46da3adb725e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:16.767014 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-7ee97fd4-e677-4222-90ff-46da3adb725e None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:16.768555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7ee97fd4-e677-4222-90ff-46da3adb725e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:16.777202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:16.810237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4283f6-eeb3-473b-8d84-6ac291c93f82 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:16.829977 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:16.846298 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 354/694] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:10:16.847391 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee97fd4-e677-4222-90ff-46da3adb725e None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:16.855510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c92eb2-a66e-4832-b929-557b42d7e14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:16.856205 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c92eb2-a66e-4832-b929-557b42d7e14d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:16.856491 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c92eb2-a66e-4832-b929-557b42d7e14d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:16.856767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c92eb2-a66e-4832-b929-557b42d7e14d None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:16.858412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c92eb2-a66e-4832-b929-557b42d7e14d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:16.858732 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c92eb2-a66e-4832-b929-557b42d7e14d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:16.860221 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c92eb2-a66e-4832-b929-557b42d7e14d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:16.874786 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 341/695] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:16.879901 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c92eb2-a66e-4832-b929-557b42d7e14d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:16.991805 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee97fd4-e677-4222-90ff-46da3adb725e None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:16.997647 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c92eb2-a66e-4832-b929-557b42d7e14d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:17.033969 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c0175-bdc0-4f87-a19b-7ceac66725c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:17.035053 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c0175-bdc0-4f87-a19b-7ceac66725c3 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:17.035501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c0175-bdc0-4f87-a19b-7ceac66725c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:17.035914 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c0175-bdc0-4f87-a19b-7ceac66725c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:17.037416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8953f3-6aae-4bbe-b186-719a7341ebab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:17.038510 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8953f3-6aae-4bbe-b186-719a7341ebab None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:17.039672 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8953f3-6aae-4bbe-b186-719a7341ebab None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:17.039954 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:17.040271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8953f3-6aae-4bbe-b186-719a7341ebab None admin] PATH_INFO: `/v3/users/nova` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:17.046852 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c0175-bdc0-4f87-a19b-7ceac66725c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:17.048500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c0175-bdc0-4f87-a19b-7ceac66725c3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:17.050176 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8953f3-6aae-4bbe-b186-719a7341ebab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:17.056385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8953f3-6aae-4bbe-b186-719a7341ebab None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:17.065786 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-af8c0175-bdc0-4f87-a19b-7ceac66725c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:17.065786 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:17.065786 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:17.065786 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:17.065786 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:17.065786 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:17.065786 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:17.065786 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:17.065786 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:17.065786 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:17.065786 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:17.065786 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:17.065786 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:10:17.065786 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:10:17.065786 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:10:17.066976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:10:17.066976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:17.066976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:17.066976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:17.066976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:17.066976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:17.066976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:17.066976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:17.066976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:17.066976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:17.066976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:17.066976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:17.066976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:17.066976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:17.066976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:17.066976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:17.066976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:17.068123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:10:17.068123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:10:17.068123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:10:17.068123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:10:17.068123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:10:17.068123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:10:17.068123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:17.068123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:17.070526 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 342/696] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:17.071659 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c0175-bdc0-4f87-a19b-7ceac66725c3 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:17.074317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-8a8953f3-6aae-4bbe-b186-719a7341ebab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:10:17.074317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:17.074317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:17.074317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:17.074317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:17.074317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:17.074317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:17.074317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:17.074317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:17.074317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:17.074317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:17.074317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:17.074317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:10:17.074317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:10:17.074317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:10:17.074317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:10:17.075263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:17.075263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:17.075263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:10:17.075263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:17.075263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:10:17.075263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:17.075263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:17.075263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:17.075263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:17.075263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:17.075263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:17.075263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:17.075263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:17.075263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:17.075263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:17.075263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:17.075263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:17.075263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:17.076265 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:17.076265 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:17.076265 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:10:17.076265 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:10:17.076265 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:10:17.076265 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:10:17.076265 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:10:17.076265 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:10:17.076265 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:10:17.076265 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:17.079125 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 355/697] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Jul 5 21:10:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:17.080177 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8953f3-6aae-4bbe-b186-719a7341ebab None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:17.162706 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:17.187887 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c0175-bdc0-4f87-a19b-7ceac66725c3 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:17.191072 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8953f3-6aae-4bbe-b186-719a7341ebab None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:17.227366 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff423b1-5ef1-47d4-9c32-2a252af2fc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:17.227823 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d21b2-ef33-4ceb-b769-ae815af37739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:17.228635 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d21b2-ef33-4ceb-b769-ae815af37739 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:17.228906 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d21b2-ef33-4ceb-b769-ae815af37739 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:17.229010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff423b1-5ef1-47d4-9c32-2a252af2fc12 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:17.229710 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d21b2-ef33-4ceb-b769-ae815af37739 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:17.230277 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff423b1-5ef1-47d4-9c32-2a252af2fc12 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:17.230754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d21b2-ef33-4ceb-b769-ae815af37739 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:17.230860 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff423b1-5ef1-47d4-9c32-2a252af2fc12 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:17.231853 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff423b1-5ef1-47d4-9c32-2a252af2fc12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:17.232112 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d21b2-ef33-4ceb-b769-ae815af37739 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:17.232567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff423b1-5ef1-47d4-9c32-2a252af2fc12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:17.234320 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff423b1-5ef1-47d4-9c32-2a252af2fc12 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:17.246265 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 356/698] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:10:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:17.247741 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff423b1-5ef1-47d4-9c32-2a252af2fc12 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:17.253624 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-c80d21b2-ef33-4ceb-b769-ae815af37739 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:10:17.253624 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:17.253624 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:10:17.253624 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:10:17.253624 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:10:17.253624 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:10:17.253624 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:10:17.253624 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:17.253624 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:10:17.253624 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:17.253624 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:10:17.253624 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:17.253624 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:17.253624 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:17.253624 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:17.253624 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:17.254630 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:17.254630 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:17.254630 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:17.254630 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:17.254630 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:17.254630 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:17.254630 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:17.254630 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:10:17.254630 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:10:17.254630 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:10:17.254630 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:10:17.254630 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:17.254630 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:17.254630 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:17.254630 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:17.254630 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:17.255492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:17.255492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:17.255492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:17.255492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:17.255492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:17.255492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:17.255492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:17.255492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:17.255492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:17.255492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:17.255492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:17.255492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:10:17.255492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:17.255492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:10:17.255492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:17.256294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 343/699] 10.222.0.13 () {56 vars in 1129 bytes} [Tue Jul 5 21:10:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:17.256294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d21b2-ef33-4ceb-b769-ae815af37739 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:17.327634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:17.373752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d21b2-ef33-4ceb-b769-ae815af37739 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:17.382162 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff423b1-5ef1-47d4-9c32-2a252af2fc12 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:17.396487 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:17.412090 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80f2a3-380e-427d-af39-6e46c0d8339d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:17.413990 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80f2a3-380e-427d-af39-6e46c0d8339d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:17.413990 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80f2a3-380e-427d-af39-6e46c0d8339d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:17.413990 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80f2a3-380e-427d-af39-6e46c0d8339d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:17.415052 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80f2a3-380e-427d-af39-6e46c0d8339d None admin] RBAC: Adding query filter params (role.id=c641ed689379413190e5e4ff94eb90ba, scope.project.id=1076c94b43b2483eb4fc06173f9204c3, user.id=441be62a077444b9b9f78714e24a760a) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:17.415563 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80f2a3-380e-427d-af39-6e46c0d8339d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:17.417231 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80f2a3-380e-427d-af39-6e46c0d8339d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:17.424170 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 344/700] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:10:17 2022] GET /identity/v3/role_assignments?user.id=441be62a077444b9b9f78714e24a760a&scope.project.id=1076c94b43b2483eb4fc06173f9204c3&role.id=c641ed689379413190e5e4ff94eb90ba => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:17.425263 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80f2a3-380e-427d-af39-6e46c0d8339d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:17.431495 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a66ad1-616c-48ef-b99d-1d6ec8eab1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:17.434877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a66ad1-616c-48ef-b99d-1d6ec8eab1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:17.435449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a66ad1-616c-48ef-b99d-1d6ec8eab1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:17.436253 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a66ad1-616c-48ef-b99d-1d6ec8eab1d5 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:17.437717 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a66ad1-616c-48ef-b99d-1d6ec8eab1d5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:17.442506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a66ad1-616c-48ef-b99d-1d6ec8eab1d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:17.444382 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a66ad1-616c-48ef-b99d-1d6ec8eab1d5 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:17.480671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 357/701] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Jul 5 21:10:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:17.487188 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a66ad1-616c-48ef-b99d-1d6ec8eab1d5 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:17.641467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80f2a3-380e-427d-af39-6e46c0d8339d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:17.641959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a66ad1-616c-48ef-b99d-1d6ec8eab1d5 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:17.668491 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:17.679408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43199a19-240f-430e-a0f3-bf4eb0436303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:17.680060 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43199a19-240f-430e-a0f3-bf4eb0436303 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:17.681268 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3871533-2e9e-4f82-8c9a-a57dbf3110ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:17.681379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43199a19-240f-430e-a0f3-bf4eb0436303 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:17.681379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43199a19-240f-430e-a0f3-bf4eb0436303 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:17.681522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3871533-2e9e-4f82-8c9a-a57dbf3110ed None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:17.681522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3871533-2e9e-4f82-8c9a-a57dbf3110ed None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:17.681522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3871533-2e9e-4f82-8c9a-a57dbf3110ed None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:17.682111 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3871533-2e9e-4f82-8c9a-a57dbf3110ed None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:17.683114 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3871533-2e9e-4f82-8c9a-a57dbf3110ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:17.684713 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3871533-2e9e-4f82-8c9a-a57dbf3110ed None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:17.690031 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 345/702] 10.222.0.13 () {56 vars in 1124 bytes} [Tue Jul 5 21:10:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:17.696564 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3871533-2e9e-4f82-8c9a-a57dbf3110ed None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:17.720503 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:17.755354 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43199a19-240f-430e-a0f3-bf4eb0436303 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:17.756809 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43199a19-240f-430e-a0f3-bf4eb0436303 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:17.814105 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3871533-2e9e-4f82-8c9a-a57dbf3110ed None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:17.863762 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58db080-4ebc-4029-8ccc-3c2c97e6214c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:17.864696 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58db080-4ebc-4029-8ccc-3c2c97e6214c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:17.865020 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58db080-4ebc-4029-8ccc-3c2c97e6214c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:17.865696 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58db080-4ebc-4029-8ccc-3c2c97e6214c None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:17.866716 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58db080-4ebc-4029-8ccc-3c2c97e6214c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:17.867041 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58db080-4ebc-4029-8ccc-3c2c97e6214c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:17.869442 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58db080-4ebc-4029-8ccc-3c2c97e6214c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:17.878401 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 358/703] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:10:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:10:17.881535 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43199a19-240f-430e-a0f3-bf4eb0436303 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:17.882508 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 346/704] 10.222.0.13 () {56 vars in 1124 bytes} [Tue Jul 5 21:10:17 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:17.964659 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:18.002379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43199a19-240f-430e-a0f3-bf4eb0436303 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:18.042133 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e9999-34ef-4d7a-a32a-edd0008a0f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:18.043077 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e9999-34ef-4d7a-a32a-edd0008a0f7c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:18.043367 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e9999-34ef-4d7a-a32a-edd0008a0f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:18.043647 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e9999-34ef-4d7a-a32a-edd0008a0f7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:18.049110 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4d218-5341-4b5c-8c23-7418ff4a23bb None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:18.049396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4d218-5341-4b5c-8c23-7418ff4a23bb None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:18.049678 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4d218-5341-4b5c-8c23-7418ff4a23bb None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:18.051060 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 347/705] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:10:18.056484 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb82f06-f9b5-4132-935c-97fed5b22e27 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:18.056779 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb82f06-f9b5-4132-935c-97fed5b22e27 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:18.057063 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb82f06-f9b5-4132-935c-97fed5b22e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:18.059285 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e9999-34ef-4d7a-a32a-edd0008a0f7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:18.060947 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e9999-34ef-4d7a-a32a-edd0008a0f7c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:18.080249 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-dfb82f06-f9b5-4132-935c-97fed5b22e27 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:18.081433 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-1f8e9999-34ef-4d7a-a32a-edd0008a0f7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:18.081433 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:18.081433 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:18.081433 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:18.081433 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:18.081433 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:18.081433 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:18.081433 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:18.081433 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:18.081433 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:18.081433 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:18.081433 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:18.081433 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:18.081433 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:18.081433 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:18.082340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:18.082340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:18.082340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:18.082340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:18.082340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:18.082340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:18.082340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:18.082340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:18.082340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:18.082340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:18.082340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:18.082340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:18.082340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:18.082340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:18.082340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:18.082340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:18.082340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:18.083246 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:18.083246 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:18.083246 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:18.083246 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:18.083500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-dfb82f06-f9b5-4132-935c-97fed5b22e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:18.083573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 359/706] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:18.091950 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e9999-34ef-4d7a-a32a-edd0008a0f7c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:18.146498 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:18.189711 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 348/707] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:10:18.226358 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e9999-34ef-4d7a-a32a-edd0008a0f7c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:18.230346 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb82f06-f9b5-4132-935c-97fed5b22e27 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:18.270372 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:18.303070 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683aa83-695b-40fb-8233-3b81d11ccdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:18.304130 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683aa83-695b-40fb-8233-3b81d11ccdf8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:18.304597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683aa83-695b-40fb-8233-3b81d11ccdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:18.305098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683aa83-695b-40fb-8233-3b81d11ccdf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:18.306000 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683aa83-695b-40fb-8233-3b81d11ccdf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:18.306535 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683aa83-695b-40fb-8233-3b81d11ccdf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:18.308733 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683aa83-695b-40fb-8233-3b81d11ccdf8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:18.338491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 360/708] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:18.341194 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683aa83-695b-40fb-8233-3b81d11ccdf8 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:18.427583 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb82f06-f9b5-4132-935c-97fed5b22e27 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:18.504348 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b23015-29a2-437d-938d-9c93096ab36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:18.505525 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b23015-29a2-437d-938d-9c93096ab36c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:18.506022 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b23015-29a2-437d-938d-9c93096ab36c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:18.506537 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b23015-29a2-437d-938d-9c93096ab36c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:18.521198 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683aa83-695b-40fb-8233-3b81d11ccdf8 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:18.527459 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b23015-29a2-437d-938d-9c93096ab36c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:18.529234 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b23015-29a2-437d-938d-9c93096ab36c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:18.570899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-b5b23015-29a2-437d-938d-9c93096ab36c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:18.570899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:18.570899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:18.570899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:18.570899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:18.570899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:18.570899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:18.570899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:18.570899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:18.570899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:18.570899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:18.570899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:18.570899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:18.570899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:18.570899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:18.571947 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:18.571947 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:18.571947 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:18.571947 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:18.571947 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:18.571947 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:18.571947 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:18.571947 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:18.571947 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:18.571947 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:18.571947 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:18.571947 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:18.571947 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:18.571947 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:18.571947 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:18.571947 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:18.571947 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:18.573784 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:18.573784 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:18.573784 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:18.573784 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:18.573784 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 349/709] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:18.579801 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b23015-29a2-437d-938d-9c93096ab36c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:18.581323 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc72430-afab-4ed8-b4c8-6f70a0e8940c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:18.582150 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc72430-afab-4ed8-b4c8-6f70a0e8940c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:18.582442 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc72430-afab-4ed8-b4c8-6f70a0e8940c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:18.582719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc72430-afab-4ed8-b4c8-6f70a0e8940c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:18.594246 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc72430-afab-4ed8-b4c8-6f70a0e8940c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:18.595718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc72430-afab-4ed8-b4c8-6f70a0e8940c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:18.614505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-efc72430-afab-4ed8-b4c8-6f70a0e8940c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:18.614505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:18.614505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:18.614505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:18.614505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:18.614505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:18.614505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:18.614505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:18.614505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:18.614505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:18.614505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:18.614505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:18.614505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:10:18.614505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:10:18.614505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:10:18.615506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:10:18.615506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:18.615506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:18.615506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:18.615506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:18.615506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:18.615506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:18.615506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:18.615506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:18.615506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:18.615506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:18.615506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:18.615506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:18.615506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:18.615506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:18.615506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:18.615506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:18.616416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:10:18.616416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:10:18.616416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:10:18.616416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:10:18.616416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:10:18.616416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:10:18.616416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:18.616416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:18.618824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 361/710] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:18.620338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90c228-2a4e-4de0-854d-bdc63adae725 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:18.620836 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90c228-2a4e-4de0-854d-bdc63adae725 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:18.621422 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90c228-2a4e-4de0-854d-bdc63adae725 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:18.626955 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 362/711] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:18.626955 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90c228-2a4e-4de0-854d-bdc63adae725 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:18.631368 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:18.685705 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:18.708452 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b23015-29a2-437d-938d-9c93096ab36c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:18.752927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b611d-be89-4536-a499-0e20b581086c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:18.753936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b611d-be89-4536-a499-0e20b581086c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:18.754517 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b611d-be89-4536-a499-0e20b581086c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:18.755007 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b611d-be89-4536-a499-0e20b581086c None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:18.755921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b611d-be89-4536-a499-0e20b581086c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:18.756420 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b611d-be89-4536-a499-0e20b581086c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:18.758196 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b611d-be89-4536-a499-0e20b581086c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:18.759403 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90c228-2a4e-4de0-854d-bdc63adae725 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:18.775706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 350/712] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:18.777908 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f943d-cfe5-4fb9-bd05-5a8a9432daa3 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:18.778526 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f943d-cfe5-4fb9-bd05-5a8a9432daa3 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:18.779004 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f943d-cfe5-4fb9-bd05-5a8a9432daa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:18.796484 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-889f943d-cfe5-4fb9-bd05-5a8a9432daa3 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:18.797550 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21b254-a927-4577-9a32-2c6a3cb107fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:18.798263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21b254-a927-4577-9a32-2c6a3cb107fe None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:18.798551 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21b254-a927-4577-9a32-2c6a3cb107fe None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:18.798656 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-889f943d-cfe5-4fb9-bd05-5a8a9432daa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:18.798851 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21b254-a927-4577-9a32-2c6a3cb107fe None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:18.799668 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21b254-a927-4577-9a32-2c6a3cb107fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:18.800035 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21b254-a927-4577-9a32-2c6a3cb107fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:18.801523 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21b254-a927-4577-9a32-2c6a3cb107fe None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:18.819170 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 363/713] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:10:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:18.820086 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21b254-a927-4577-9a32-2c6a3cb107fe None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:18.878185 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 351/714] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:10:18.879834 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f943d-cfe5-4fb9-bd05-5a8a9432daa3 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:18.927383 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:18.928309 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:18.932449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21b254-a927-4577-9a32-2c6a3cb107fe None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:18.971842 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e884b6b-f376-4d91-96ce-143f4422ec60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:18.972518 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e884b6b-f376-4d91-96ce-143f4422ec60 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:18.972800 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e884b6b-f376-4d91-96ce-143f4422ec60 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:18.973063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e884b6b-f376-4d91-96ce-143f4422ec60 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:18.973763 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e884b6b-f376-4d91-96ce-143f4422ec60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:18.975241 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e884b6b-f376-4d91-96ce-143f4422ec60 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:19.022287 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f943d-cfe5-4fb9-bd05-5a8a9432daa3 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:19.058648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bee36b-48b9-4f04-9975-dbcb5d2aa5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:19.059634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bee36b-48b9-4f04-9975-dbcb5d2aa5af None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:19.060113 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bee36b-48b9-4f04-9975-dbcb5d2aa5af None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:19.060617 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bee36b-48b9-4f04-9975-dbcb5d2aa5af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:19.061647 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bee36b-48b9-4f04-9975-dbcb5d2aa5af None admin] RBAC: Adding query filter params (role.id=15cf04fec8c6477088a33bf286f1bbdb, scope.project.id=1076c94b43b2483eb4fc06173f9204c3, user.id=910cd341df8943f18af2765e2a30b238) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:19.062229 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bee36b-48b9-4f04-9975-dbcb5d2aa5af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:19.063966 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bee36b-48b9-4f04-9975-dbcb5d2aa5af None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:19.072314 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 364/715] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 21:10:18 2022] POST /identity/v3/users => generated 254 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:10:19.074459 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e884b6b-f376-4d91-96ce-143f4422ec60 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:19.080789 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 352/716] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:10:18 2022] GET /identity/v3/role_assignments?user.id=910cd341df8943f18af2765e2a30b238&scope.project.id=1076c94b43b2483eb4fc06173f9204c3&role.id=15cf04fec8c6477088a33bf286f1bbdb => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:19.205508 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e884b6b-f376-4d91-96ce-143f4422ec60 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:19.262235 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab3e52-d70f-44c9-8e97-f994306323bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:19.263501 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab3e52-d70f-44c9-8e97-f994306323bd None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:19.263983 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab3e52-d70f-44c9-8e97-f994306323bd None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:19.264500 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab3e52-d70f-44c9-8e97-f994306323bd None admin] PATH_INFO: `/v3/services/network` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:19.265726 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab3e52-d70f-44c9-8e97-f994306323bd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:19.267521 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab3e52-d70f-44c9-8e97-f994306323bd None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:19.287756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-94ab3e52-d70f-44c9-8e97-f994306323bd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:10:19.287756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:19.287756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:10:19.287756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:10:19.287756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:10:19.287756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:10:19.287756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:10:19.287756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:19.287756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:10:19.287756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:19.287756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:10:19.287756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:19.287756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:19.287756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:19.287756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:19.287756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:19.287756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:19.288824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:19.288824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:19.288824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:19.288824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:19.288824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:19.288824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:19.288824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:10:19.288824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:10:19.288824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:10:19.288824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:10:19.288824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:19.288824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:19.288824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:19.288824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:19.288824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:19.288824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:19.289735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:19.289735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:19.289735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:19.289735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:19.289735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:19.289735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:19.289735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:19.289735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:19.289735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:19.289735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:19.289735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:10:19.289735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:19.289735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:10:19.289735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:19.293396 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 365/717] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:19 2022] GET /identity/v3/services/network => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:19.300812 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bee36b-48b9-4f04-9975-dbcb5d2aa5af None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:19.403961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:19.416447 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bee36b-48b9-4f04-9975-dbcb5d2aa5af None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:19.452934 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ffd08-4dd7-44ef-b289-1c1613a6b9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:19.453599 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ffd08-4dd7-44ef-b289-1c1613a6b9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:19.453875 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ffd08-4dd7-44ef-b289-1c1613a6b9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:19.454189 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ffd08-4dd7-44ef-b289-1c1613a6b9a1 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:19.454901 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ffd08-4dd7-44ef-b289-1c1613a6b9a1 None admin] RBAC: Adding query filter params (name=network) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:19.455206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ffd08-4dd7-44ef-b289-1c1613a6b9a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:19.456564 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ffd08-4dd7-44ef-b289-1c1613a6b9a1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:19.461330 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 353/718] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Jul 5 21:10:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:19.467827 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab3e52-d70f-44c9-8e97-f994306323bd None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:19.492064 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:19.581565 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab3e52-d70f-44c9-8e97-f994306323bd None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:19.629074 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ddd34f-d136-4f28-b5a4-71cda2ba8109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:19.629797 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ddd34f-d136-4f28-b5a4-71cda2ba8109 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:19.630030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ddd34f-d136-4f28-b5a4-71cda2ba8109 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:19.630326 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ddd34f-d136-4f28-b5a4-71cda2ba8109 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:19.631036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ddd34f-d136-4f28-b5a4-71cda2ba8109 None admin] RBAC: Adding query filter params (type=network) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:19.631337 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ddd34f-d136-4f28-b5a4-71cda2ba8109 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:19.632718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ddd34f-d136-4f28-b5a4-71cda2ba8109 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:19.641018 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 366/719] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Jul 5 21:10:19 2022] GET /identity/v3/services?type=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:20.223488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f0c9b-1e8d-4f59-944d-baf7a167758b None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:20.224013 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f0c9b-1e8d-4f59-944d-baf7a167758b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:20.224013 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f0c9b-1e8d-4f59-944d-baf7a167758b None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:20.225618 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 354/720] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:20.231202 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cca78-3571-4d23-b0ac-4166fe5d9483 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:20.231736 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cca78-3571-4d23-b0ac-4166fe5d9483 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:20.231736 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cca78-3571-4d23-b0ac-4166fe5d9483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:20.232034 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e576f-87a1-4b9b-8560-a2c907b56564 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:20.232244 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e576f-87a1-4b9b-8560-a2c907b56564 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:20.232527 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e576f-87a1-4b9b-8560-a2c907b56564 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:20.234153 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 355/721] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:20.240463 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace2b7d-73e3-4d9e-a508-038575503258 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:20.240745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace2b7d-73e3-4d9e-a508-038575503258 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:20.241024 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace2b7d-73e3-4d9e-a508-038575503258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:20.251179 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-791cca78-3571-4d23-b0ac-4166fe5d9483 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:20.252382 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-791cca78-3571-4d23-b0ac-4166fe5d9483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:20.268222 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-9ace2b7d-73e3-4d9e-a508-038575503258 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:20.269406 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9ace2b7d-73e3-4d9e-a508-038575503258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:20.380331 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 367/722] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:10:20.402501 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cca78-3571-4d23-b0ac-4166fe5d9483 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:20.403735 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 356/723] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:10:20.427816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace2b7d-73e3-4d9e-a508-038575503258 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:20.428167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:20.527400 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cca78-3571-4d23-b0ac-4166fe5d9483 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:20.564158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2702a-655e-4b06-8c6d-d52065194407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:20.565150 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2702a-655e-4b06-8c6d-d52065194407 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:20.565636 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2702a-655e-4b06-8c6d-d52065194407 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:20.566103 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2702a-655e-4b06-8c6d-d52065194407 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:20.567368 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2702a-655e-4b06-8c6d-d52065194407 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:20.569527 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2702a-655e-4b06-8c6d-d52065194407 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:20.588716 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:20.607630 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace2b7d-73e3-4d9e-a508-038575503258 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:20.644718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598b582-e4fd-496c-9d70-074fa71e924a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:20.645901 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598b582-e4fd-496c-9d70-074fa71e924a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:20.646432 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598b582-e4fd-496c-9d70-074fa71e924a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:20.646951 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598b582-e4fd-496c-9d70-074fa71e924a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:20.658241 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598b582-e4fd-496c-9d70-074fa71e924a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:10:20.666319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-c598b582-e4fd-496c-9d70-074fa71e924a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:10:20.666319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:20.666319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:20.666319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:20.666319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:20.666319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:20.666319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:20.666319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:20.666319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:20.666319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:20.666319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:20.666319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:20.666319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:10:20.666319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:10:20.666319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:10:20.666319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:10:20.667794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:10:20.667794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:10:20.667794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:10:20.667794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:10:20.667794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:20.667794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:20.667794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:20.667794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:20.667794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:20.667794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:20.667794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:20.667794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:20.667794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:20.667794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:20.667794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:20.667794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:20.668647 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:20.668647 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:20.668647 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:20.668647 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:20.668647 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:10:20.668647 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:10:20.668647 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:10:20.668647 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:10:20.668647 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:10:20.668647 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:10:20.668647 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:10:20.668647 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:20.671375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 357/724] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:10:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:20.678317 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598b582-e4fd-496c-9d70-074fa71e924a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:20.684311 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 368/725] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Jul 5 21:10:20 2022] POST /identity/v3/services => generated 251 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:10:20.826691 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598b582-e4fd-496c-9d70-074fa71e924a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:20.899364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556ef9e-1139-484f-86bc-338e266808b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:20.900040 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556ef9e-1139-484f-86bc-338e266808b2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:20.900325 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556ef9e-1139-484f-86bc-338e266808b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:20.901172 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556ef9e-1139-484f-86bc-338e266808b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:20.902090 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556ef9e-1139-484f-86bc-338e266808b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:20.902430 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556ef9e-1139-484f-86bc-338e266808b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:20.903833 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556ef9e-1139-484f-86bc-338e266808b2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:20.910440 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:20.915391 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 358/726] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:10:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:20.922197 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2702a-655e-4b06-8c6d-d52065194407 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:21.004042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:21.031198 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2702a-655e-4b06-8c6d-d52065194407 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:21.071284 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef483655-e3e6-45c2-881e-850a453dfbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:21.072094 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef483655-e3e6-45c2-881e-850a453dfbd9 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:21.072377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef483655-e3e6-45c2-881e-850a453dfbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:21.073488 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef483655-e3e6-45c2-881e-850a453dfbd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:21.092439 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef483655-e3e6-45c2-881e-850a453dfbd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:21.093834 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef483655-e3e6-45c2-881e-850a453dfbd9 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:21.117562 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-ef483655-e3e6-45c2-881e-850a453dfbd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:21.117562 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:21.117562 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:21.117562 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:21.117562 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:21.117562 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:21.117562 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:21.117562 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:21.117562 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:21.117562 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:21.117562 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:21.117562 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:21.117562 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:21.117562 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:21.117562 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:21.118567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:21.118567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:21.118567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:21.118567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:21.118567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:21.118567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:21.118567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:21.118567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:21.118567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:21.118567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:21.118567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:21.118567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:21.118567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:21.118567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:21.118567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:21.118567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:21.118567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:21.119901 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:21.119901 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:21.119901 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:21.119901 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:21.119901 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 369/727] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:21.125341 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556ef9e-1139-484f-86bc-338e266808b2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:21.285893 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556ef9e-1139-484f-86bc-338e266808b2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:21.328737 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5c978-ce9e-40a5-97b1-7e5cde60e44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:21.329409 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5c978-ce9e-40a5-97b1-7e5cde60e44c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:21.329697 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5c978-ce9e-40a5-97b1-7e5cde60e44c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:21.329981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5c978-ce9e-40a5-97b1-7e5cde60e44c None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:21.330743 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5c978-ce9e-40a5-97b1-7e5cde60e44c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:21.331055 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5c978-ce9e-40a5-97b1-7e5cde60e44c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:21.332427 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5c978-ce9e-40a5-97b1-7e5cde60e44c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:21.349441 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 359/728] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:21.354631 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef483655-e3e6-45c2-881e-850a453dfbd9 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:21.493502 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef483655-e3e6-45c2-881e-850a453dfbd9 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:21.520280 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:21.529513 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7aacab-8997-41e1-a3da-f8a8f9d37053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:21.530342 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7aacab-8997-41e1-a3da-f8a8f9d37053 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:21.530631 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7aacab-8997-41e1-a3da-f8a8f9d37053 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:21.530910 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7aacab-8997-41e1-a3da-f8a8f9d37053 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:21.538777 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7aacab-8997-41e1-a3da-f8a8f9d37053 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:21.540234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7aacab-8997-41e1-a3da-f8a8f9d37053 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:21.554789 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-cc7aacab-8997-41e1-a3da-f8a8f9d37053 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:10:21.554789 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:21.554789 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:21.554789 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:21.554789 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:21.554789 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:21.554789 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:21.554789 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:21.554789 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:21.554789 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:21.554789 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:21.554789 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:21.554789 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:10:21.554789 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:10:21.554789 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:10:21.554789 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:10:21.555783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:21.555783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:21.555783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:10:21.555783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:21.555783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:10:21.555783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:21.555783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:21.555783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:21.555783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:21.555783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:21.555783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:21.555783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:21.555783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:21.555783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:21.555783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:21.555783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:21.555783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:21.555783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:21.557259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:21.557259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:21.557259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:10:21.557259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:10:21.557259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:10:21.557259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:10:21.557259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:10:21.557259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:10:21.557259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:10:21.557259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:21.557259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 370/729] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:10:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:21.563027 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5c978-ce9e-40a5-97b1-7e5cde60e44c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:21.651951 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:21.708857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5c978-ce9e-40a5-97b1-7e5cde60e44c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:21.760773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73edda5-b22c-4918-ba03-803c8f12a7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:21.761445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73edda5-b22c-4918-ba03-803c8f12a7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:21.761727 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73edda5-b22c-4918-ba03-803c8f12a7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:21.762002 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73edda5-b22c-4918-ba03-803c8f12a7d3 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:21.762868 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73edda5-b22c-4918-ba03-803c8f12a7d3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:21.763177 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73edda5-b22c-4918-ba03-803c8f12a7d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:21.764849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73edda5-b22c-4918-ba03-803c8f12a7d3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:21.783564 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14674a8a-b75d-456e-b0c4-c0fed397bbd6 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:21.783861 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14674a8a-b75d-456e-b0c4-c0fed397bbd6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:21.784121 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14674a8a-b75d-456e-b0c4-c0fed397bbd6 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:21.785742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 371/730] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:21.792661 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 360/731] 10.222.0.13 () {56 vars in 1135 bytes} [Tue Jul 5 21:10:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:21.793188 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f146e6-de18-4038-b1d3-bbf45b73fd52 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:21.793479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f146e6-de18-4038-b1d3-bbf45b73fd52 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:21.793756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f146e6-de18-4038-b1d3-bbf45b73fd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:21.798293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73edda5-b22c-4918-ba03-803c8f12a7d3 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:21.824092 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-77f146e6-de18-4038-b1d3-bbf45b73fd52 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:21.825289 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-77f146e6-de18-4038-b1d3-bbf45b73fd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:21.903523 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73edda5-b22c-4918-ba03-803c8f12a7d3 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:21.905644 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 372/732] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:21 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:10:21.942224 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f146e6-de18-4038-b1d3-bbf45b73fd52 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:21.943346 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:21.962497 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674112ff-318a-485a-a1b6-441297e51bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:21.963439 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674112ff-318a-485a-a1b6-441297e51bcb None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:21.963789 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674112ff-318a-485a-a1b6-441297e51bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:21.964292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674112ff-318a-485a-a1b6-441297e51bcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:22.085109 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674112ff-318a-485a-a1b6-441297e51bcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:22.087384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674112ff-318a-485a-a1b6-441297e51bcb None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:22.089164 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f146e6-de18-4038-b1d3-bbf45b73fd52 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:22.106940 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:22.127680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d3957-8589-4934-9cc7-1262bedad6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:22.130328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d3957-8589-4934-9cc7-1262bedad6ef None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:22.130328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d3957-8589-4934-9cc7-1262bedad6ef None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:22.130328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d3957-8589-4934-9cc7-1262bedad6ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:22.142564 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d3957-8589-4934-9cc7-1262bedad6ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:10:22.153300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-481d3957-8589-4934-9cc7-1262bedad6ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:10:22.153300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:22.153300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:22.153300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:22.153300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:22.153300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:22.153300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:22.153300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:22.153300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:22.153300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:22.153300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:22.153300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:22.153300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:10:22.153300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:10:22.153300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:10:22.153300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:10:22.154525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:10:22.154525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:10:22.154525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:10:22.154525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:10:22.154525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:22.154525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:22.154525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:22.154525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:22.154525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:22.154525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:22.154525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:22.154525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:22.154525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:22.154525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:22.154525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:22.154525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:22.155584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:22.155584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:22.155584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:22.155584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:22.155584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:10:22.155584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:10:22.155584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:10:22.155584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:10:22.155584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:10:22.155584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:10:22.155584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:10:22.155584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:22.158278 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 373/733] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:10:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:22.160011 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b6370-0208-4a55-bd56-e379bf73d8f6 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:22.160299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b6370-0208-4a55-bd56-e379bf73d8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:22.160578 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b6370-0208-4a55-bd56-e379bf73d8f6 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:22.164513 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 374/734] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:22.165104 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b6370-0208-4a55-bd56-e379bf73d8f6 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:22.224359 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 361/735] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:10:21 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 21:10:22.230670 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e3e82-944f-496a-92fb-57ca053a4ba0 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:22.230964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e3e82-944f-496a-92fb-57ca053a4ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:22.231244 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e3e82-944f-496a-92fb-57ca053a4ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:22.247447 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-2a4e3e82-944f-496a-92fb-57ca053a4ba0 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:22.248652 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2a4e3e82-944f-496a-92fb-57ca053a4ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:22.261923 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:22.292926 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b6370-0208-4a55-bd56-e379bf73d8f6 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:22.324039 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 362/736] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:22 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:10:22.326034 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8eaab-b05d-43d1-9f22-b21448fbee92 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:22.326425 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8eaab-b05d-43d1-9f22-b21448fbee92 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:22.326702 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8eaab-b05d-43d1-9f22-b21448fbee92 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:22.328138 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 363/737] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:22.332579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8eaab-b05d-43d1-9f22-b21448fbee92 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:22.334711 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f8389-0844-44b6-bfc2-fe0a59581308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:22.335685 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f8389-0844-44b6-bfc2-fe0a59581308 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:22.336213 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f8389-0844-44b6-bfc2-fe0a59581308 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:22.336562 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f8389-0844-44b6-bfc2-fe0a59581308 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:22.337417 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f8389-0844-44b6-bfc2-fe0a59581308 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:22.337794 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f8389-0844-44b6-bfc2-fe0a59581308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:22.339858 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f8389-0844-44b6-bfc2-fe0a59581308 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:22.354854 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 375/738] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:10:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:22.356302 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4dd289-4521-415f-ae06-28bfa089d484 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:22.356600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4dd289-4521-415f-ae06-28bfa089d484 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:22.356884 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4dd289-4521-415f-ae06-28bfa089d484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:22.373876 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-bc4dd289-4521-415f-ae06-28bfa089d484 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:22.375120 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-bc4dd289-4521-415f-ae06-28bfa089d484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:22.410754 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:22.450448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 376/739] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:22 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:10:22.450898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8eaab-b05d-43d1-9f22-b21448fbee92 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:22.451337 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4dd289-4521-415f-ae06-28bfa089d484 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:22.498745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b232b9-2ac6-41c1-9ced-a7a49ca71319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:22.499820 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b232b9-2ac6-41c1-9ced-a7a49ca71319 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:22.500279 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b232b9-2ac6-41c1-9ced-a7a49ca71319 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:22.500727 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b232b9-2ac6-41c1-9ced-a7a49ca71319 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:22.513237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b232b9-2ac6-41c1-9ced-a7a49ca71319 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:22.515761 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b232b9-2ac6-41c1-9ced-a7a49ca71319 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:22.525506 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:22.534726 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-51b232b9-2ac6-41c1-9ced-a7a49ca71319 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:22.534726 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:22.534726 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:22.534726 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:22.534726 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:22.534726 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:22.534726 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:22.534726 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:22.534726 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:22.534726 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:22.534726 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:22.534726 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:22.534726 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:22.534726 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:22.534726 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:22.547718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:22.547718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:22.547718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:22.547718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:22.547718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:22.547718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:22.547718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:22.547718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:22.547718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:22.547718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:22.547718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:22.547718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:22.547718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:22.547718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:22.547718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:22.547718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:22.547718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:22.548657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:22.548657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:22.548657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:22.548657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:22.548657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 364/740] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:22.548657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b232b9-2ac6-41c1-9ced-a7a49ca71319 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:22.578155 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4dd289-4521-415f-ae06-28bfa089d484 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:22.622959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55f6a6-b9b7-48a5-96b1-ab565bdf96df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:22.624022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55f6a6-b9b7-48a5-96b1-ab565bdf96df None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:22.624306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55f6a6-b9b7-48a5-96b1-ab565bdf96df None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:22.624828 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55f6a6-b9b7-48a5-96b1-ab565bdf96df None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:22.638974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55f6a6-b9b7-48a5-96b1-ab565bdf96df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:10:22.644200 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b232b9-2ac6-41c1-9ced-a7a49ca71319 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:22.648877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-7b55f6a6-b9b7-48a5-96b1-ab565bdf96df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:10:22.648877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:22.648877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:22.648877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:22.648877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:22.648877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:22.648877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:22.648877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:22.648877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:22.648877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:22.648877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:22.648877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:22.648877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:10:22.648877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:10:22.648877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:10:22.648877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:10:22.649806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:10:22.649806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:10:22.649806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:10:22.649806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:10:22.649806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:22.649806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:22.649806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:22.649806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:22.649806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:22.649806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:22.649806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:22.649806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:22.649806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:22.649806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:22.649806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:22.649806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:22.661560 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:22.661560 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:22.661560 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:22.661560 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:22.661560 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:10:22.661560 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:10:22.661560 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:10:22.661560 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:10:22.661560 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:10:22.661560 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:10:22.661560 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:10:22.661560 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:22.661560 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 377/741] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 21:10:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:22.661560 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55f6a6-b9b7-48a5-96b1-ab565bdf96df None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:22.680447 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cf31c-73ec-4315-b767-a2f440d1ff86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:22.681233 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cf31c-73ec-4315-b767-a2f440d1ff86 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:22.681515 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cf31c-73ec-4315-b767-a2f440d1ff86 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:22.682709 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cf31c-73ec-4315-b767-a2f440d1ff86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:22.690645 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:22.694612 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3cf31c-73ec-4315-b767-a2f440d1ff86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:22.696239 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3cf31c-73ec-4315-b767-a2f440d1ff86 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:22.714375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-5e3cf31c-73ec-4315-b767-a2f440d1ff86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:22.714375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:22.714375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:22.714375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:22.714375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:22.714375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:22.714375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:22.714375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:22.714375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:22.714375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:22.714375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:22.714375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:22.714375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:22.714375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:22.714375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:22.716037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:22.716037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:22.716037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:22.716037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:22.716037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:22.716037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:22.716037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:22.716037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:22.716037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:22.716037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:22.716037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:22.716037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:22.716037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:22.716037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:22.716037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:22.716037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:22.716037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:22.716964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:22.716964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:22.716964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:22.716964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:22.717765 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 365/742] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:22.718578 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cf31c-73ec-4315-b767-a2f440d1ff86 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:22.769665 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55f6a6-b9b7-48a5-96b1-ab565bdf96df None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:22.777051 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:22.805853 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f938d-9af6-4fac-b56a-4561d3448dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:22.806553 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f938d-9af6-4fac-b56a-4561d3448dd9 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:22.807508 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f938d-9af6-4fac-b56a-4561d3448dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:22.807801 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f938d-9af6-4fac-b56a-4561d3448dd9 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:22.808522 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f938d-9af6-4fac-b56a-4561d3448dd9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:22.809891 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f938d-9af6-4fac-b56a-4561d3448dd9 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:22.829815 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cf31c-73ec-4315-b767-a2f440d1ff86 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:22.863779 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f306a5b-0a4d-419b-b947-ef4c183fb17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:22.864432 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f306a5b-0a4d-419b-b947-ef4c183fb17e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:22.864750 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f306a5b-0a4d-419b-b947-ef4c183fb17e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:22.865030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f306a5b-0a4d-419b-b947-ef4c183fb17e None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:22.865750 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f306a5b-0a4d-419b-b947-ef4c183fb17e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:22.866056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f306a5b-0a4d-419b-b947-ef4c183fb17e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:22.867457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f306a5b-0a4d-419b-b947-ef4c183fb17e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:22.882514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 378/743] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Jul 5 21:10:22 2022] POST /identity/v3/services => generated 240 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:10:22.883498 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f938d-9af6-4fac-b56a-4561d3448dd9 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:22.886943 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 366/744] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:22.886943 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f306a5b-0a4d-419b-b947-ef4c183fb17e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:22.998197 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f306a5b-0a4d-419b-b947-ef4c183fb17e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:23.002754 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:23.013835 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:23.024257 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f938d-9af6-4fac-b56a-4561d3448dd9 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:23.039061 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034c897-6ef6-4a84-b156-3d082bdc4bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:23.039992 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034c897-6ef6-4a84-b156-3d082bdc4bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:23.040450 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034c897-6ef6-4a84-b156-3d082bdc4bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:23.040969 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034c897-6ef6-4a84-b156-3d082bdc4bc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:23.042063 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034c897-6ef6-4a84-b156-3d082bdc4bc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:23.042417 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034c897-6ef6-4a84-b156-3d082bdc4bc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:23.043797 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034c897-6ef6-4a84-b156-3d082bdc4bc0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:23.065716 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 367/745] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:23.066769 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034c897-6ef6-4a84-b156-3d082bdc4bc0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:23.067175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6542bc-512a-42e4-a9af-0baa35326b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:23.067806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6542bc-512a-42e4-a9af-0baa35326b5b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:23.068111 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6542bc-512a-42e4-a9af-0baa35326b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:23.068391 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6542bc-512a-42e4-a9af-0baa35326b5b None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:23.069146 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6542bc-512a-42e4-a9af-0baa35326b5b None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:23.069455 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6542bc-512a-42e4-a9af-0baa35326b5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:23.071751 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6542bc-512a-42e4-a9af-0baa35326b5b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:23.084392 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 379/746] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 21:10:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:23.085173 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6542bc-512a-42e4-a9af-0baa35326b5b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:23.195353 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034c897-6ef6-4a84-b156-3d082bdc4bc0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:23.221617 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6542bc-512a-42e4-a9af-0baa35326b5b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:23.232941 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06279b43-bfc3-4a5a-82cf-0fe290371369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:23.233992 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06279b43-bfc3-4a5a-82cf-0fe290371369 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:23.234468 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06279b43-bfc3-4a5a-82cf-0fe290371369 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:23.234889 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06279b43-bfc3-4a5a-82cf-0fe290371369 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:23.242255 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06279b43-bfc3-4a5a-82cf-0fe290371369 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:23.245090 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06279b43-bfc3-4a5a-82cf-0fe290371369 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:23.261078 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-06279b43-bfc3-4a5a-82cf-0fe290371369 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:23.261078 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:23.261078 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:23.261078 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:23.261078 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:23.261078 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:23.261078 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:23.261078 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:23.261078 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:23.261078 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:23.261078 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:23.261078 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:23.261078 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:10:23.261078 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:10:23.261078 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:10:23.262332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:10:23.262332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:23.262332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:23.262332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:23.262332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:23.262332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:23.262332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:23.262332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:23.262332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:23.262332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:23.262332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:23.262332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:23.262332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:23.262332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:23.262332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:23.262332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:23.262332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:23.263493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:10:23.263493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:10:23.263493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:10:23.263493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:10:23.263493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:10:23.263493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:10:23.263493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:23.263493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:23.264429 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868331a-87a3-4664-933a-815bc542ecf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:23.265547 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868331a-87a3-4664-933a-815bc542ecf9 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:23.265896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868331a-87a3-4664-933a-815bc542ecf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:23.266267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868331a-87a3-4664-933a-815bc542ecf9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:23.266961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 368/747] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:23.268073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06279b43-bfc3-4a5a-82cf-0fe290371369 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:23.276349 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868331a-87a3-4664-933a-815bc542ecf9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:23.278535 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868331a-87a3-4664-933a-815bc542ecf9 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:23.298167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-3868331a-87a3-4664-933a-815bc542ecf9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:10:23.298167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:23.298167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:23.298167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:23.298167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:23.298167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:23.298167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:23.298167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:23.298167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:23.298167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:23.298167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:23.298167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:23.298167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:10:23.298167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:10:23.298167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:10:23.298167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:10:23.299182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:23.299182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:23.299182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:10:23.299182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:23.299182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:10:23.299182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:23.299182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:23.299182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:23.299182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:23.299182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:23.299182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:23.299182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:23.299182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:23.299182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:23.299182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:23.299182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:23.299182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:23.299182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:23.300138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:23.300138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:23.300138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:10:23.300138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:10:23.300138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:10:23.300138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:10:23.300138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:10:23.300138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:10:23.300138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:10:23.300138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:23.300138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 380/748] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Jul 5 21:10:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:23.300738 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868331a-87a3-4664-933a-815bc542ecf9 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:23.305212 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:23.313236 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:23.377674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06279b43-bfc3-4a5a-82cf-0fe290371369 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:23.412804 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868331a-87a3-4664-933a-815bc542ecf9 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:23.416996 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b578558-fd00-4877-ba6a-8e55550ea93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:23.417865 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b578558-fd00-4877-ba6a-8e55550ea93f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:23.418490 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b578558-fd00-4877-ba6a-8e55550ea93f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:23.419255 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b578558-fd00-4877-ba6a-8e55550ea93f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:23.429374 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b578558-fd00-4877-ba6a-8e55550ea93f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:23.430848 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b578558-fd00-4877-ba6a-8e55550ea93f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:23.449763 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-9b578558-fd00-4877-ba6a-8e55550ea93f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:23.449763 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:23.449763 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:23.449763 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:23.449763 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:23.449763 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:23.449763 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:23.449763 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:23.449763 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:23.449763 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:23.449763 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:23.449763 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:23.449763 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:23.449763 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:23.449763 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:23.450740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:23.450740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:23.450740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:23.450740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:23.450740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:23.450740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:23.450740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:23.450740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:23.450740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:23.450740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:23.450740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:23.450740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:23.450740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:23.450740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:23.450740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:23.450740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:23.450740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:23.451681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:23.451681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:23.451681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:23.451681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:23.451907 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5105e7b-0f10-491b-bb2b-8304f96646d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:23.451907 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5105e7b-0f10-491b-bb2b-8304f96646d2 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:23.451907 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5105e7b-0f10-491b-bb2b-8304f96646d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:23.451907 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5105e7b-0f10-491b-bb2b-8304f96646d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:23.452174 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5105e7b-0f10-491b-bb2b-8304f96646d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:23.452737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5105e7b-0f10-491b-bb2b-8304f96646d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:23.453813 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5105e7b-0f10-491b-bb2b-8304f96646d2 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:23.455521 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 369/749] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:23.456847 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fdf84-bd8a-4a4c-913b-cf987bf93dd3 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:23.457129 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fdf84-bd8a-4a4c-913b-cf987bf93dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:23.457401 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fdf84-bd8a-4a4c-913b-cf987bf93dd3 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:23.458849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 370/750] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:23.463718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fdf84-bd8a-4a4c-913b-cf987bf93dd3 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:23.467875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 381/751] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:10:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:23.472555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5105e7b-0f10-491b-bb2b-8304f96646d2 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:23.537645 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:23.562712 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:23.577732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5105e7b-0f10-491b-bb2b-8304f96646d2 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:23.581094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fdf84-bd8a-4a4c-913b-cf987bf93dd3 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:23.616746 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf4532-8054-46b3-be13-88bb66ceb356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:23.617412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf4532-8054-46b3-be13-88bb66ceb356 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:23.617693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf4532-8054-46b3-be13-88bb66ceb356 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:23.617966 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf4532-8054-46b3-be13-88bb66ceb356 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:23.618740 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf4532-8054-46b3-be13-88bb66ceb356 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:23.619077 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf4532-8054-46b3-be13-88bb66ceb356 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:23.620178 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4aa14-acde-4df7-af71-8e82b63f0c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:23.620491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf4532-8054-46b3-be13-88bb66ceb356 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:23.621190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4aa14-acde-4df7-af71-8e82b63f0c72 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:23.621615 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4aa14-acde-4df7-af71-8e82b63f0c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:23.622351 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4aa14-acde-4df7-af71-8e82b63f0c72 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:23.623451 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab4aa14-acde-4df7-af71-8e82b63f0c72 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:23.623902 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab4aa14-acde-4df7-af71-8e82b63f0c72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:23.625478 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab4aa14-acde-4df7-af71-8e82b63f0c72 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:23.631892 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 382/752] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:23.633148 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea641a-bc68-4651-a4ff-72deed5fcf20 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:23.633437 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea641a-bc68-4651-a4ff-72deed5fcf20 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:23.633717 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea641a-bc68-4651-a4ff-72deed5fcf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:23.645995 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 371/753] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Jul 5 21:10:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:23.647067 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4aa14-acde-4df7-af71-8e82b63f0c72 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:23.653814 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b7ea641a-bc68-4651-a4ff-72deed5fcf20 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:23.655119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b7ea641a-bc68-4651-a4ff-72deed5fcf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:23.731770 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 383/754] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:23.733151 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea641a-bc68-4651-a4ff-72deed5fcf20 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:23.766574 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4aa14-acde-4df7-af71-8e82b63f0c72 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:23.796307 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:23.804079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17051315-816d-4cdf-bf5d-a3a45317f80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:23.804903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17051315-816d-4cdf-bf5d-a3a45317f80f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:23.805336 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17051315-816d-4cdf-bf5d-a3a45317f80f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:23.805780 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17051315-816d-4cdf-bf5d-a3a45317f80f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:23.807398 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17051315-816d-4cdf-bf5d-a3a45317f80f None admin] RBAC: Adding query filter params (role.id=15cf04fec8c6477088a33bf286f1bbdb, scope.project.id=1076c94b43b2483eb4fc06173f9204c3, user.id=441be62a077444b9b9f78714e24a760a) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:23.807955 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17051315-816d-4cdf-bf5d-a3a45317f80f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:23.809531 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17051315-816d-4cdf-bf5d-a3a45317f80f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:23.815414 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 372/755] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:10:23 2022] GET /identity/v3/role_assignments?user.id=441be62a077444b9b9f78714e24a760a&scope.project.id=1076c94b43b2483eb4fc06173f9204c3&role.id=15cf04fec8c6477088a33bf286f1bbdb => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:23.816381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17051315-816d-4cdf-bf5d-a3a45317f80f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:23.832309 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:23.848413 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea641a-bc68-4651-a4ff-72deed5fcf20 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:23.889872 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1325a-376c-425f-b708-0e2aeedb5e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:23.891065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1325a-376c-425f-b708-0e2aeedb5e7b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:23.891349 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1325a-376c-425f-b708-0e2aeedb5e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:23.891825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1325a-376c-425f-b708-0e2aeedb5e7b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:23.902338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1325a-376c-425f-b708-0e2aeedb5e7b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:23.904064 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1325a-376c-425f-b708-0e2aeedb5e7b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:23.925154 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-deb1325a-376c-425f-b708-0e2aeedb5e7b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:10:23.925154 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:23.925154 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:23.925154 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:23.925154 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:23.925154 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:23.925154 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:23.925154 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:23.925154 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:23.925154 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:23.925154 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:23.925154 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:23.925154 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:10:23.925154 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:10:23.925154 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:10:23.925154 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:10:23.926412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:23.926412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:23.926412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:10:23.926412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:23.926412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:10:23.926412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:23.926412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:23.926412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:23.926412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:23.926412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:23.926412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:23.926412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:23.926412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:23.926412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:23.926412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:23.926412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:23.926412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:23.926412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:23.927385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:23.927385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:23.927385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:10:23.927385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:10:23.927385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:10:23.927385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:10:23.927385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:10:23.927385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:10:23.927385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:10:23.927385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:23.930291 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 384/756] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Jul 5 21:10:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:23.931224 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1325a-376c-425f-b708-0e2aeedb5e7b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:23.960378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17051315-816d-4cdf-bf5d-a3a45317f80f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:24.005477 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f1c3e-8665-4231-8126-735cdfe13fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:24.006815 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f1c3e-8665-4231-8126-735cdfe13fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:24.007298 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f1c3e-8665-4231-8126-735cdfe13fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:24.007769 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f1c3e-8665-4231-8126-735cdfe13fc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:24.020666 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f1c3e-8665-4231-8126-735cdfe13fc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:24.022103 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f1c3e-8665-4231-8126-735cdfe13fc9 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:24.040751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-1c1f1c3e-8665-4231-8126-735cdfe13fc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:24.040751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:24.040751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:24.040751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:24.040751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:24.040751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:24.040751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:24.040751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:24.040751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:24.040751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:24.040751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:24.040751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:24.040751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:24.040751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:24.040751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:24.042264 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:24.042264 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:24.042264 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:24.042264 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:24.042264 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:24.042264 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:24.042264 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:24.042264 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:24.042264 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:24.042264 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:24.042264 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:24.042264 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:24.042264 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:24.042264 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:24.042264 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:24.042264 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:24.042264 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:24.043314 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:24.043314 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:24.043314 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:24.043314 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:24.045555 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 373/757] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:24.046679 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f1c3e-8665-4231-8126-735cdfe13fc9 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:24.061893 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1325a-376c-425f-b708-0e2aeedb5e7b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:24.087752 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:24.112121 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d517af-f2a3-4012-89e7-baa666c8e910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:24.113011 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d517af-f2a3-4012-89e7-baa666c8e910 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:24.113215 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d517af-f2a3-4012-89e7-baa666c8e910 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:24.113497 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d517af-f2a3-4012-89e7-baa666c8e910 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:24.114284 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:24.115103 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d517af-f2a3-4012-89e7-baa666c8e910 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:24.116990 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d517af-f2a3-4012-89e7-baa666c8e910 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:24.134239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-61d517af-f2a3-4012-89e7-baa666c8e910 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:10:24.134239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:24.134239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:10:24.134239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:10:24.134239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:10:24.134239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:10:24.134239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:10:24.134239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:24.134239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:10:24.134239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:24.134239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:10:24.134239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:24.134239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:24.134239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:24.134239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:24.134239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:24.136718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:24.136718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:24.136718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:24.136718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:24.136718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:24.136718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:24.136718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:24.136718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:10:24.136718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:10:24.136718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:10:24.136718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:10:24.136718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:24.136718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:24.136718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:24.136718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:24.136718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:24.137605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:24.137605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:24.137605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:24.137605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:24.137605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:24.137605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:24.137605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:24.137605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:24.137605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:24.137605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:24.137605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:24.137605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:10:24.137605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:24.137605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:10:24.137605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:24.137605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 385/758] 10.222.0.13 () {56 vars in 1129 bytes} [Tue Jul 5 21:10:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:24.138517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d517af-f2a3-4012-89e7-baa666c8e910 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:24.166688 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f1c3e-8665-4231-8126-735cdfe13fc9 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:24.204585 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce95852-be24-4785-a60a-ac7d7d0e900c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:24.205673 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce95852-be24-4785-a60a-ac7d7d0e900c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:24.206256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce95852-be24-4785-a60a-ac7d7d0e900c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:24.206744 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce95852-be24-4785-a60a-ac7d7d0e900c None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:24.207792 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce95852-be24-4785-a60a-ac7d7d0e900c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:24.208354 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce95852-be24-4785-a60a-ac7d7d0e900c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:24.209995 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce95852-be24-4785-a60a-ac7d7d0e900c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:24.230192 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 374/759] 10.222.0.13 () {56 vars in 1149 bytes} [Tue Jul 5 21:10:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:24.231417 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce95852-be24-4785-a60a-ac7d7d0e900c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:24.276805 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d517af-f2a3-4012-89e7-baa666c8e910 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:24.315353 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330973b1-b353-454e-8e96-b558cba807ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:24.316125 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330973b1-b353-454e-8e96-b558cba807ab None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:24.316726 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330973b1-b353-454e-8e96-b558cba807ab None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:24.317025 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330973b1-b353-454e-8e96-b558cba807ab None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:24.318006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330973b1-b353-454e-8e96-b558cba807ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:24.318363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330973b1-b353-454e-8e96-b558cba807ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:24.319735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330973b1-b353-454e-8e96-b558cba807ab None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:24.339900 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 386/760] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:24.341087 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330973b1-b353-454e-8e96-b558cba807ab None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:24.366153 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce95852-be24-4785-a60a-ac7d7d0e900c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:24.387767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:24.392245 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:24.412341 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b49c0b-f985-4e52-967e-be895689aede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:24.413714 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b49c0b-f985-4e52-967e-be895689aede None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:24.414358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b49c0b-f985-4e52-967e-be895689aede None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:24.414912 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b49c0b-f985-4e52-967e-be895689aede None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:24.416511 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b49c0b-f985-4e52-967e-be895689aede None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:24.416972 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b49c0b-f985-4e52-967e-be895689aede None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:24.419143 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b49c0b-f985-4e52-967e-be895689aede None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:24.427094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 375/761] 10.222.0.13 () {56 vars in 1124 bytes} [Tue Jul 5 21:10:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:24.428319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b49c0b-f985-4e52-967e-be895689aede None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:24.470233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330973b1-b353-454e-8e96-b558cba807ab None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:24.520164 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a6c35-d770-4f7e-bc60-ebf5b7671771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:24.520898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a6c35-d770-4f7e-bc60-ebf5b7671771 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:24.521187 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a6c35-d770-4f7e-bc60-ebf5b7671771 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:24.521491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a6c35-d770-4f7e-bc60-ebf5b7671771 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:24.543226 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b49c0b-f985-4e52-967e-be895689aede None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:24.594939 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358b7c7-8744-492e-96e9-e9a6b4fd6725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:24.595663 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358b7c7-8744-492e-96e9-e9a6b4fd6725 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:24.598139 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358b7c7-8744-492e-96e9-e9a6b4fd6725 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:24.598139 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358b7c7-8744-492e-96e9-e9a6b4fd6725 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:24.607212 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358b7c7-8744-492e-96e9-e9a6b4fd6725 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:24.608985 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358b7c7-8744-492e-96e9-e9a6b4fd6725 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:24.612051 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a6c35-d770-4f7e-bc60-ebf5b7671771 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:24.613577 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a6c35-d770-4f7e-bc60-ebf5b7671771 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:24.627849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-4358b7c7-8744-492e-96e9-e9a6b4fd6725 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:24.627849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:24.627849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:24.627849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:24.627849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:24.627849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:24.627849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:24.627849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:24.627849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:24.627849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:24.627849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:24.627849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:24.627849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:10:24.627849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:10:24.627849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:10:24.629281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:10:24.629281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:24.629281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:24.629281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:24.629281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:24.629281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:24.629281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:24.629281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:24.629281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:24.629281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:24.629281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:24.629281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:24.629281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:24.629281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:24.629281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:24.629281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:24.629281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:24.630845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:10:24.630845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:10:24.630845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:10:24.630845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:10:24.630845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:10:24.630845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:10:24.630845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:24.630845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:24.630845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 376/762] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:24.631963 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358b7c7-8744-492e-96e9-e9a6b4fd6725 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:24.663247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:24.694324 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:24.725958 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 387/763] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:10:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:10:24.727054 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a6c35-d770-4f7e-bc60-ebf5b7671771 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:24.769268 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358b7c7-8744-492e-96e9-e9a6b4fd6725 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:24.812684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577163b2-a0a1-4cbe-a6ba-92af95d56e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:24.813854 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577163b2-a0a1-4cbe-a6ba-92af95d56e44 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:24.814312 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577163b2-a0a1-4cbe-a6ba-92af95d56e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:24.814738 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577163b2-a0a1-4cbe-a6ba-92af95d56e44 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:24.815756 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577163b2-a0a1-4cbe-a6ba-92af95d56e44 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:24.816556 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577163b2-a0a1-4cbe-a6ba-92af95d56e44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:24.818371 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577163b2-a0a1-4cbe-a6ba-92af95d56e44 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:24.824824 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 377/764] 10.222.0.13 () {56 vars in 1124 bytes} [Tue Jul 5 21:10:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:24.825780 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577163b2-a0a1-4cbe-a6ba-92af95d56e44 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:24.845940 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a6c35-d770-4f7e-bc60-ebf5b7671771 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:24.882354 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e662ee5-b5dc-4988-8076-f519a2a655d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:24.883197 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e662ee5-b5dc-4988-8076-f519a2a655d1 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:24.883311 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e662ee5-b5dc-4988-8076-f519a2a655d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:24.883536 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e662ee5-b5dc-4988-8076-f519a2a655d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:24.884325 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e662ee5-b5dc-4988-8076-f519a2a655d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:24.884672 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e662ee5-b5dc-4988-8076-f519a2a655d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:24.886233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e662ee5-b5dc-4988-8076-f519a2a655d1 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:24.895907 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:24.904802 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 388/765] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:10:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:24.904802 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e662ee5-b5dc-4988-8076-f519a2a655d1 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:24.959038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577163b2-a0a1-4cbe-a6ba-92af95d56e44 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:24.961991 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:25.004353 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3aac4-14de-4870-8a0e-c220ff68a15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:25.005154 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3aac4-14de-4870-8a0e-c220ff68a15d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:25.005448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3aac4-14de-4870-8a0e-c220ff68a15d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:25.005729 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3aac4-14de-4870-8a0e-c220ff68a15d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:25.020940 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae3aac4-14de-4870-8a0e-c220ff68a15d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:25.022462 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae3aac4-14de-4870-8a0e-c220ff68a15d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:25.036394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e662ee5-b5dc-4988-8076-f519a2a655d1 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:25.045122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-cae3aac4-14de-4870-8a0e-c220ff68a15d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:25.045122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:25.045122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:25.045122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:25.045122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:25.045122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:25.045122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:25.045122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:25.045122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:25.045122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:25.045122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:25.045122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:25.045122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:25.045122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:25.045122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:25.047586 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:25.047586 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:25.047586 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:25.047586 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:25.047586 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:25.047586 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:25.047586 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:25.047586 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:25.047586 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:25.047586 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:25.047586 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:25.047586 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:25.047586 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:25.047586 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:25.047586 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:25.047586 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:25.047586 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:25.049832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:25.049832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:25.049832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:25.049832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:25.049832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 378/766] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:25.049832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3aac4-14de-4870-8a0e-c220ff68a15d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:25.080237 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8be86-f8cf-49dc-97d3-56da3c52138a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:25.080911 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8be86-f8cf-49dc-97d3-56da3c52138a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:25.081409 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8be86-f8cf-49dc-97d3-56da3c52138a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:25.081685 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8be86-f8cf-49dc-97d3-56da3c52138a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:25.083340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8be86-f8cf-49dc-97d3-56da3c52138a None admin] RBAC: Adding query filter params (interface=public, service_id=8a0e1dffcd1e40618ec92563a4e458d0, region_id=RegionOne) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:25.083652 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8be86-f8cf-49dc-97d3-56da3c52138a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:25.085011 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8be86-f8cf-49dc-97d3-56da3c52138a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:25.094499 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 389/767] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Jul 5 21:10:24 2022] GET /identity/v3/endpoints?service_id=8a0e1dffcd1e40618ec92563a4e458d0&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:25.095781 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25624e-299f-4c03-b344-095849065bc6 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:25.096121 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25624e-299f-4c03-b344-095849065bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:25.096349 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25624e-299f-4c03-b344-095849065bc6 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:25.101630 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 390/768] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:25.101630 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25624e-299f-4c03-b344-095849065bc6 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:25.162019 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3aac4-14de-4870-8a0e-c220ff68a15d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:25.170282 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:25.201195 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe6ecb-331f-4223-a953-e803fe0ab04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:25.202281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe6ecb-331f-4223-a953-e803fe0ab04b None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:25.202875 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe6ecb-331f-4223-a953-e803fe0ab04b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:25.203155 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe6ecb-331f-4223-a953-e803fe0ab04b None admin] PATH_INFO: `/v3/projects/1076c94b43b2483eb4fc06173f9204c3/users/910cd341df8943f18af2765e2a30b238/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:25.205851 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe6ecb-331f-4223-a953-e803fe0ab04b None admin] RBAC: Authorizing `identity:create_grant(project_id=1076c94b43b2483eb4fc06173f9204c3, user_id=910cd341df8943f18af2765e2a30b238, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:25.207596 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe6ecb-331f-4223-a953-e803fe0ab04b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:25.209424 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25624e-299f-4c03-b344-095849065bc6 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:25.247514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0579bda-8acc-4e8e-b310-98e30670e5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:25.248176 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0579bda-8acc-4e8e-b310-98e30670e5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:25.248461 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0579bda-8acc-4e8e-b310-98e30670e5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:25.248740 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0579bda-8acc-4e8e-b310-98e30670e5d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:25.249458 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0579bda-8acc-4e8e-b310-98e30670e5d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:25.249775 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0579bda-8acc-4e8e-b310-98e30670e5d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:25.251189 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0579bda-8acc-4e8e-b310-98e30670e5d3 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:25.263001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 391/769] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:25.263775 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0579bda-8acc-4e8e-b310-98e30670e5d3 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:25.286269 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 379/770] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 21:10:25 2022] PUT /identity/v3/projects/1076c94b43b2483eb4fc06173f9204c3/users/910cd341df8943f18af2765e2a30b238/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:10:25.287779 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14008b84-95ae-4a3c-b049-2222926379eb None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:25.288065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14008b84-95ae-4a3c-b049-2222926379eb None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:25.288345 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14008b84-95ae-4a3c-b049-2222926379eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:25.324817 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-14008b84-95ae-4a3c-b049-2222926379eb None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:25.327650 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-14008b84-95ae-4a3c-b049-2222926379eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:25.349052 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:25.382523 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0579bda-8acc-4e8e-b310-98e30670e5d3 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:25.412361 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:25.426928 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ab6a1-8378-40d4-8407-70c0d5bc3591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:25.427676 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ab6a1-8378-40d4-8407-70c0d5bc3591 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:25.427875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ab6a1-8378-40d4-8407-70c0d5bc3591 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:25.428157 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ab6a1-8378-40d4-8407-70c0d5bc3591 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:25.428857 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ab6a1-8378-40d4-8407-70c0d5bc3591 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:25.430507 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ab6a1-8378-40d4-8407-70c0d5bc3591 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:25.437178 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 392/772] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Jul 5 21:10:25 2022] GET /identity/v3/services => generated 772 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:25.438202 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ab6a1-8378-40d4-8407-70c0d5bc3591 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:25.442220 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 380/772] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:25.470897 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14008b84-95ae-4a3c-b049-2222926379eb None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:25.635995 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ab6a1-8378-40d4-8407-70c0d5bc3591 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:25.663021 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14008b84-95ae-4a3c-b049-2222926379eb None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:25.675437 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ac25c-3961-42e8-9aa5-35129d858ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:25.676236 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ac25c-3961-42e8-9aa5-35129d858ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:25.676521 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ac25c-3961-42e8-9aa5-35129d858ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:25.676796 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ac25c-3961-42e8-9aa5-35129d858ed9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:25.687477 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ac25c-3961-42e8-9aa5-35129d858ed9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:25.688943 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ac25c-3961-42e8-9aa5-35129d858ed9 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:25.704709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-b15ac25c-3961-42e8-9aa5-35129d858ed9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:25.704709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:25.704709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:25.704709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:25.704709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:25.704709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:25.704709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:25.704709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:25.704709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:25.704709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:25.704709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:25.704709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:25.704709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:10:25.704709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:10:25.704709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:10:25.705679 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:10:25.705679 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:25.705679 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:25.705679 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:25.705679 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:25.705679 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:25.705679 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:25.705679 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:25.705679 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:25.705679 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:25.705679 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:25.705679 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:25.705679 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:25.705679 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:25.705679 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:25.705679 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:25.705679 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:25.706609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:10:25.706609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:10:25.706609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:10:25.706609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:10:25.706609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:10:25.706609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:10:25.706609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:25.706609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:25.706609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 393/773] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:25.710449 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5ebe9-cb5f-4922-b0b7-1c1b1a5e659a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:25.711516 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5ebe9-cb5f-4922-b0b7-1c1b1a5e659a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:25.711735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ac25c-3961-42e8-9aa5-35129d858ed9 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:25.712206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5ebe9-cb5f-4922-b0b7-1c1b1a5e659a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:25.713322 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5ebe9-cb5f-4922-b0b7-1c1b1a5e659a None admin] PATH_INFO: `/v3/services/network` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:25.714370 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5ebe9-cb5f-4922-b0b7-1c1b1a5e659a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:25.716308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5ebe9-cb5f-4922-b0b7-1c1b1a5e659a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:25.733256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-74f5ebe9-cb5f-4922-b0b7-1c1b1a5e659a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:10:25.733256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:25.733256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:10:25.733256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:10:25.733256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:10:25.733256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:10:25.733256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:10:25.733256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:25.733256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:10:25.733256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:25.733256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:10:25.733256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:25.733256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:25.733256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:25.733256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:25.733256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:25.733256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:25.734308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:25.734308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:25.734308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:25.734308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:25.734308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:25.734308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:25.734308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:10:25.734308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:10:25.734308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:10:25.734308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:10:25.734308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:25.734308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:25.734308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:25.734308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:25.734308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:25.734308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:25.735214 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:25.735214 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:25.735214 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:25.735214 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:25.735214 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:25.735214 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:25.735214 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:25.735214 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:25.735214 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:25.735214 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:25.735214 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:10:25.735214 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:25.735214 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:10:25.735214 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:25.735956 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 381/774] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:25 2022] GET /identity/v3/services/network => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:25.741879 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5ebe9-cb5f-4922-b0b7-1c1b1a5e659a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:25.759323 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:25.776913 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:25.862478 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ac25c-3961-42e8-9aa5-35129d858ed9 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:25.905643 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69a77b-309f-4d2e-af24-7a115440fe54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:25.907377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69a77b-309f-4d2e-af24-7a115440fe54 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:25.908382 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69a77b-309f-4d2e-af24-7a115440fe54 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:25.908884 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69a77b-309f-4d2e-af24-7a115440fe54 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:25.909689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69a77b-309f-4d2e-af24-7a115440fe54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:25.909998 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69a77b-309f-4d2e-af24-7a115440fe54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:25.911486 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69a77b-309f-4d2e-af24-7a115440fe54 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:25.938095 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 394/775] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:10:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:25.940351 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9a0d2-e75b-4ca5-998f-8958cb616c66 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:25.940646 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9a0d2-e75b-4ca5-998f-8958cb616c66 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:25.940928 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9a0d2-e75b-4ca5-998f-8958cb616c66 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:25.944835 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 395/776] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:25.946960 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9a0d2-e75b-4ca5-998f-8958cb616c66 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:25.947850 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5ebe9-cb5f-4922-b0b7-1c1b1a5e659a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:25.984315 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e787ef-659f-4ec1-93c8-b7c70390538a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:25.984979 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e787ef-659f-4ec1-93c8-b7c70390538a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:25.985260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e787ef-659f-4ec1-93c8-b7c70390538a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:25.985535 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e787ef-659f-4ec1-93c8-b7c70390538a None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:25.986274 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e787ef-659f-4ec1-93c8-b7c70390538a None admin] RBAC: Adding query filter params (name=network) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:25.986580 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e787ef-659f-4ec1-93c8-b7c70390538a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:25.988263 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e787ef-659f-4ec1-93c8-b7c70390538a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:25.997621 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 382/777] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Jul 5 21:10:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:25.998969 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc11d1-fef2-4053-b5cf-fb8e4dce2b09 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:25.999256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc11d1-fef2-4053-b5cf-fb8e4dce2b09 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:25.999594 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc11d1-fef2-4053-b5cf-fb8e4dce2b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:26.017324 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-2dbc11d1-fef2-4053-b5cf-fb8e4dce2b09 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:26.018593 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2dbc11d1-fef2-4053-b5cf-fb8e4dce2b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:26.076824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9a0d2-e75b-4ca5-998f-8958cb616c66 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:26.087170 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:26.109464 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 383/778] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:26.110410 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc11d1-fef2-4053-b5cf-fb8e4dce2b09 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:26.113660 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:26.123774 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e560387-638f-453d-a00c-40f5edf1be3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:26.124584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e560387-638f-453d-a00c-40f5edf1be3e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:26.125059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e560387-638f-453d-a00c-40f5edf1be3e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:26.125458 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e560387-638f-453d-a00c-40f5edf1be3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:26.126450 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e560387-638f-453d-a00c-40f5edf1be3e None admin] RBAC: Adding query filter params (role.id=c641ed689379413190e5e4ff94eb90ba, scope.project.id=1076c94b43b2483eb4fc06173f9204c3, user.id=063ce3b820a74d648d709ab6ac4d7be2) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:26.126867 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e560387-638f-453d-a00c-40f5edf1be3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:26.128404 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e560387-638f-453d-a00c-40f5edf1be3e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:26.146489 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 396/779] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:10:25 2022] GET /identity/v3/role_assignments?user.id=063ce3b820a74d648d709ab6ac4d7be2&scope.project.id=1076c94b43b2483eb4fc06173f9204c3&role.id=c641ed689379413190e5e4ff94eb90ba => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:26.147465 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e560387-638f-453d-a00c-40f5edf1be3e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:26.297393 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc11d1-fef2-4053-b5cf-fb8e4dce2b09 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:26.351205 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77843b4e-ba73-4493-b85a-055cf571f72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:26.351886 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77843b4e-ba73-4493-b85a-055cf571f72b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:26.352172 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77843b4e-ba73-4493-b85a-055cf571f72b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:26.352459 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77843b4e-ba73-4493-b85a-055cf571f72b None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:26.353255 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77843b4e-ba73-4493-b85a-055cf571f72b None admin] RBAC: Adding query filter params (type=network) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:26.353598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77843b4e-ba73-4493-b85a-055cf571f72b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:26.358629 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77843b4e-ba73-4493-b85a-055cf571f72b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:26.367963 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 384/780] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Jul 5 21:10:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:26.374783 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77843b4e-ba73-4493-b85a-055cf571f72b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:26.382811 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e560387-638f-453d-a00c-40f5edf1be3e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:26.441434 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd215592-cbbd-4635-9b7f-fb2cd9f67e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:26.442269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd215592-cbbd-4635-9b7f-fb2cd9f67e3a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:26.442556 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd215592-cbbd-4635-9b7f-fb2cd9f67e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:26.442831 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd215592-cbbd-4635-9b7f-fb2cd9f67e3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:26.465189 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd215592-cbbd-4635-9b7f-fb2cd9f67e3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:10:26.473010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-bd215592-cbbd-4635-9b7f-fb2cd9f67e3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:10:26.473010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:26.473010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:26.473010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:26.473010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:26.473010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:26.473010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:26.473010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:26.473010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:26.473010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:26.473010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:26.473010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:26.473010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:10:26.473010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:10:26.473010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:10:26.473010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:10:26.475136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:10:26.475136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:10:26.475136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:10:26.475136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:10:26.475136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:26.475136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:26.475136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:26.475136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:26.475136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:26.475136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:26.475136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:26.475136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:26.475136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:26.475136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:26.475136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:26.475136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:26.477101 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:26.477101 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:26.477101 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:26.477101 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:26.477101 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:10:26.477101 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:10:26.477101 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:10:26.477101 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:10:26.477101 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:10:26.477101 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:10:26.477101 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:10:26.477101 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:26.482651 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 397/781] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:10:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:26.490098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd215592-cbbd-4635-9b7f-fb2cd9f67e3a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:26.547566 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:26.547897 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:26.619014 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd215592-cbbd-4635-9b7f-fb2cd9f67e3a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:26.623426 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77843b4e-ba73-4493-b85a-055cf571f72b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:26.661051 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c7879-b2a5-485f-9526-deebf2202224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:26.661732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c7879-b2a5-485f-9526-deebf2202224 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:26.666817 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c7879-b2a5-485f-9526-deebf2202224 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:26.666817 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c7879-b2a5-485f-9526-deebf2202224 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:26.666817 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c7879-b2a5-485f-9526-deebf2202224 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:26.666817 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c7879-b2a5-485f-9526-deebf2202224 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:26.666817 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c7879-b2a5-485f-9526-deebf2202224 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:26.674776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 398/782] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:10:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:26.680286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c7879-b2a5-485f-9526-deebf2202224 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:26.717022 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cfd6a-53a7-4d65-94e8-b82394ec81bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:26.717700 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cfd6a-53a7-4d65-94e8-b82394ec81bd None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:26.718052 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cfd6a-53a7-4d65-94e8-b82394ec81bd None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:26.718352 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cfd6a-53a7-4d65-94e8-b82394ec81bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:26.719149 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3cfd6a-53a7-4d65-94e8-b82394ec81bd None admin] RBAC: Adding query filter params (interface=public, service_id=427fb86ddb8d474db8f7be2100f0ad2e, region_id=RegionOne) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:26.719465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3cfd6a-53a7-4d65-94e8-b82394ec81bd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:26.720840 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3cfd6a-53a7-4d65-94e8-b82394ec81bd None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:26.737461 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 385/783] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Jul 5 21:10:26 2022] GET /identity/v3/endpoints?service_id=427fb86ddb8d474db8f7be2100f0ad2e&interface=public®ion_id=RegionOne => generated 194 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:26.741771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cfd6a-53a7-4d65-94e8-b82394ec81bd None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:26.855843 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:26.863110 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c7879-b2a5-485f-9526-deebf2202224 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:26.923517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea2c5a-196b-454a-9773-5cc5c92b677b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:26.924680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea2c5a-196b-454a-9773-5cc5c92b677b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:26.925170 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea2c5a-196b-454a-9773-5cc5c92b677b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:26.925680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea2c5a-196b-454a-9773-5cc5c92b677b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:26.938175 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cfd6a-53a7-4d65-94e8-b82394ec81bd None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:26.952223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea2c5a-196b-454a-9773-5cc5c92b677b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:26.953986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea2c5a-196b-454a-9773-5cc5c92b677b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:26.968124 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:26.973206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1ea32-0b25-44a9-9856-10b1012ee2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:26.973876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1ea32-0b25-44a9-9856-10b1012ee2de None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:26.974180 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1ea32-0b25-44a9-9856-10b1012ee2de None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:26.974465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1ea32-0b25-44a9-9856-10b1012ee2de None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:26.975150 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1ea32-0b25-44a9-9856-10b1012ee2de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:26.977594 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1ea32-0b25-44a9-9856-10b1012ee2de None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:26.989970 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 386/784] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Jul 5 21:10:26 2022] GET /identity/v3/services => generated 772 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:26.992534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-d2ea2c5a-196b-454a-9773-5cc5c92b677b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:26.992534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:26.992534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:26.992534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:26.992534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:26.992534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:26.992534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:26.992534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:26.992534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:26.992534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:26.992534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:26.992534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:26.992534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:26.992534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:26.992534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:26.993438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:26.993438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:26.993438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:26.993438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:26.993438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:26.993438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:26.993438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:26.993438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:26.993438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:26.993438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:26.993438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:26.993438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:26.993438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:26.993438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:26.993438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:26.993438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:26.993438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:26.995160 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:26.995160 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:26.995160 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:26.995160 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:26.995160 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 399/785] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:27.003316 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1ea32-0b25-44a9-9856-10b1012ee2de None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:27.171692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1ea32-0b25-44a9-9856-10b1012ee2de None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:27.219404 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559eac73-d63d-4b75-9e5d-49d3a4724261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:27.220000 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559eac73-d63d-4b75-9e5d-49d3a4724261 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:27.220287 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559eac73-d63d-4b75-9e5d-49d3a4724261 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:27.220565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559eac73-d63d-4b75-9e5d-49d3a4724261 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:27.221303 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559eac73-d63d-4b75-9e5d-49d3a4724261 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:27.221612 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559eac73-d63d-4b75-9e5d-49d3a4724261 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:27.223034 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559eac73-d63d-4b75-9e5d-49d3a4724261 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:27.242038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 387/786] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:27.248286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea2c5a-196b-454a-9773-5cc5c92b677b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:27.364548 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea2c5a-196b-454a-9773-5cc5c92b677b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:27.409784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74bb55-3bfb-4bdb-9eba-6e0944b13174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:27.411014 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74bb55-3bfb-4bdb-9eba-6e0944b13174 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:27.411517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74bb55-3bfb-4bdb-9eba-6e0944b13174 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:27.411989 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74bb55-3bfb-4bdb-9eba-6e0944b13174 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:27.427359 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74bb55-3bfb-4bdb-9eba-6e0944b13174 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:27.428834 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74bb55-3bfb-4bdb-9eba-6e0944b13174 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:27.450932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-2c74bb55-3bfb-4bdb-9eba-6e0944b13174 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:10:27.450932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:27.450932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:27.450932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:27.450932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:27.450932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:27.450932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:27.450932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:27.450932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:27.450932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:27.450932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:27.450932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:27.450932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:10:27.450932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:10:27.450932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:10:27.450932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:10:27.451961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:27.451961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:27.451961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:10:27.451961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:27.451961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:10:27.451961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:27.451961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:27.451961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:27.451961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:27.451961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:27.451961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:27.451961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:27.451961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:27.451961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:27.451961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:27.451961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:27.451961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:27.451961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:27.452931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:27.452931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:27.452931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:10:27.452931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:10:27.452931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:10:27.452931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:10:27.452931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:10:27.452931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:10:27.452931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:10:27.452931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:27.452931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 400/787] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:10:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:27.458109 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559eac73-d63d-4b75-9e5d-49d3a4724261 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:27.689274 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:27.719693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c905f7-d011-4578-ab82-e4d8f92498c4 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:27.720411 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c905f7-d011-4578-ab82-e4d8f92498c4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:27.720411 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c905f7-d011-4578-ab82-e4d8f92498c4 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:27.721846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 401/788] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:10:27.726638 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7d4d2-3a5e-472e-b74c-94c8de15f330 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:27.726926 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7d4d2-3a5e-472e-b74c-94c8de15f330 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:27.727201 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7d4d2-3a5e-472e-b74c-94c8de15f330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:27.739944 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:27.745623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-40f7d4d2-3a5e-472e-b74c-94c8de15f330 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:27.746868 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-40f7d4d2-3a5e-472e-b74c-94c8de15f330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:27.750334 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559eac73-d63d-4b75-9e5d-49d3a4724261 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:27.808900 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71da46-c585-4ff5-b6c2-c66c08db631a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:27.809587 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71da46-c585-4ff5-b6c2-c66c08db631a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:27.809869 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71da46-c585-4ff5-b6c2-c66c08db631a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:27.810178 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71da46-c585-4ff5-b6c2-c66c08db631a None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:27.811044 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71da46-c585-4ff5-b6c2-c66c08db631a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:27.811355 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71da46-c585-4ff5-b6c2-c66c08db631a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:27.812798 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71da46-c585-4ff5-b6c2-c66c08db631a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:27.832368 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 402/789] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:10:27.853491 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 388/790] 10.222.0.13 () {56 vars in 1135 bytes} [Tue Jul 5 21:10:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:27.859269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7d4d2-3a5e-472e-b74c-94c8de15f330 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:27.865557 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71da46-c585-4ff5-b6c2-c66c08db631a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:28.014523 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71da46-c585-4ff5-b6c2-c66c08db631a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:28.016550 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7d4d2-3a5e-472e-b74c-94c8de15f330 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:28.032223 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:28.056362 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed77001-04c8-4fc4-a18a-d48fef67f5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:28.057176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed77001-04c8-4fc4-a18a-d48fef67f5cf None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:28.057519 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed77001-04c8-4fc4-a18a-d48fef67f5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:28.057794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed77001-04c8-4fc4-a18a-d48fef67f5cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:28.063883 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8decc08-0976-426e-85df-b9ef275df2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:28.065106 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8decc08-0976-426e-85df-b9ef275df2fd None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:28.065743 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8decc08-0976-426e-85df-b9ef275df2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:28.066537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8decc08-0976-426e-85df-b9ef275df2fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:28.068833 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed77001-04c8-4fc4-a18a-d48fef67f5cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:10:28.070153 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:28.079158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-aed77001-04c8-4fc4-a18a-d48fef67f5cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:10:28.079158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:28.079158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:28.079158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:28.079158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:28.079158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:28.079158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:28.079158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:28.079158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:28.079158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:28.079158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:28.079158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:28.079158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:10:28.079158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:10:28.079158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:10:28.079158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:10:28.091396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:10:28.091396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:10:28.091396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:10:28.091396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:10:28.091396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:28.091396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:28.091396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:28.091396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:28.091396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:28.091396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:28.091396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:28.091396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:28.091396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:28.091396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:28.091396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:28.091396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:28.092252 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:28.092252 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:28.092252 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:28.092252 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:28.092252 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:10:28.092252 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:10:28.092252 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:10:28.092252 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:10:28.092252 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:10:28.092252 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:10:28.092252 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:10:28.092252 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:28.092916 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8decc08-0976-426e-85df-b9ef275df2fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:28.092992 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 389/791] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:10:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:28.093068 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8decc08-0976-426e-85df-b9ef275df2fd None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:28.093139 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371511b-4e57-4bf3-96e2-b3af6388b4b8 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:28.093139 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371511b-4e57-4bf3-96e2-b3af6388b4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:28.093139 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371511b-4e57-4bf3-96e2-b3af6388b4b8 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:28.093139 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 390/792] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:28.093139 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371511b-4e57-4bf3-96e2-b3af6388b4b8 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:28.115441 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-e8decc08-0976-426e-85df-b9ef275df2fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:28.115441 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:28.115441 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:28.115441 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:28.115441 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:28.115441 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:28.115441 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:28.115441 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:28.115441 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:28.115441 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:28.115441 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:28.115441 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:28.115441 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:28.115441 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:28.115441 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:28.116386 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:28.116386 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:28.116386 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:28.116386 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:28.116386 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:28.116386 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:28.116386 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:28.116386 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:28.116386 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:28.116386 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:28.116386 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:28.116386 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:28.116386 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:28.116386 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:28.116386 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:28.116386 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:28.116386 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:28.117287 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:28.117287 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:28.117287 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:28.117287 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:28.124496 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 403/793] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:28.124496 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44704ba5-9a7a-4531-9133-34f112e3c57c None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:28.124496 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44704ba5-9a7a-4531-9133-34f112e3c57c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:28.124496 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44704ba5-9a7a-4531-9133-34f112e3c57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:28.143199 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-44704ba5-9a7a-4531-9133-34f112e3c57c None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:28.144370 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-44704ba5-9a7a-4531-9133-34f112e3c57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:28.222142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 404/794] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:28.222142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44704ba5-9a7a-4531-9133-34f112e3c57c None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:28.242890 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371511b-4e57-4bf3-96e2-b3af6388b4b8 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:28.291130 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921f068-e5cc-4c40-af55-405c9430da2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:28.292184 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921f068-e5cc-4c40-af55-405c9430da2c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:28.292702 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921f068-e5cc-4c40-af55-405c9430da2c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:28.293753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921f068-e5cc-4c40-af55-405c9430da2c None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:28.295483 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921f068-e5cc-4c40-af55-405c9430da2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:28.296496 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921f068-e5cc-4c40-af55-405c9430da2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:28.299431 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921f068-e5cc-4c40-af55-405c9430da2c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:28.317216 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 391/795] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:10:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:28.317216 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921f068-e5cc-4c40-af55-405c9430da2c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:28.355091 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44704ba5-9a7a-4531-9133-34f112e3c57c None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:28.363016 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:28.377624 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:28.398642 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c02818-7abd-476c-a241-f302e8a7eff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:28.399701 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c02818-7abd-476c-a241-f302e8a7eff2 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:28.400011 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c02818-7abd-476c-a241-f302e8a7eff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:28.400286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c02818-7abd-476c-a241-f302e8a7eff2 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:28.405247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c02818-7abd-476c-a241-f302e8a7eff2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:28.405247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c02818-7abd-476c-a241-f302e8a7eff2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:28.405247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c02818-7abd-476c-a241-f302e8a7eff2 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:28.422029 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 405/796] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:28.422029 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c02818-7abd-476c-a241-f302e8a7eff2 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:28.455815 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921f068-e5cc-4c40-af55-405c9430da2c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:28.491669 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3ad0b-7cb1-45fa-bbc3-f78deb067953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:28.492479 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3ad0b-7cb1-45fa-bbc3-f78deb067953 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:28.492759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3ad0b-7cb1-45fa-bbc3-f78deb067953 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:28.493031 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3ad0b-7cb1-45fa-bbc3-f78deb067953 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:28.494323 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea3ad0b-7cb1-45fa-bbc3-f78deb067953 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:28.495727 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea3ad0b-7cb1-45fa-bbc3-f78deb067953 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:28.507874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-7ea3ad0b-7cb1-45fa-bbc3-f78deb067953 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:10:28.507874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:28.507874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:10:28.507874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:10:28.507874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:10:28.507874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:10:28.507874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:10:28.507874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:28.507874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:10:28.507874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:28.507874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:10:28.507874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:28.507874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:28.507874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:28.507874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:28.507874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:28.508857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:28.508857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:28.508857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:28.508857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:28.508857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:28.508857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:28.508857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:28.508857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:10:28.508857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:10:28.508857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:10:28.508857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:10:28.508857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:28.508857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:28.508857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:28.508857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:28.508857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:28.509781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:28.509781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:28.509781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:28.509781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:28.509781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:28.509781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:28.509781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:28.509781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:28.509781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:28.509781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:28.509781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:28.509781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:10:28.509781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:28.509781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:10:28.509781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:28.509781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 392/797] 10.222.0.13 () {56 vars in 1129 bytes} [Tue Jul 5 21:10:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:28.510777 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3ad0b-7cb1-45fa-bbc3-f78deb067953 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:28.557163 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c02818-7abd-476c-a241-f302e8a7eff2 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:28.591572 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecd997-cf3f-4aaa-a8a4-b94d262eb964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:28.592463 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecd997-cf3f-4aaa-a8a4-b94d262eb964 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:28.592821 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecd997-cf3f-4aaa-a8a4-b94d262eb964 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:28.593171 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecd997-cf3f-4aaa-a8a4-b94d262eb964 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:28.604915 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ecd997-cf3f-4aaa-a8a4-b94d262eb964 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:28.606795 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ecd997-cf3f-4aaa-a8a4-b94d262eb964 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:28.628220 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:28.631122 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-51ecd997-cf3f-4aaa-a8a4-b94d262eb964 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:28.631122 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:28.631122 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:28.631122 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:28.631122 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:28.631122 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:28.631122 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:28.631122 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:28.631122 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:28.631122 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:28.631122 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:28.631122 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:28.631122 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:28.631122 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:28.631122 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:28.632006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:28.632006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:28.632006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:28.632006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:28.632006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:28.632006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:28.632006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:28.632006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:28.632006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:28.632006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:28.632006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:28.632006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:28.632006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:28.632006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:28.632006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:28.632006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:28.632006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:28.632931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:28.632931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:28.632931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:28.632931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:28.633155 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3ad0b-7cb1-45fa-bbc3-f78deb067953 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:28.635479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 406/798] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:28.636307 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec2ed1-f7bf-4cd3-b303-fc782f219041 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:28.636599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec2ed1-f7bf-4cd3-b303-fc782f219041 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:28.636878 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec2ed1-f7bf-4cd3-b303-fc782f219041 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:28.642785 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 407/799] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:28.642785 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec2ed1-f7bf-4cd3-b303-fc782f219041 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:28.672668 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:28.672963 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b946b-2d1a-4d02-a307-891982995d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:28.673745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b946b-2d1a-4d02-a307-891982995d7e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:28.674031 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b946b-2d1a-4d02-a307-891982995d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:28.674347 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b946b-2d1a-4d02-a307-891982995d7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:28.682147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b946b-2d1a-4d02-a307-891982995d7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:28.683590 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b946b-2d1a-4d02-a307-891982995d7e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:28.698643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-272b946b-2d1a-4d02-a307-891982995d7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:28.698643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:28.698643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:28.698643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:28.698643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:28.698643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:28.698643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:28.698643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:28.698643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:28.698643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:28.698643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:28.698643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:28.698643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:10:28.698643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:10:28.698643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:10:28.700054 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:10:28.700054 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:28.700054 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:28.700054 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:28.700054 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:28.700054 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:28.700054 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:28.700054 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:28.700054 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:28.700054 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:28.700054 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:28.700054 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:28.700054 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:28.700054 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:28.700054 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:28.700054 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:28.700054 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:28.701492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:10:28.701492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:10:28.701492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:10:28.701492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:10:28.701492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:10:28.701492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:10:28.701492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:28.701492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:28.701492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 393/800] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:28.701492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b946b-2d1a-4d02-a307-891982995d7e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:28.751863 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec2ed1-f7bf-4cd3-b303-fc782f219041 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:28.788329 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879d823-884d-4e29-923c-49f8d98daf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:28.788992 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879d823-884d-4e29-923c-49f8d98daf17 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:28.789278 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879d823-884d-4e29-923c-49f8d98daf17 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:28.789556 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879d823-884d-4e29-923c-49f8d98daf17 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:28.790667 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879d823-884d-4e29-923c-49f8d98daf17 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:28.790667 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879d823-884d-4e29-923c-49f8d98daf17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:28.792036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879d823-884d-4e29-923c-49f8d98daf17 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:28.796810 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 408/801] 10.222.0.13 () {56 vars in 1124 bytes} [Tue Jul 5 21:10:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:28.797813 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b00903-9680-40ff-bbd8-631318b0f8c4 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:28.798106 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b00903-9680-40ff-bbd8-631318b0f8c4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:28.798417 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b00903-9680-40ff-bbd8-631318b0f8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:28.807629 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b946b-2d1a-4d02-a307-891982995d7e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:28.815962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e8b00903-9680-40ff-bbd8-631318b0f8c4 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:28.817197 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e8b00903-9680-40ff-bbd8-631318b0f8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:28.844067 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cfee1-1c82-404d-960b-74fe32663534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:28.844845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cfee1-1c82-404d-960b-74fe32663534 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:28.845131 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cfee1-1c82-404d-960b-74fe32663534 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:28.845410 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cfee1-1c82-404d-960b-74fe32663534 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:28.846153 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329cfee1-1c82-404d-960b-74fe32663534 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:28.846465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329cfee1-1c82-404d-960b-74fe32663534 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:28.847848 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329cfee1-1c82-404d-960b-74fe32663534 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:28.864636 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 394/802] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:28.865541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cfee1-1c82-404d-960b-74fe32663534 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:28.895689 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:28.895847 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 409/803] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:28.895847 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b00903-9680-40ff-bbd8-631318b0f8c4 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:28.924417 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:28.982636 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cfee1-1c82-404d-960b-74fe32663534 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:29.004697 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b00903-9680-40ff-bbd8-631318b0f8c4 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:29.020704 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e9478-6e37-43ff-8c91-7895fde26cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:29.021369 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e9478-6e37-43ff-8c91-7895fde26cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:29.021644 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e9478-6e37-43ff-8c91-7895fde26cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:29.021926 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e9478-6e37-43ff-8c91-7895fde26cd6 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:29.022755 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e9478-6e37-43ff-8c91-7895fde26cd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:29.023066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e9478-6e37-43ff-8c91-7895fde26cd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:29.024509 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e9478-6e37-43ff-8c91-7895fde26cd6 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:29.040995 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 395/804] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:10:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:29.040995 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e9478-6e37-43ff-8c91-7895fde26cd6 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:29.048173 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270bb8e-207a-4d76-b21f-dddc2bc0624b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:29.048841 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270bb8e-207a-4d76-b21f-dddc2bc0624b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:29.049176 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270bb8e-207a-4d76-b21f-dddc2bc0624b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:29.049449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270bb8e-207a-4d76-b21f-dddc2bc0624b None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:29.050327 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270bb8e-207a-4d76-b21f-dddc2bc0624b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:29.050634 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270bb8e-207a-4d76-b21f-dddc2bc0624b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:29.052170 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270bb8e-207a-4d76-b21f-dddc2bc0624b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:29.063074 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 410/805] 10.222.0.13 () {56 vars in 1124 bytes} [Tue Jul 5 21:10:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:29.063074 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270bb8e-207a-4d76-b21f-dddc2bc0624b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:29.122186 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:29.141436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e9478-6e37-43ff-8c91-7895fde26cd6 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:29.156976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:29.171697 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270bb8e-207a-4d76-b21f-dddc2bc0624b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:29.180627 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea5bfe-8438-404f-9a2b-134c565918d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:29.182030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea5bfe-8438-404f-9a2b-134c565918d2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:29.182383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea5bfe-8438-404f-9a2b-134c565918d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:29.182665 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea5bfe-8438-404f-9a2b-134c565918d2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:29.190565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea5bfe-8438-404f-9a2b-134c565918d2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:29.192001 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea5bfe-8438-404f-9a2b-134c565918d2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:29.207225 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-edea5bfe-8438-404f-9a2b-134c565918d2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:10:29.207225 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:29.207225 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:29.207225 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:29.207225 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:29.207225 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:29.207225 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:29.207225 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:29.207225 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:29.207225 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:29.207225 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:29.207225 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:29.207225 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:10:29.207225 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:10:29.207225 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:10:29.207225 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:10:29.208190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:29.208190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:29.208190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:10:29.208190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:29.208190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:10:29.208190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:29.208190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:29.208190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:29.208190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:29.208190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:29.208190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:29.208190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:29.208190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:29.208190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:29.208190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:29.208190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:29.208190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:29.208190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:29.209188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:29.209188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:29.209188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:10:29.209188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:10:29.209188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:10:29.209188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:10:29.209188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:10:29.209188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:10:29.209188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:10:29.209188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:29.209188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 396/806] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Jul 5 21:10:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:29.209188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea5bfe-8438-404f-9a2b-134c565918d2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:29.210693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967b2c1-2b26-4955-8162-6d26a5ac8bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:29.211477 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967b2c1-2b26-4955-8162-6d26a5ac8bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:29.211758 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967b2c1-2b26-4955-8162-6d26a5ac8bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:29.212033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967b2c1-2b26-4955-8162-6d26a5ac8bf5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:29.223256 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967b2c1-2b26-4955-8162-6d26a5ac8bf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:10:29.231364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-f967b2c1-2b26-4955-8162-6d26a5ac8bf5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:10:29.231364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:29.231364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:29.231364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:29.231364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:29.231364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:29.231364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:29.231364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:29.231364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:29.231364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:29.231364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:29.231364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:29.231364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:10:29.231364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:10:29.231364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:10:29.231364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:10:29.232328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:10:29.232328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:10:29.232328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:10:29.232328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:10:29.232328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:29.232328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:29.232328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:29.232328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:29.232328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:29.232328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:29.232328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:29.232328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:29.232328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:29.232328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:29.232328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:29.232328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:29.233230 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:29.233230 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:29.233230 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:29.233230 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:29.233230 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:10:29.233230 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:10:29.233230 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:10:29.233230 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:10:29.233230 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:10:29.233230 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:10:29.233230 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:10:29.233230 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:29.233230 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 411/807] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 21:10:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:29.233945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967b2c1-2b26-4955-8162-6d26a5ac8bf5 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:29.322283 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea5bfe-8438-404f-9a2b-134c565918d2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:29.348558 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967b2c1-2b26-4955-8162-6d26a5ac8bf5 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:29.357897 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf382fe5-f7f0-48ae-943a-a368b74ada00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:29.358813 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf382fe5-f7f0-48ae-943a-a368b74ada00 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:29.359094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf382fe5-f7f0-48ae-943a-a368b74ada00 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:29.359369 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf382fe5-f7f0-48ae-943a-a368b74ada00 None admin] PATH_INFO: `/v3/projects/1076c94b43b2483eb4fc06173f9204c3/users/441be62a077444b9b9f78714e24a760a/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:29.361338 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf382fe5-f7f0-48ae-943a-a368b74ada00 None admin] RBAC: Authorizing `identity:create_grant(project_id=1076c94b43b2483eb4fc06173f9204c3, user_id=441be62a077444b9b9f78714e24a760a, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:29.362792 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf382fe5-f7f0-48ae-943a-a368b74ada00 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:29.383710 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c483adf-5f68-4a18-895f-751009a786d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:29.384416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c483adf-5f68-4a18-895f-751009a786d7 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:29.384852 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c483adf-5f68-4a18-895f-751009a786d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:29.384968 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c483adf-5f68-4a18-895f-751009a786d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:29.385656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c483adf-5f68-4a18-895f-751009a786d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:29.387068 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c483adf-5f68-4a18-895f-751009a786d7 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:29.432779 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:29.437149 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 397/808] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 21:10:29 2022] PUT /identity/v3/projects/1076c94b43b2483eb4fc06173f9204c3/users/441be62a077444b9b9f78714e24a760a/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:10:29.440790 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf382fe5-f7f0-48ae-943a-a368b74ada00 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:29.468174 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 412/809] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Jul 5 21:10:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:10:29.469606 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c483adf-5f68-4a18-895f-751009a786d7 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:29.491961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:29.559466 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf382fe5-f7f0-48ae-943a-a368b74ada00 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:29.622517 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e59d36-8907-4384-8330-4ebcb53dd763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:29.623206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e59d36-8907-4384-8330-4ebcb53dd763 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:29.623491 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e59d36-8907-4384-8330-4ebcb53dd763 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:29.623768 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e59d36-8907-4384-8330-4ebcb53dd763 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:29.624635 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e59d36-8907-4384-8330-4ebcb53dd763 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:29.624945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e59d36-8907-4384-8330-4ebcb53dd763 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:29.626493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e59d36-8907-4384-8330-4ebcb53dd763 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:29.628204 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c483adf-5f68-4a18-895f-751009a786d7 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:29.647995 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 398/810] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Jul 5 21:10:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:29.649348 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea3b1a-5622-45f8-82be-52db86648857 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:29.649638 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea3b1a-5622-45f8-82be-52db86648857 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:29.650643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea3b1a-5622-45f8-82be-52db86648857 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:29.652140 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 399/811] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:29.663667 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50b572-65f2-4fbd-8256-793993723dfe None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:29.664222 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50b572-65f2-4fbd-8256-793993723dfe None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:29.664349 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50b572-65f2-4fbd-8256-793993723dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:29.671733 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0c4c8-3e67-4f03-b6af-2225c4a8d902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:29.673177 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0c4c8-3e67-4f03-b6af-2225c4a8d902 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:29.673177 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0c4c8-3e67-4f03-b6af-2225c4a8d902 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:29.673177 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0c4c8-3e67-4f03-b6af-2225c4a8d902 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:29.674156 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0c4c8-3e67-4f03-b6af-2225c4a8d902 None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:29.674564 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0c4c8-3e67-4f03-b6af-2225c4a8d902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:29.676038 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0c4c8-3e67-4f03-b6af-2225c4a8d902 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:29.686791 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 413/812] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 21:10:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:29.687706 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0c4c8-3e67-4f03-b6af-2225c4a8d902 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:29.688745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-db50b572-65f2-4fbd-8256-793993723dfe None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:29.690097 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-db50b572-65f2-4fbd-8256-793993723dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:29.755542 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:29.774112 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 400/813] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:29.775278 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50b572-65f2-4fbd-8256-793993723dfe None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:29.777331 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:29.815691 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0c4c8-3e67-4f03-b6af-2225c4a8d902 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:29.867293 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a7f36-47df-4d90-8009-645b124d9e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:29.867956 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a7f36-47df-4d90-8009-645b124d9e65 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:29.868944 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a7f36-47df-4d90-8009-645b124d9e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:29.869257 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a7f36-47df-4d90-8009-645b124d9e65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:29.912150 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50b572-65f2-4fbd-8256-793993723dfe None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:29.950885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b289a43-6295-4946-9a4a-024445a45343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:29.951726 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b289a43-6295-4946-9a4a-024445a45343 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:29.952010 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b289a43-6295-4946-9a4a-024445a45343 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:29.952386 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b289a43-6295-4946-9a4a-024445a45343 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:29.963506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a7f36-47df-4d90-8009-645b124d9e65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:29.963664 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b289a43-6295-4946-9a4a-024445a45343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:29.964975 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a7f36-47df-4d90-8009-645b124d9e65 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:29.965536 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b289a43-6295-4946-9a4a-024445a45343 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:29.985065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-8b289a43-6295-4946-9a4a-024445a45343 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:29.985065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:29.985065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:29.985065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:29.985065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:29.985065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:29.985065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:29.985065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:29.985065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:29.985065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:29.985065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:29.985065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:29.985065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:29.985065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:29.985065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:29.986038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:29.986038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:29.986038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:29.986038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:29.986038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:29.986038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:29.986038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:29.986038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:29.986038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:29.986038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:29.986038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:29.986038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:29.986038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:29.986038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:29.986038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:29.986038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:29.986038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:29.987872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:29.987872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:29.987872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:29.987872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:29.987872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 401/814] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:29.987872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b289a43-6295-4946-9a4a-024445a45343 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:30.028749 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:30.049428 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:30.093701 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 414/815] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:10:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:10:30.094894 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a7f36-47df-4d90-8009-645b124d9e65 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:30.117009 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b289a43-6295-4946-9a4a-024445a45343 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:30.165908 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fb713-1852-4b8b-b063-b91addc2c7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:30.167344 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fb713-1852-4b8b-b063-b91addc2c7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:30.167754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fb713-1852-4b8b-b063-b91addc2c7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:30.168145 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fb713-1852-4b8b-b063-b91addc2c7a6 None admin] PATH_INFO: `/v3/services/network` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:30.169135 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906fb713-1852-4b8b-b063-b91addc2c7a6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:30.172158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906fb713-1852-4b8b-b063-b91addc2c7a6 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:30.188927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-906fb713-1852-4b8b-b063-b91addc2c7a6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:10:30.188927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:30.188927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:10:30.188927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:10:30.188927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:10:30.188927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:10:30.188927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:10:30.188927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:30.188927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:10:30.188927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:30.188927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:10:30.188927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:30.188927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:30.188927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:30.188927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:30.188927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:30.188927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:30.190190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:30.190190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:30.190190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:30.190190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:30.190190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:30.190190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:30.190190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:10:30.190190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:10:30.190190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:10:30.190190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:10:30.190190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:30.190190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:30.190190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:30.190190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:30.190190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:30.190190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:30.191120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:30.191120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:30.191120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:30.191120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:30.191120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:30.191120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:30.191120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:30.191120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:30.191120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:30.191120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:30.191120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:10:30.191120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:30.191120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:10:30.191120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:30.191120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 402/816] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:29 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:30.191925 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fb713-1852-4b8b-b063-b91addc2c7a6 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:30.216271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a7f36-47df-4d90-8009-645b124d9e65 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:30.263164 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90ea1a-1f64-45e0-ba5c-e881eb3bf047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:30.263516 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90ea1a-1f64-45e0-ba5c-e881eb3bf047 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:30.263709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90ea1a-1f64-45e0-ba5c-e881eb3bf047 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:30.264362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90ea1a-1f64-45e0-ba5c-e881eb3bf047 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:30.265110 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90ea1a-1f64-45e0-ba5c-e881eb3bf047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:30.265418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90ea1a-1f64-45e0-ba5c-e881eb3bf047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:30.267008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90ea1a-1f64-45e0-ba5c-e881eb3bf047 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:30.282166 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 415/817] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:30.283008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90ea1a-1f64-45e0-ba5c-e881eb3bf047 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:30.313651 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:30.317198 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fb713-1852-4b8b-b063-b91addc2c7a6 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:30.359333 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a606f-825a-489a-8605-32a88dc2d19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:30.360196 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a606f-825a-489a-8605-32a88dc2d19f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:30.360527 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a606f-825a-489a-8605-32a88dc2d19f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:30.360812 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a606f-825a-489a-8605-32a88dc2d19f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:30.373567 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a606f-825a-489a-8605-32a88dc2d19f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:30.375105 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a606f-825a-489a-8605-32a88dc2d19f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:30.395703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-c95a606f-825a-489a-8605-32a88dc2d19f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:30.395703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:30.395703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:30.395703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:30.395703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:30.395703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:30.395703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:30.395703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:30.395703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:30.395703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:30.395703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:30.395703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:30.395703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:30.395703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:30.395703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:30.396692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:30.396692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:30.396692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:30.396692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:30.396692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:30.396692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:30.396692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:30.396692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:30.396692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:30.396692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:30.396692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:30.396692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:30.396692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:30.396692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:30.396692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:30.396692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:30.396692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:30.397600 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:30.397600 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:30.397600 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:30.397600 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:30.397600 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 403/818] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:30.397892 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a606f-825a-489a-8605-32a88dc2d19f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:30.444794 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:30.519163 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a606f-825a-489a-8605-32a88dc2d19f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:30.530702 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90ea1a-1f64-45e0-ba5c-e881eb3bf047 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:30.556037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5155391-c071-4970-8494-9ee73b48319a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:30.557379 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5155391-c071-4970-8494-9ee73b48319a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:30.557866 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5155391-c071-4970-8494-9ee73b48319a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:30.558399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5155391-c071-4970-8494-9ee73b48319a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:30.566492 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af0c8e-d002-40e6-af59-940f8d0a08cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:30.567159 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af0c8e-d002-40e6-af59-940f8d0a08cb None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:30.567444 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af0c8e-d002-40e6-af59-940f8d0a08cb None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:30.567723 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af0c8e-d002-40e6-af59-940f8d0a08cb None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:30.568076 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5155391-c071-4970-8494-9ee73b48319a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:30.568437 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af0c8e-d002-40e6-af59-940f8d0a08cb None admin] RBAC: Adding query filter params (name=network) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:30.568744 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af0c8e-d002-40e6-af59-940f8d0a08cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:30.570206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af0c8e-d002-40e6-af59-940f8d0a08cb None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:30.570317 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5155391-c071-4970-8494-9ee73b48319a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:30.579934 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 416/819] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Jul 5 21:10:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:30.579934 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af0c8e-d002-40e6-af59-940f8d0a08cb None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:30.591562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-b5155391-c071-4970-8494-9ee73b48319a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:10:30.591562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:30.591562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:30.591562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:30.591562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:30.591562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:30.591562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:30.591562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:30.591562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:30.591562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:30.591562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:30.591562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:30.591562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:10:30.591562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:10:30.591562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:10:30.591562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:10:30.592579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:30.592579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:30.592579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:10:30.592579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:30.592579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:10:30.592579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:30.592579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:30.592579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:30.592579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:30.592579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:30.592579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:30.592579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:30.592579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:30.592579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:30.592579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:30.592579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:30.592579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:30.592579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:30.593634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:30.593634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:30.593634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:10:30.593634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:10:30.593634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:10:30.593634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:10:30.593634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:10:30.593634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:10:30.593634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:10:30.593634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:30.594770 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 404/820] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Jul 5 21:10:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:30.595497 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5155391-c071-4970-8494-9ee73b48319a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:30.619533 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:30.704501 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:30.716478 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af0c8e-d002-40e6-af59-940f8d0a08cb None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:30.722289 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5155391-c071-4970-8494-9ee73b48319a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:30.753675 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77335332-8cb9-470d-aa0b-1664e215c383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:30.754744 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77335332-8cb9-470d-aa0b-1664e215c383 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:30.755179 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77335332-8cb9-470d-aa0b-1664e215c383 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:30.755611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77335332-8cb9-470d-aa0b-1664e215c383 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:30.756541 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77335332-8cb9-470d-aa0b-1664e215c383 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:30.757003 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77335332-8cb9-470d-aa0b-1664e215c383 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:30.758577 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77335332-8cb9-470d-aa0b-1664e215c383 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:30.760394 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d474a-9fd7-4a84-b8cf-3dec20f20006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:30.761172 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d474a-9fd7-4a84-b8cf-3dec20f20006 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:30.761569 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d474a-9fd7-4a84-b8cf-3dec20f20006 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:30.761945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d474a-9fd7-4a84-b8cf-3dec20f20006 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:30.763674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d474a-9fd7-4a84-b8cf-3dec20f20006 None admin] RBAC: Adding query filter params (type=network) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:30.764347 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d474a-9fd7-4a84-b8cf-3dec20f20006 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:30.766098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d474a-9fd7-4a84-b8cf-3dec20f20006 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:30.774426 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 417/822] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:30.776152 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77335332-8cb9-470d-aa0b-1664e215c383 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:30.776789 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 405/822] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Jul 5 21:10:30 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:30.777849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d474a-9fd7-4a84-b8cf-3dec20f20006 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:30.861505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:30.880741 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77335332-8cb9-470d-aa0b-1664e215c383 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:30.887441 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d474a-9fd7-4a84-b8cf-3dec20f20006 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:30.917731 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f5d83-6d21-4312-878e-0a596953bcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:30.918770 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f5d83-6d21-4312-878e-0a596953bcdd None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:30.919261 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f5d83-6d21-4312-878e-0a596953bcdd None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:30.919741 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f5d83-6d21-4312-878e-0a596953bcdd None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:30.920777 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f5d83-6d21-4312-878e-0a596953bcdd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:30.921292 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f5d83-6d21-4312-878e-0a596953bcdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:30.922957 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f5d83-6d21-4312-878e-0a596953bcdd None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:30.925375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b9ed9-5ce6-47bf-83d6-075232a2dadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:30.926151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b9ed9-5ce6-47bf-83d6-075232a2dadc None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:30.926696 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b9ed9-5ce6-47bf-83d6-075232a2dadc None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:30.926696 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b9ed9-5ce6-47bf-83d6-075232a2dadc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:30.927496 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b9ed9-5ce6-47bf-83d6-075232a2dadc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:30.928850 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b9ed9-5ce6-47bf-83d6-075232a2dadc None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:30.941844 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 418/823] 10.222.0.13 () {56 vars in 1149 bytes} [Tue Jul 5 21:10:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:30.942965 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f5d83-6d21-4312-878e-0a596953bcdd None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:30.957982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:31.006933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 406/824] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Jul 5 21:10:30 2022] POST /identity/v3/endpoints => generated 327 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:10:31.006933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b9ed9-5ce6-47bf-83d6-075232a2dadc None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:31.107263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f5d83-6d21-4312-878e-0a596953bcdd None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:31.203158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b9ed9-5ce6-47bf-83d6-075232a2dadc None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:31.206613 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc99be-113a-49a5-9af4-d11cba8d59b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:31.207413 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc99be-113a-49a5-9af4-d11cba8d59b7 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:31.207700 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc99be-113a-49a5-9af4-d11cba8d59b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:31.207977 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc99be-113a-49a5-9af4-d11cba8d59b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:31.217618 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc99be-113a-49a5-9af4-d11cba8d59b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:31.220054 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc99be-113a-49a5-9af4-d11cba8d59b7 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:31.238876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:31.244719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-5ecc99be-113a-49a5-9af4-d11cba8d59b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:31.244719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:31.244719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:31.244719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:31.244719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:31.244719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:31.244719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:31.244719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:31.244719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:31.244719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:31.244719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:31.244719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:31.244719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:10:31.244719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:10:31.244719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:10:31.251418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:10:31.251418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:31.251418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:31.251418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:31.251418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:31.251418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:31.251418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:31.251418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:31.251418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:31.251418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:31.251418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:31.251418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:31.251418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:31.251418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:31.251418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:31.251418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:31.251418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:31.252350 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:10:31.252350 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:10:31.252350 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:10:31.252350 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:10:31.252350 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:10:31.252350 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:10:31.252350 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:31.252350 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:31.252350 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 419/825] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:31.252843 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca0b9c-5fb9-4ff4-8076-d98fa10ca304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:31.252843 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca0b9c-5fb9-4ff4-8076-d98fa10ca304 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:31.252843 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca0b9c-5fb9-4ff4-8076-d98fa10ca304 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:31.253050 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc99be-113a-49a5-9af4-d11cba8d59b7 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:31.253127 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca0b9c-5fb9-4ff4-8076-d98fa10ca304 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:31.270083 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca0b9c-5fb9-4ff4-8076-d98fa10ca304 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:31.271669 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca0b9c-5fb9-4ff4-8076-d98fa10ca304 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:31.298164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-e8ca0b9c-5fb9-4ff4-8076-d98fa10ca304 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:31.298164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:31.298164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:31.298164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:31.298164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:31.298164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:31.298164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:31.298164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:31.298164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:31.298164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:31.298164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:31.298164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:31.298164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:31.298164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:31.298164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:31.299137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:31.299137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:31.299137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:31.299137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:31.299137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:31.299137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:31.299137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:31.299137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:31.299137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:31.299137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:31.299137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:31.299137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:31.299137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:31.299137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:31.299137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:31.299137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:31.299137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:31.300098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:31.300098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:31.300098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:31.300098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:31.300098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 407/826] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:31.304975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca0b9c-5fb9-4ff4-8076-d98fa10ca304 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:31.338514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:31.382403 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc99be-113a-49a5-9af4-d11cba8d59b7 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:31.439827 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e652079-5742-48de-929c-57fae95cd198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:31.441138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e652079-5742-48de-929c-57fae95cd198 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:31.442011 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e652079-5742-48de-929c-57fae95cd198 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:31.442756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e652079-5742-48de-929c-57fae95cd198 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:31.444001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e652079-5742-48de-929c-57fae95cd198 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:31.444893 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e652079-5742-48de-929c-57fae95cd198 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:31.447585 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e652079-5742-48de-929c-57fae95cd198 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:31.447846 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca0b9c-5fb9-4ff4-8076-d98fa10ca304 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:31.465362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 420/827] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:10:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:31.471972 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e652079-5742-48de-929c-57fae95cd198 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:31.498367 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2ceb4-0f40-42d6-9f9b-e88701e40644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:31.499536 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2ceb4-0f40-42d6-9f9b-e88701e40644 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:31.500330 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2ceb4-0f40-42d6-9f9b-e88701e40644 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:31.501072 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2ceb4-0f40-42d6-9f9b-e88701e40644 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:31.502211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2ceb4-0f40-42d6-9f9b-e88701e40644 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:31.503043 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2ceb4-0f40-42d6-9f9b-e88701e40644 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:31.506406 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2ceb4-0f40-42d6-9f9b-e88701e40644 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:31.526872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 408/828] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:31.532543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2ceb4-0f40-42d6-9f9b-e88701e40644 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:31.590309 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e652079-5742-48de-929c-57fae95cd198 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:31.596337 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:31.619422 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:31.629863 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07767663-4396-43d5-9b71-dbf51239e890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:31.630552 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07767663-4396-43d5-9b71-dbf51239e890 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:31.630831 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07767663-4396-43d5-9b71-dbf51239e890 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:31.631198 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07767663-4396-43d5-9b71-dbf51239e890 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:31.632027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07767663-4396-43d5-9b71-dbf51239e890 None admin] RBAC: Adding query filter params (role.id=15cf04fec8c6477088a33bf286f1bbdb, scope.project.id=1076c94b43b2483eb4fc06173f9204c3, user.id=910cd341df8943f18af2765e2a30b238) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:31.632335 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07767663-4396-43d5-9b71-dbf51239e890 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:31.633879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07767663-4396-43d5-9b71-dbf51239e890 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:31.640472 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 421/829] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:10:31 2022] GET /identity/v3/role_assignments?user.id=910cd341df8943f18af2765e2a30b238&scope.project.id=1076c94b43b2483eb4fc06173f9204c3&role.id=15cf04fec8c6477088a33bf286f1bbdb => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:31.644907 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cf7f0-657b-4393-bddd-93ef442188e3 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:31.644907 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cf7f0-657b-4393-bddd-93ef442188e3 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:31.644907 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cf7f0-657b-4393-bddd-93ef442188e3 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:31.644907 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 422/830] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:31.649272 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68248f10-a90b-4c0d-a84c-a36d8fa2f0ee None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:31.649602 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68248f10-a90b-4c0d-a84c-a36d8fa2f0ee None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:31.650079 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68248f10-a90b-4c0d-a84c-a36d8fa2f0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:31.664336 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2ceb4-0f40-42d6-9f9b-e88701e40644 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:31.668947 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-68248f10-a90b-4c0d-a84c-a36d8fa2f0ee None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:31.670240 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-68248f10-a90b-4c0d-a84c-a36d8fa2f0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:31.710062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c115d8-c3e3-4702-a829-86b56d60b2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:31.710979 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c115d8-c3e3-4702-a829-86b56d60b2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:31.711267 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c115d8-c3e3-4702-a829-86b56d60b2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:31.711544 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c115d8-c3e3-4702-a829-86b56d60b2a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:31.719738 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c115d8-c3e3-4702-a829-86b56d60b2a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:31.721220 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c115d8-c3e3-4702-a829-86b56d60b2a4 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:31.737189 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-48c115d8-c3e3-4702-a829-86b56d60b2a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:31.737189 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:31.737189 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:31.737189 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:31.737189 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:31.737189 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:31.737189 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:31.737189 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:31.737189 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:31.737189 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:31.737189 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:31.737189 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:31.737189 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:10:31.737189 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:10:31.737189 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:10:31.738361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:10:31.738361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:31.738361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:31.738361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:31.738361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:31.738361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:31.738361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:31.738361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:31.738361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:31.738361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:31.738361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:31.738361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:31.738361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:31.738361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:31.738361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:31.738361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:31.738361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:31.739315 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:10:31.739315 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:10:31.739315 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:10:31.739315 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:10:31.739315 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:10:31.739315 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:10:31.739315 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:31.739315 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:31.739315 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 409/831] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:31.739828 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942a66d-967f-4650-a0de-93840c11e85a None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:31.740580 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942a66d-967f-4650-a0de-93840c11e85a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:31.740580 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942a66d-967f-4650-a0de-93840c11e85a None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:31.746757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 410/832] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:31.746757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942a66d-967f-4650-a0de-93840c11e85a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:31.757705 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 423/833] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:31.763652 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad17874-c533-41fc-89a4-65ae610053a0 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:31.763952 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad17874-c533-41fc-89a4-65ae610053a0 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:31.764467 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad17874-c533-41fc-89a4-65ae610053a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:31.782913 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-3ad17874-c533-41fc-89a4-65ae610053a0 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:31.784205 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3ad17874-c533-41fc-89a4-65ae610053a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:31.870266 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 424/834] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:31.871197 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad17874-c533-41fc-89a4-65ae610053a0 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:31.873067 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942a66d-967f-4650-a0de-93840c11e85a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:31.876438 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:31.910487 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049910f-52ec-4d9a-a863-c74d80685fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:31.911062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049910f-52ec-4d9a-a863-c74d80685fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:31.911340 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049910f-52ec-4d9a-a863-c74d80685fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:31.911737 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049910f-52ec-4d9a-a863-c74d80685fd3 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:31.912521 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049910f-52ec-4d9a-a863-c74d80685fd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:31.912823 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049910f-52ec-4d9a-a863-c74d80685fd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:31.914272 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049910f-52ec-4d9a-a863-c74d80685fd3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:31.931905 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 411/835] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:10:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:31.931905 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049910f-52ec-4d9a-a863-c74d80685fd3 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:31.934360 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:31.989127 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad17874-c533-41fc-89a4-65ae610053a0 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:32.024112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c865ddd-d0c7-4117-bac9-62ca7848c800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:32.025537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c865ddd-d0c7-4117-bac9-62ca7848c800 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:32.025813 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c865ddd-d0c7-4117-bac9-62ca7848c800 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:32.026408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c865ddd-d0c7-4117-bac9-62ca7848c800 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:32.036626 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c865ddd-d0c7-4117-bac9-62ca7848c800 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:10:32.038751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049910f-52ec-4d9a-a863-c74d80685fd3 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:32.044959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-0c865ddd-d0c7-4117-bac9-62ca7848c800 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:10:32.044959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:32.044959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:32.044959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:32.044959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:32.044959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:32.044959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:32.044959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:32.044959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:32.044959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:32.044959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:32.044959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:32.044959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:10:32.044959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:10:32.044959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:10:32.044959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:10:32.045948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:10:32.045948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:10:32.045948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:10:32.045948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:10:32.045948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:32.045948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:32.045948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:32.045948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:32.045948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:32.045948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:32.045948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:32.045948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:32.045948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:32.045948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:32.045948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:32.045948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:32.046853 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:32.046853 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:32.046853 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:32.046853 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:32.046853 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:10:32.046853 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:10:32.046853 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:10:32.046853 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:10:32.046853 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:10:32.046853 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:10:32.046853 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:10:32.046853 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:32.050436 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 425/836] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:10:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:32.051784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c865ddd-d0c7-4117-bac9-62ca7848c800 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:32.077067 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778dc78-25ff-4ecf-9a15-c92b1fc4e400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:32.077975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778dc78-25ff-4ecf-9a15-c92b1fc4e400 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:32.078174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778dc78-25ff-4ecf-9a15-c92b1fc4e400 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:32.078449 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778dc78-25ff-4ecf-9a15-c92b1fc4e400 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:32.079103 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778dc78-25ff-4ecf-9a15-c92b1fc4e400 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:32.080560 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778dc78-25ff-4ecf-9a15-c92b1fc4e400 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:32.092898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-b778dc78-25ff-4ecf-9a15-c92b1fc4e400 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:10:32.092898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:32.092898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:10:32.092898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:10:32.092898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:10:32.092898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:10:32.092898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:10:32.092898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:32.092898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:10:32.092898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:32.092898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:10:32.092898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:32.092898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:32.092898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:32.092898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:32.092898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:32.092898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:32.093936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:32.093936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:32.093936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:32.093936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:32.093936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:32.093936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:32.093936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:10:32.093936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:10:32.093936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:10:32.093936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:10:32.093936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:32.093936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:32.093936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:32.093936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:32.093936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:32.093936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:32.094825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:32.094825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:32.094825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:32.094825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:32.094825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:32.094825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:32.094825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:32.094825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:32.094825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:32.094825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:32.094825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:10:32.094825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:32.094825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:10:32.094825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:32.094825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 412/837] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 21:10:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:32.096542 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778dc78-25ff-4ecf-9a15-c92b1fc4e400 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:32.125352 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:32.162099 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c865ddd-d0c7-4117-bac9-62ca7848c800 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:32.172021 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:32.199135 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d262b-5b9d-42c6-93e6-e5bd5878300e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:32.200207 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d262b-5b9d-42c6-93e6-e5bd5878300e None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:32.200984 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d262b-5b9d-42c6-93e6-e5bd5878300e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:32.201433 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d262b-5b9d-42c6-93e6-e5bd5878300e None admin] PATH_INFO: `/v3/projects/1076c94b43b2483eb4fc06173f9204c3/users/063ce3b820a74d648d709ab6ac4d7be2/roles/c641ed689379413190e5e4ff94eb90ba` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:32.206248 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778dc78-25ff-4ecf-9a15-c92b1fc4e400 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:32.218619 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d262b-5b9d-42c6-93e6-e5bd5878300e None admin] RBAC: Authorizing `identity:create_grant(project_id=1076c94b43b2483eb4fc06173f9204c3, user_id=063ce3b820a74d648d709ab6ac4d7be2, role_id=c641ed689379413190e5e4ff94eb90ba)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:32.220095 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d262b-5b9d-42c6-93e6-e5bd5878300e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:32.241393 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c93c8-56c4-493f-a66a-be6ae521598b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:32.242061 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c93c8-56c4-493f-a66a-be6ae521598b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:32.242375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c93c8-56c4-493f-a66a-be6ae521598b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:32.242656 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c93c8-56c4-493f-a66a-be6ae521598b None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:32.244023 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c93c8-56c4-493f-a66a-be6ae521598b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:32.244341 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c93c8-56c4-493f-a66a-be6ae521598b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:32.245871 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c93c8-56c4-493f-a66a-be6ae521598b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:32.254270 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 413/838] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:10:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:32.255057 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c93c8-56c4-493f-a66a-be6ae521598b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:32.303081 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 426/839] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 21:10:32 2022] PUT /identity/v3/projects/1076c94b43b2483eb4fc06173f9204c3/users/063ce3b820a74d648d709ab6ac4d7be2/roles/c641ed689379413190e5e4ff94eb90ba => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:10:32.304123 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d262b-5b9d-42c6-93e6-e5bd5878300e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:32.394250 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:32.408413 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c93c8-56c4-493f-a66a-be6ae521598b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:32.444346 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d262b-5b9d-42c6-93e6-e5bd5878300e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:32.462279 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f8b77-b001-4e34-9963-2de4cffce87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:32.464755 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f8b77-b001-4e34-9963-2de4cffce87e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:32.465188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f8b77-b001-4e34-9963-2de4cffce87e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:32.465472 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f8b77-b001-4e34-9963-2de4cffce87e None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:32.466204 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f8b77-b001-4e34-9963-2de4cffce87e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:32.466514 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f8b77-b001-4e34-9963-2de4cffce87e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:32.468346 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f8b77-b001-4e34-9963-2de4cffce87e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:32.474589 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 414/840] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 21:10:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:32.482541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f8b77-b001-4e34-9963-2de4cffce87e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:32.494956 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249968fe-fd1f-425e-a92f-7cba1dae1c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:32.495892 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249968fe-fd1f-425e-a92f-7cba1dae1c22 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:32.496269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249968fe-fd1f-425e-a92f-7cba1dae1c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:32.496624 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249968fe-fd1f-425e-a92f-7cba1dae1c22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:32.507382 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249968fe-fd1f-425e-a92f-7cba1dae1c22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:32.508990 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249968fe-fd1f-425e-a92f-7cba1dae1c22 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:32.527997 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-249968fe-fd1f-425e-a92f-7cba1dae1c22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:32.527997 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:32.527997 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:32.527997 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:32.527997 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:32.527997 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:32.527997 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:32.527997 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:32.527997 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:32.527997 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:32.527997 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:32.527997 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:32.527997 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:32.527997 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:32.527997 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:32.529169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:32.529169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:32.529169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:32.529169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:32.529169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:32.529169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:32.529169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:32.529169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:32.529169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:32.529169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:32.529169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:32.529169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:32.529169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:32.529169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:32.529169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:32.529169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:32.529169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:32.530317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:32.530317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:32.530317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:32.530317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:32.531297 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 427/841] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:32.536539 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249968fe-fd1f-425e-a92f-7cba1dae1c22 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:32.549832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:32.612441 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f8b77-b001-4e34-9963-2de4cffce87e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:32.657032 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb41169-962c-4dde-ab19-fa1a7c5aa26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:32.657513 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249968fe-fd1f-425e-a92f-7cba1dae1c22 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:32.661626 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb41169-962c-4dde-ab19-fa1a7c5aa26f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:32.661626 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb41169-962c-4dde-ab19-fa1a7c5aa26f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:32.661626 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb41169-962c-4dde-ab19-fa1a7c5aa26f None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:32.661626 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb41169-962c-4dde-ab19-fa1a7c5aa26f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:32.661626 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb41169-962c-4dde-ab19-fa1a7c5aa26f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:32.662263 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb41169-962c-4dde-ab19-fa1a7c5aa26f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:32.668670 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 415/842] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 21:10:32 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:32.706423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e169396-f52d-497e-9b2c-b6a1b34df22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:32.707171 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e169396-f52d-497e-9b2c-b6a1b34df22d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:32.707599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e169396-f52d-497e-9b2c-b6a1b34df22d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:32.707975 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e169396-f52d-497e-9b2c-b6a1b34df22d None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:32.708782 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e169396-f52d-497e-9b2c-b6a1b34df22d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:32.709141 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e169396-f52d-497e-9b2c-b6a1b34df22d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:32.710584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e169396-f52d-497e-9b2c-b6a1b34df22d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:32.725318 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 428/843] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:32.731914 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb41169-962c-4dde-ab19-fa1a7c5aa26f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:32.758584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:32.847913 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb41169-962c-4dde-ab19-fa1a7c5aa26f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:32.883242 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8da009-9bb4-4c6b-b8e4-5e90c5bea87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:32.884235 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8da009-9bb4-4c6b-b8e4-5e90c5bea87c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:32.884517 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8da009-9bb4-4c6b-b8e4-5e90c5bea87c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:32.884874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8da009-9bb4-4c6b-b8e4-5e90c5bea87c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:32.892742 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8da009-9bb4-4c6b-b8e4-5e90c5bea87c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:32.894202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8da009-9bb4-4c6b-b8e4-5e90c5bea87c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:32.909486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-9e8da009-9bb4-4c6b-b8e4-5e90c5bea87c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:10:32.909486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:32.909486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:32.909486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:32.909486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:32.909486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:32.909486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:32.909486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:32.909486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:32.909486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:32.909486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:32.909486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:32.909486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:10:32.909486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:10:32.909486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:10:32.909486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:10:32.910501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:32.910501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:32.910501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:10:32.910501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:32.910501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:10:32.910501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:32.910501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:32.910501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:32.910501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:32.910501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:32.910501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:32.910501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:32.910501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:32.910501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:32.910501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:32.910501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:32.910501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:32.910501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:32.912060 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:32.912060 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:32.912060 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:10:32.912060 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:10:32.912060 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:10:32.912060 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:10:32.912060 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:10:32.912060 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:10:32.912060 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:10:32.912060 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:32.912060 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 416/844] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:10:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:32.917061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e169396-f52d-497e-9b2c-b6a1b34df22d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:32.991030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:33.023309 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e169396-f52d-497e-9b2c-b6a1b34df22d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:33.059800 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2534e-25f6-495c-a952-2b11b9e9feed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:33.060472 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2534e-25f6-495c-a952-2b11b9e9feed None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:33.060756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2534e-25f6-495c-a952-2b11b9e9feed None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:33.061035 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2534e-25f6-495c-a952-2b11b9e9feed None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:33.061871 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2534e-25f6-495c-a952-2b11b9e9feed None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:33.062204 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2534e-25f6-495c-a952-2b11b9e9feed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:33.063670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2534e-25f6-495c-a952-2b11b9e9feed None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:33.086454 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 429/845] 10.222.0.13 () {56 vars in 1135 bytes} [Tue Jul 5 21:10:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:33.091195 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8da009-9bb4-4c6b-b8e4-5e90c5bea87c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:33.182378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:33.204447 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8da009-9bb4-4c6b-b8e4-5e90c5bea87c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:33.239331 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693fc5d-1e51-477a-b448-acca2f93c62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:33.240283 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693fc5d-1e51-477a-b448-acca2f93c62e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:33.240748 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693fc5d-1e51-477a-b448-acca2f93c62e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:33.241288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693fc5d-1e51-477a-b448-acca2f93c62e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:33.311690 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693fc5d-1e51-477a-b448-acca2f93c62e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:33.313428 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693fc5d-1e51-477a-b448-acca2f93c62e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:33.393613 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:33.417317 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 417/846] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:10:33 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:10:33.423239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2534e-25f6-495c-a952-2b11b9e9feed None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:33.529138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2534e-25f6-495c-a952-2b11b9e9feed None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:33.559346 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:33.565369 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07179b0-8d94-40bb-84e9-00f8bb543fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:33.566408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07179b0-8d94-40bb-84e9-00f8bb543fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:33.566870 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07179b0-8d94-40bb-84e9-00f8bb543fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:33.567347 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07179b0-8d94-40bb-84e9-00f8bb543fb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:33.579998 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07179b0-8d94-40bb-84e9-00f8bb543fb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:33.586026 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07179b0-8d94-40bb-84e9-00f8bb543fb5 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:33.602423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-d07179b0-8d94-40bb-84e9-00f8bb543fb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:33.602423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:33.602423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:33.602423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:33.602423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:33.602423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:33.602423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:33.602423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:33.602423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:33.602423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:33.602423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:33.602423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:33.602423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:33.602423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:33.602423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:33.604021 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:33.604021 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:33.604021 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:33.604021 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:33.604021 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:33.604021 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:33.604021 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:33.604021 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:33.604021 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:33.604021 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:33.604021 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:33.604021 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:33.604021 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:33.604021 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:33.604021 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:33.604021 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:33.604021 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:33.604934 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:33.604934 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:33.604934 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:33.604934 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:33.604934 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 430/847] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:33.608202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693fc5d-1e51-477a-b448-acca2f93c62e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:33.709861 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693fc5d-1e51-477a-b448-acca2f93c62e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:33.745464 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e7eab-a803-484a-908b-138bb4ba6f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:33.746150 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e7eab-a803-484a-908b-138bb4ba6f7f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:33.746442 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e7eab-a803-484a-908b-138bb4ba6f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:33.746719 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e7eab-a803-484a-908b-138bb4ba6f7f None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:33.747441 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e7eab-a803-484a-908b-138bb4ba6f7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:33.747747 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e7eab-a803-484a-908b-138bb4ba6f7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:33.749135 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e7eab-a803-484a-908b-138bb4ba6f7f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:33.750980 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4fbd1-b38f-4705-bcaa-18455ae14dff None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:33.751265 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4fbd1-b38f-4705-bcaa-18455ae14dff None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:33.751745 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4fbd1-b38f-4705-bcaa-18455ae14dff None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:33.753852 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 431/848] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:33.759154 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19dc3a-ce69-4101-a5ea-adb3baafabcf None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:33.759359 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19dc3a-ce69-4101-a5ea-adb3baafabcf None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:33.760069 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19dc3a-ce69-4101-a5ea-adb3baafabcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:33.763181 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 418/849] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:33.768467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e7eab-a803-484a-908b-138bb4ba6f7f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:33.781524 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-9b19dc3a-ce69-4101-a5ea-adb3baafabcf None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:33.782670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-9b19dc3a-ce69-4101-a5ea-adb3baafabcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:33.818368 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:33.857891 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 432/850] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:33.879502 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19dc3a-ce69-4101-a5ea-adb3baafabcf None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:33.891851 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e7eab-a803-484a-908b-138bb4ba6f7f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:33.930223 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b8435-e134-4256-ab66-d1ab9ff8b012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:33.931613 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b8435-e134-4256-ab66-d1ab9ff8b012 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:33.932099 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b8435-e134-4256-ab66-d1ab9ff8b012 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:33.932572 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b8435-e134-4256-ab66-d1ab9ff8b012 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:33.940608 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b8435-e134-4256-ab66-d1ab9ff8b012 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:33.942336 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b8435-e134-4256-ab66-d1ab9ff8b012 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:33.958508 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-fb5b8435-e134-4256-ab66-d1ab9ff8b012 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:33.958508 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:33.958508 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:33.958508 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:33.958508 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:33.958508 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:33.958508 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:33.958508 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:33.958508 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:33.958508 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:33.958508 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:33.958508 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:33.958508 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:10:33.958508 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:10:33.958508 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:10:33.959453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:10:33.959453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:33.959453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:33.959453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:33.959453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:33.959453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:33.959453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:33.959453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:33.959453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:33.959453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:33.959453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:33.959453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:33.959453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:33.959453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:33.959453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:33.959453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:33.959453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:33.960381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:10:33.960381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:10:33.960381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:10:33.960381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:10:33.960381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:10:33.960381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:10:33.960381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:33.960381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:33.968208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 419/851] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:33.969317 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b8435-e134-4256-ab66-d1ab9ff8b012 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:33.983106 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19dc3a-ce69-4101-a5ea-adb3baafabcf None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:33.993984 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:34.019093 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f163a7-290d-4cf4-9a4a-1b7a381922b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:34.019665 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f163a7-290d-4cf4-9a4a-1b7a381922b3 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:34.019940 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f163a7-290d-4cf4-9a4a-1b7a381922b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:34.020208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f163a7-290d-4cf4-9a4a-1b7a381922b3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:34.020851 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f163a7-290d-4cf4-9a4a-1b7a381922b3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:34.022326 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f163a7-290d-4cf4-9a4a-1b7a381922b3 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:34.035427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-73f163a7-290d-4cf4-9a4a-1b7a381922b3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:10:34.035427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:34.035427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:10:34.035427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:10:34.035427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:10:34.035427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:10:34.035427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:10:34.035427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:34.035427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:10:34.035427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:34.035427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:10:34.035427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:34.035427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:34.035427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:34.035427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:34.035427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:34.036448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:34.036448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:34.036448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:34.036448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:34.036448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:34.036448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:34.036448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:34.036448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:10:34.036448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:10:34.036448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:10:34.036448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:10:34.036448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:34.036448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:34.036448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:34.036448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:34.036448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:34.037331 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:34.037331 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:34.037331 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:34.037331 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:34.037331 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:34.037331 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:34.037331 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:34.037331 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:34.037331 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:34.037331 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:34.037331 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:34.037331 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:10:34.037331 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:34.037331 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:10:34.037331 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:34.042315 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 433/852] 10.222.0.13 () {56 vars in 1132 bytes} [Tue Jul 5 21:10:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:34.043708 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f163a7-290d-4cf4-9a4a-1b7a381922b3 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:34.081125 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:34.085416 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b8435-e134-4256-ab66-d1ab9ff8b012 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:34.120998 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa05ae9-b8bd-4cc7-bb5d-81d7fc3ece24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:34.122033 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa05ae9-b8bd-4cc7-bb5d-81d7fc3ece24 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:34.122551 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa05ae9-b8bd-4cc7-bb5d-81d7fc3ece24 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:34.123045 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa05ae9-b8bd-4cc7-bb5d-81d7fc3ece24 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:34.124047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa05ae9-b8bd-4cc7-bb5d-81d7fc3ece24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:34.124669 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa05ae9-b8bd-4cc7-bb5d-81d7fc3ece24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:34.126361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa05ae9-b8bd-4cc7-bb5d-81d7fc3ece24 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:34.144634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 420/853] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:10:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:34.145821 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa05ae9-b8bd-4cc7-bb5d-81d7fc3ece24 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:34.151502 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f163a7-290d-4cf4-9a4a-1b7a381922b3 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:34.188755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf86f3-72a1-4fc1-bf25-76af5e1c8a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:34.189420 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf86f3-72a1-4fc1-bf25-76af5e1c8a13 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:34.189700 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf86f3-72a1-4fc1-bf25-76af5e1c8a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:34.189975 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf86f3-72a1-4fc1-bf25-76af5e1c8a13 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:34.190711 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf86f3-72a1-4fc1-bf25-76af5e1c8a13 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:34.191014 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf86f3-72a1-4fc1-bf25-76af5e1c8a13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:34.192464 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf86f3-72a1-4fc1-bf25-76af5e1c8a13 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:34.205763 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 434/854] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Jul 5 21:10:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:34.206726 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf86f3-72a1-4fc1-bf25-76af5e1c8a13 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:34.250536 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:34.254987 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa05ae9-b8bd-4cc7-bb5d-81d7fc3ece24 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:34.291281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecdcdf-f372-42a2-96de-cc479d809a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:34.292287 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecdcdf-f372-42a2-96de-cc479d809a10 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:34.292789 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecdcdf-f372-42a2-96de-cc479d809a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:34.293265 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecdcdf-f372-42a2-96de-cc479d809a10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:34.295367 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eecdcdf-f372-42a2-96de-cc479d809a10 None admin] RBAC: Adding query filter params (role.id=15cf04fec8c6477088a33bf286f1bbdb, scope.project.id=1076c94b43b2483eb4fc06173f9204c3, user.id=441be62a077444b9b9f78714e24a760a) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:34.295905 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eecdcdf-f372-42a2-96de-cc479d809a10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:34.297536 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eecdcdf-f372-42a2-96de-cc479d809a10 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:34.310438 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 421/855] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:10:34 2022] GET /identity/v3/role_assignments?user.id=441be62a077444b9b9f78714e24a760a&scope.project.id=1076c94b43b2483eb4fc06173f9204c3&role.id=15cf04fec8c6477088a33bf286f1bbdb => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:34.316886 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf86f3-72a1-4fc1-bf25-76af5e1c8a13 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:34.357291 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfaf8d-8255-4604-9386-be3ea0a8815f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:34.357977 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfaf8d-8255-4604-9386-be3ea0a8815f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:34.358370 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfaf8d-8255-4604-9386-be3ea0a8815f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:34.358650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfaf8d-8255-4604-9386-be3ea0a8815f None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:34.359377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfaf8d-8255-4604-9386-be3ea0a8815f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:34.359683 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfaf8d-8255-4604-9386-be3ea0a8815f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:34.361095 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfaf8d-8255-4604-9386-be3ea0a8815f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:34.367063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 435/856] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Jul 5 21:10:34 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:34.479696 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd231c-7394-4075-8616-75075db460ef None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:34.480019 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd231c-7394-4075-8616-75075db460ef None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:34.480267 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd231c-7394-4075-8616-75075db460ef None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:34.481842 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 422/857] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:34.487632 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec52f2e-61ed-4a73-8bb3-94bc9feefb24 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:34.487921 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec52f2e-61ed-4a73-8bb3-94bc9feefb24 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:34.488195 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec52f2e-61ed-4a73-8bb3-94bc9feefb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:34.510875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-aec52f2e-61ed-4a73-8bb3-94bc9feefb24 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:34.512103 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-aec52f2e-61ed-4a73-8bb3-94bc9feefb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:34.586982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 436/858] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:34.612746 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd231c-7394-4075-8616-75075db460ef None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:34.639547 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:34.722094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd231c-7394-4075-8616-75075db460ef None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:34.760515 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60c626-41df-4721-b8fe-c14607bff2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:34.761557 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60c626-41df-4721-b8fe-c14607bff2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:34.761987 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60c626-41df-4721-b8fe-c14607bff2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:34.762430 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60c626-41df-4721-b8fe-c14607bff2f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:34.773576 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60c626-41df-4721-b8fe-c14607bff2f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:10:34.781488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-9c60c626-41df-4721-b8fe-c14607bff2f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:10:34.781488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:34.781488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:34.781488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:34.781488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:34.781488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:34.781488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:34.781488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:34.781488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:34.781488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:34.781488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:34.781488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:34.781488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:10:34.781488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:10:34.781488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:10:34.781488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:10:34.782651 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:10:34.782651 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:10:34.782651 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:10:34.782651 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:10:34.782651 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:34.782651 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:34.782651 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:34.782651 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:34.782651 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:34.782651 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:34.782651 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:34.782651 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:34.782651 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:34.782651 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:34.782651 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:34.782651 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:34.783694 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:34.783694 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:34.783694 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:34.783694 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:34.783694 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:10:34.783694 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:10:34.783694 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:10:34.783694 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:10:34.783694 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:10:34.783694 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:10:34.783694 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:10:34.783694 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:34.786022 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 423/859] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 21:10:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:34.798179 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec52f2e-61ed-4a73-8bb3-94bc9feefb24 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:34.825095 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:34.827286 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372e8f3-7175-46ac-a405-02a703cd8b9e None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:34.827569 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372e8f3-7175-46ac-a405-02a703cd8b9e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:34.827983 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372e8f3-7175-46ac-a405-02a703cd8b9e None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:34.829356 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 424/860] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:10:34.834414 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb64ba8-9cf5-42f2-8478-b07e11a6f190 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:34.834702 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb64ba8-9cf5-42f2-8478-b07e11a6f190 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:34.839040 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb64ba8-9cf5-42f2-8478-b07e11a6f190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:34.852155 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-eeb64ba8-9cf5-42f2-8478-b07e11a6f190 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:34.854009 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-eeb64ba8-9cf5-42f2-8478-b07e11a6f190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:34.912618 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec52f2e-61ed-4a73-8bb3-94bc9feefb24 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:34.931734 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 425/861] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:34.952554 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3685dd3-b3a0-42d0-9509-7bd3b2691cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:34.953394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3685dd3-b3a0-42d0-9509-7bd3b2691cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:34.953680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3685dd3-b3a0-42d0-9509-7bd3b2691cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:34.953959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3685dd3-b3a0-42d0-9509-7bd3b2691cc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:34.954443 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb64ba8-9cf5-42f2-8478-b07e11a6f190 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:34.954784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3685dd3-b3a0-42d0-9509-7bd3b2691cc5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:34.955094 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3685dd3-b3a0-42d0-9509-7bd3b2691cc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:34.956821 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3685dd3-b3a0-42d0-9509-7bd3b2691cc5 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:34.970277 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 437/862] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 21:10:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:34.974210 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3685dd3-b3a0-42d0-9509-7bd3b2691cc5 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:34.975291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:35.064294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb64ba8-9cf5-42f2-8478-b07e11a6f190 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:35.100825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7bc31-61d5-4306-8f13-101ff91d79e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:35.101501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7bc31-61d5-4306-8f13-101ff91d79e2 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:35.101850 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7bc31-61d5-4306-8f13-101ff91d79e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:35.102277 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7bc31-61d5-4306-8f13-101ff91d79e2 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:35.104009 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7bc31-61d5-4306-8f13-101ff91d79e2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:35.104262 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:35.105528 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7bc31-61d5-4306-8f13-101ff91d79e2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:35.112514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3685dd3-b3a0-42d0-9509-7bd3b2691cc5 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:35.149877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32d25f-e827-4712-97cf-bc7bdebed90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:35.150990 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32d25f-e827-4712-97cf-bc7bdebed90f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:35.151615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32d25f-e827-4712-97cf-bc7bdebed90f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:35.152056 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32d25f-e827-4712-97cf-bc7bdebed90f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:35.163639 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32d25f-e827-4712-97cf-bc7bdebed90f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:35.166046 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32d25f-e827-4712-97cf-bc7bdebed90f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:35.183075 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 426/863] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Jul 5 21:10:34 2022] POST /identity/v3/services => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:10:35.185974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-fd32d25f-e827-4712-97cf-bc7bdebed90f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:35.185974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:35.185974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:35.185974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:35.185974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:35.185974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:35.185974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:35.185974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:35.185974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:35.185974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:35.185974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:35.185974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:35.185974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:35.185974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:35.185974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:35.187124 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:35.187124 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:35.187124 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:35.187124 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:35.187124 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:35.187124 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:35.187124 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:35.187124 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:35.187124 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:35.187124 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:35.187124 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:35.187124 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:35.187124 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:35.187124 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:35.187124 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:35.187124 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:35.187124 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:35.188338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:35.188338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:35.188338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:35.188338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:35.195066 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 438/864] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:35.197098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7bc31-61d5-4306-8f13-101ff91d79e2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:35.281743 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:35.328552 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7bc31-61d5-4306-8f13-101ff91d79e2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:35.366154 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91851720-1901-453c-8aef-735008e6b76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:35.366757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91851720-1901-453c-8aef-735008e6b76f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:35.367040 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91851720-1901-453c-8aef-735008e6b76f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:35.367316 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91851720-1901-453c-8aef-735008e6b76f None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:35.368601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91851720-1901-453c-8aef-735008e6b76f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:35.368909 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91851720-1901-453c-8aef-735008e6b76f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:35.370304 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91851720-1901-453c-8aef-735008e6b76f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:35.383012 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 427/865] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:35.388512 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32d25f-e827-4712-97cf-bc7bdebed90f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:35.496508 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32d25f-e827-4712-97cf-bc7bdebed90f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:35.532180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ce967-791e-46d1-ae5f-7292dd416113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:35.533251 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ce967-791e-46d1-ae5f-7292dd416113 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:35.533716 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ce967-791e-46d1-ae5f-7292dd416113 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:35.534178 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ce967-791e-46d1-ae5f-7292dd416113 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:35.543895 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ce967-791e-46d1-ae5f-7292dd416113 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:35.545673 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ce967-791e-46d1-ae5f-7292dd416113 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:35.562425 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-c63ce967-791e-46d1-ae5f-7292dd416113 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:10:35.562425 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:35.562425 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:35.562425 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:35.562425 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:35.562425 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:35.562425 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:35.562425 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:35.562425 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:35.562425 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:35.562425 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:35.562425 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:35.562425 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:10:35.562425 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:10:35.562425 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:10:35.562425 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:10:35.563681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:35.563681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:35.563681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:10:35.563681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:35.563681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:10:35.563681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:35.563681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:35.563681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:35.563681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:35.563681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:35.563681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:35.563681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:35.563681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:35.563681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:35.563681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:35.563681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:35.563681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:35.563681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:35.564882 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:35.564882 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:35.564882 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:10:35.564882 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:10:35.564882 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:10:35.564882 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:10:35.564882 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:10:35.564882 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:10:35.564882 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:10:35.564882 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:35.572379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 439/866] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Jul 5 21:10:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:35.574388 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91851720-1901-453c-8aef-735008e6b76f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:35.697480 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91851720-1901-453c-8aef-735008e6b76f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:35.725853 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:35.734353 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc815f6b-8370-4aa6-9e81-afdb9f9e49f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:35.735207 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc815f6b-8370-4aa6-9e81-afdb9f9e49f0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:35.735645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc815f6b-8370-4aa6-9e81-afdb9f9e49f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:35.736076 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc815f6b-8370-4aa6-9e81-afdb9f9e49f0 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:35.737063 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc815f6b-8370-4aa6-9e81-afdb9f9e49f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:35.740597 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc815f6b-8370-4aa6-9e81-afdb9f9e49f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:35.740597 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc815f6b-8370-4aa6-9e81-afdb9f9e49f0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:35.762176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 428/867] 10.222.0.13 () {56 vars in 1149 bytes} [Tue Jul 5 21:10:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:35.763485 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ce967-791e-46d1-ae5f-7292dd416113 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:35.776962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:35.878776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ce967-791e-46d1-ae5f-7292dd416113 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:35.919320 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb91ca-c6eb-45b6-9ac1-c5a22b07667c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:35.920131 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb91ca-c6eb-45b6-9ac1-c5a22b07667c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:35.920533 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb91ca-c6eb-45b6-9ac1-c5a22b07667c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:35.920911 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb91ca-c6eb-45b6-9ac1-c5a22b07667c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:36.003114 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb91ca-c6eb-45b6-9ac1-c5a22b07667c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:36.004651 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb91ca-c6eb-45b6-9ac1-c5a22b07667c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:36.013457 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:36.115513 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 440/868] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:10:35 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:10:36.121732 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc815f6b-8370-4aa6-9e81-afdb9f9e49f0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:36.252445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc815f6b-8370-4aa6-9e81-afdb9f9e49f0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:36.316772 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a52749-4942-4903-8da5-11268ed797f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:36.317580 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a52749-4942-4903-8da5-11268ed797f9 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:36.317863 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a52749-4942-4903-8da5-11268ed797f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:36.318152 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a52749-4942-4903-8da5-11268ed797f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:36.343218 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a52749-4942-4903-8da5-11268ed797f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:36.344687 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a52749-4942-4903-8da5-11268ed797f9 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:36.385875 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-29a52749-4942-4903-8da5-11268ed797f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:36.385875 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:36.385875 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:36.385875 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:36.385875 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:36.385875 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:36.385875 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:36.385875 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:36.385875 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:36.385875 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:36.385875 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:36.385875 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:36.385875 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:36.385875 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:36.385875 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:36.386880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:36.386880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:36.386880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:36.386880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:36.386880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:36.386880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:36.386880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:36.386880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:36.386880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:36.386880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:36.386880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:36.386880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:36.386880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:36.386880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:36.386880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:36.386880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:36.386880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:36.387801 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:36.387801 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:36.387801 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:36.387801 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:36.387801 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 429/869] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:36.393686 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb91ca-c6eb-45b6-9ac1-c5a22b07667c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:36.543663 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb91ca-c6eb-45b6-9ac1-c5a22b07667c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:36.551362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:36.558684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603146e-7472-4bde-9a86-5c9fd715ca5d None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:36.559002 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603146e-7472-4bde-9a86-5c9fd715ca5d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:36.559249 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603146e-7472-4bde-9a86-5c9fd715ca5d None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:36.561988 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 430/870] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:10:36.578037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f582669-b178-40f1-b754-16d85123ce72 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:36.578037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f582669-b178-40f1-b754-16d85123ce72 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:36.578037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f582669-b178-40f1-b754-16d85123ce72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:36.590641 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-0f582669-b178-40f1-b754-16d85123ce72 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:36.590641 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0f582669-b178-40f1-b754-16d85123ce72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:36.594690 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777750d-e5b8-48f3-8729-f159117b8f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:36.594690 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777750d-e5b8-48f3-8729-f159117b8f5f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:36.594690 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777750d-e5b8-48f3-8729-f159117b8f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:36.594690 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777750d-e5b8-48f3-8729-f159117b8f5f None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:36.597242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777750d-e5b8-48f3-8729-f159117b8f5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:36.597242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777750d-e5b8-48f3-8729-f159117b8f5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:36.597242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777750d-e5b8-48f3-8729-f159117b8f5f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:36.614271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 441/871] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:36.615575 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f415787-d2ad-41ac-8ad4-3490eba208d4 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:36.615873 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f415787-d2ad-41ac-8ad4-3490eba208d4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:36.616276 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f415787-d2ad-41ac-8ad4-3490eba208d4 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:36.617802 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 442/872] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:36.622344 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f415787-d2ad-41ac-8ad4-3490eba208d4 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:36.622866 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:36.663325 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 431/873] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:36 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:10:36.667964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5855e3-f4e3-4810-86cd-3ecb9a3c00f2 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:36.668867 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5855e3-f4e3-4810-86cd-3ecb9a3c00f2 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:36.669154 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5855e3-f4e3-4810-86cd-3ecb9a3c00f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:36.686969 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-4a5855e3-f4e3-4810-86cd-3ecb9a3c00f2 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:36.688164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4a5855e3-f4e3-4810-86cd-3ecb9a3c00f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:36.745606 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f415787-d2ad-41ac-8ad4-3490eba208d4 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:36.758818 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 432/874] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:36 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:36.759463 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5855e3-f4e3-4810-86cd-3ecb9a3c00f2 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:36.789378 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3a111-d378-4616-b844-0ba5bee3b60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:36.790968 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3a111-d378-4616-b844-0ba5bee3b60b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:36.791255 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3a111-d378-4616-b844-0ba5bee3b60b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:36.791533 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3a111-d378-4616-b844-0ba5bee3b60b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:36.798402 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3a111-d378-4616-b844-0ba5bee3b60b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:36.799851 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3a111-d378-4616-b844-0ba5bee3b60b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:36.814053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-09b3a111-d378-4616-b844-0ba5bee3b60b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:36.814053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:36.814053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:36.814053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:36.814053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:36.814053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:36.814053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:36.814053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:36.814053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:36.814053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:36.814053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:36.814053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:36.814053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:10:36.814053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:10:36.814053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:10:36.815161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:10:36.815161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:36.815161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:36.815161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:36.815161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:36.815161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:36.815161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:36.815161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:36.815161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:36.815161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:36.815161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:36.815161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:36.815161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:36.815161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:36.815161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:36.815161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:36.815161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:36.816082 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:10:36.816082 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:10:36.816082 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:10:36.816082 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:10:36.816082 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:10:36.816082 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:10:36.816082 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:36.816082 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:36.816082 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 443/875] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:36.816082 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3a111-d378-4616-b844-0ba5bee3b60b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:36.847574 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:36.877689 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:36.881162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5855e3-f4e3-4810-86cd-3ecb9a3c00f2 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:36.918362 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376faa89-75d6-4c20-bb64-df6592206493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:36.919032 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376faa89-75d6-4c20-bb64-df6592206493 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:36.919321 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376faa89-75d6-4c20-bb64-df6592206493 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:36.919599 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376faa89-75d6-4c20-bb64-df6592206493 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:36.920323 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376faa89-75d6-4c20-bb64-df6592206493 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:36.921682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376faa89-75d6-4c20-bb64-df6592206493 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:36.925905 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3a111-d378-4616-b844-0ba5bee3b60b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:36.960686 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfc47f-9caf-4da6-b93d-dbfc1dbe4cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:36.962150 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfc47f-9caf-4da6-b93d-dbfc1dbe4cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:36.962447 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfc47f-9caf-4da6-b93d-dbfc1dbe4cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:36.962725 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfc47f-9caf-4da6-b93d-dbfc1dbe4cc8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:36.963375 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dfc47f-9caf-4da6-b93d-dbfc1dbe4cc8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:36.964897 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dfc47f-9caf-4da6-b93d-dbfc1dbe4cc8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:36.977030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-71dfc47f-9caf-4da6-b93d-dbfc1dbe4cc8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:10:36.977030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:36.977030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:10:36.977030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:10:36.977030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:10:36.977030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:10:36.977030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:10:36.977030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:36.977030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:10:36.977030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:36.977030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:10:36.977030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:36.977030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:36.977030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:36.977030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:36.977030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:36.977030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:36.978232 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:36.978232 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:36.978232 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:36.978232 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:36.978232 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:36.978232 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:36.978232 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:10:36.978232 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:10:36.978232 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:10:36.978232 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:10:36.978232 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:36.978232 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:36.978232 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:36.978232 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:36.978232 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:36.978232 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:36.979100 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:36.979100 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:36.979100 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:36.979100 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:36.979100 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:36.979100 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:36.979100 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:36.979100 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:36.979100 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:36.979100 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:36.979100 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:10:36.979100 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:36.979100 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:10:36.979100 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:36.979100 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 444/876] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Jul 5 21:10:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:36.979939 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfc47f-9caf-4da6-b93d-dbfc1dbe4cc8 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:37.018424 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 433/877] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Jul 5 21:10:36 2022] POST /identity/v3/services => generated 269 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:10:37.018424 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376faa89-75d6-4c20-bb64-df6592206493 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:37.101543 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:37.113293 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfc47f-9caf-4da6-b93d-dbfc1dbe4cc8 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:37.167186 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cf030-9490-4c87-a052-c4332e6545f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:37.167961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cf030-9490-4c87-a052-c4332e6545f4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:37.168318 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cf030-9490-4c87-a052-c4332e6545f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:37.168667 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cf030-9490-4c87-a052-c4332e6545f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:37.169770 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779cf030-9490-4c87-a052-c4332e6545f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:37.170090 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779cf030-9490-4c87-a052-c4332e6545f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:37.170534 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376faa89-75d6-4c20-bb64-df6592206493 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:37.171581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779cf030-9490-4c87-a052-c4332e6545f4 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:37.190582 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 445/878] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:10:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:37.197118 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cf030-9490-4c87-a052-c4332e6545f4 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:37.218416 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69162558-3342-45c8-bb64-e5895d179845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:37.219165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69162558-3342-45c8-bb64-e5895d179845 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:37.219448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69162558-3342-45c8-bb64-e5895d179845 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:37.219720 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69162558-3342-45c8-bb64-e5895d179845 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:37.220857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69162558-3342-45c8-bb64-e5895d179845 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:37.221167 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69162558-3342-45c8-bb64-e5895d179845 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:37.222594 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69162558-3342-45c8-bb64-e5895d179845 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:37.228304 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 434/879] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Jul 5 21:10:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:37.234023 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69162558-3342-45c8-bb64-e5895d179845 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:37.257175 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:37.322233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cf030-9490-4c87-a052-c4332e6545f4 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:37.359512 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d9fd2-ba11-4f8d-89d4-6f2f2aefc665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:37.360270 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d9fd2-ba11-4f8d-89d4-6f2f2aefc665 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:37.360655 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d9fd2-ba11-4f8d-89d4-6f2f2aefc665 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:37.361038 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d9fd2-ba11-4f8d-89d4-6f2f2aefc665 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:37.362006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d9fd2-ba11-4f8d-89d4-6f2f2aefc665 None admin] RBAC: Adding query filter params (role.id=c641ed689379413190e5e4ff94eb90ba, scope.project.id=1076c94b43b2483eb4fc06173f9204c3, user.id=063ce3b820a74d648d709ab6ac4d7be2) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:37.362450 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d9fd2-ba11-4f8d-89d4-6f2f2aefc665 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:37.364036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d9fd2-ba11-4f8d-89d4-6f2f2aefc665 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:37.371672 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69162558-3342-45c8-bb64-e5895d179845 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:37.372288 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 446/880] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:10:37 2022] GET /identity/v3/role_assignments?user.id=063ce3b820a74d648d709ab6ac4d7be2&scope.project.id=1076c94b43b2483eb4fc06173f9204c3&role.id=c641ed689379413190e5e4ff94eb90ba => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:37.413669 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858de06-cc9b-463b-9440-4e9266caf9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:37.414508 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858de06-cc9b-463b-9440-4e9266caf9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:37.415004 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858de06-cc9b-463b-9440-4e9266caf9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:37.415347 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858de06-cc9b-463b-9440-4e9266caf9a0 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:37.416089 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858de06-cc9b-463b-9440-4e9266caf9a0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:37.416448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858de06-cc9b-463b-9440-4e9266caf9a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:37.417868 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858de06-cc9b-463b-9440-4e9266caf9a0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:37.430810 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 435/881] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Jul 5 21:10:37 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:37.516923 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e422e-93d1-4982-9da8-83873bff2d6d None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:37.517274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e422e-93d1-4982-9da8-83873bff2d6d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:37.517481 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e422e-93d1-4982-9da8-83873bff2d6d None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:37.519328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 447/882] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:37.525184 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d374ad-6a71-4d88-8bcd-c18df2ebdcae None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:37.525489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d374ad-6a71-4d88-8bcd-c18df2ebdcae None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:37.525749 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d374ad-6a71-4d88-8bcd-c18df2ebdcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:37.545866 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-88d374ad-6a71-4d88-8bcd-c18df2ebdcae None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:37.547134 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-88d374ad-6a71-4d88-8bcd-c18df2ebdcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:37.630571 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 436/883] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:37.653668 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e422e-93d1-4982-9da8-83873bff2d6d None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:37.669724 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:37.771492 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e422e-93d1-4982-9da8-83873bff2d6d None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:37.808281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d24e2-4b99-4487-aaf7-1eb4731784aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:37.809143 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d24e2-4b99-4487-aaf7-1eb4731784aa None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:37.809423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d24e2-4b99-4487-aaf7-1eb4731784aa None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:37.809695 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d24e2-4b99-4487-aaf7-1eb4731784aa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:37.810431 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d24e2-4b99-4487-aaf7-1eb4731784aa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:37.811810 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d24e2-4b99-4487-aaf7-1eb4731784aa None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:37.824447 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-614d24e2-4b99-4487-aaf7-1eb4731784aa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:10:37.824447 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:37.824447 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:10:37.824447 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:10:37.824447 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:10:37.824447 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:10:37.824447 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:10:37.824447 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:37.824447 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:10:37.824447 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:37.824447 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:10:37.824447 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:37.824447 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:37.824447 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:37.824447 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:37.824447 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:37.824447 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:37.825515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:37.825515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:37.825515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:37.825515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:37.825515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:37.825515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:37.825515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:10:37.825515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:10:37.825515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:10:37.825515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:10:37.825515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:37.825515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:37.825515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:37.825515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:37.825515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:37.825515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:37.826420 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:37.826420 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:37.826420 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:37.826420 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:37.826420 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:37.826420 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:37.826420 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:37.826420 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:37.826420 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:37.826420 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:37.826420 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:10:37.826420 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:37.826420 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:10:37.826420 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:37.826420 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 448/884] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 21:10:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:37.831644 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d374ad-6a71-4d88-8bcd-c18df2ebdcae None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:37.846204 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:37.938536 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d374ad-6a71-4d88-8bcd-c18df2ebdcae None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:37.974938 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b7734-bdc1-4388-b404-b687fbc631bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:37.975968 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b7734-bdc1-4388-b404-b687fbc631bd None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:37.976447 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b7734-bdc1-4388-b404-b687fbc631bd None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:37.977699 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b7734-bdc1-4388-b404-b687fbc631bd None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:37.978991 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b7734-bdc1-4388-b404-b687fbc631bd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:37.979496 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b7734-bdc1-4388-b404-b687fbc631bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:37.981054 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b7734-bdc1-4388-b404-b687fbc631bd None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:37.986632 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 437/885] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 21:10:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:37.991941 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d24e2-4b99-4487-aaf7-1eb4731784aa None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:38.076094 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:38.101270 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d24e2-4b99-4487-aaf7-1eb4731784aa None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:38.137524 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f07f4-d158-4f7b-abb8-ca4535c2d066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:38.138221 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f07f4-d158-4f7b-abb8-ca4535c2d066 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:38.138505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f07f4-d158-4f7b-abb8-ca4535c2d066 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:38.139045 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f07f4-d158-4f7b-abb8-ca4535c2d066 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:38.139749 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f07f4-d158-4f7b-abb8-ca4535c2d066 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:38.140055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f07f4-d158-4f7b-abb8-ca4535c2d066 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:38.141425 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f07f4-d158-4f7b-abb8-ca4535c2d066 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:38.146799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 449/886] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 21:10:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:38.152574 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b7734-bdc1-4388-b404-b687fbc631bd None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:38.233156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:38.259521 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b7734-bdc1-4388-b404-b687fbc631bd None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:38.295112 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b19077-d09a-4a76-ae58-01bd6a3f7945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:38.295773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b19077-d09a-4a76-ae58-01bd6a3f7945 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:38.296064 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b19077-d09a-4a76-ae58-01bd6a3f7945 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:38.296342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b19077-d09a-4a76-ae58-01bd6a3f7945 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:38.297132 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b19077-d09a-4a76-ae58-01bd6a3f7945 None admin] RBAC: Adding query filter params (interface=public, service_id=5073c898bf5346c18ec6dce7d508e20d, region_id=RegionOne) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:38.297448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b19077-d09a-4a76-ae58-01bd6a3f7945 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:38.298849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b19077-d09a-4a76-ae58-01bd6a3f7945 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:38.309463 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 438/887] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Jul 5 21:10:38 2022] GET /identity/v3/endpoints?service_id=5073c898bf5346c18ec6dce7d508e20d&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:38.310847 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f07f4-d158-4f7b-abb8-ca4535c2d066 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:38.416263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f07f4-d158-4f7b-abb8-ca4535c2d066 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:38.450533 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c091e2e-3580-48b8-b1fa-cda29659ae98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:38.451190 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c091e2e-3580-48b8-b1fa-cda29659ae98 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:38.451470 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c091e2e-3580-48b8-b1fa-cda29659ae98 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:38.451804 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c091e2e-3580-48b8-b1fa-cda29659ae98 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:38.452490 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c091e2e-3580-48b8-b1fa-cda29659ae98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:38.453909 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c091e2e-3580-48b8-b1fa-cda29659ae98 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:38.459984 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 450/888] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Jul 5 21:10:38 2022] GET /identity/v3/services => generated 1268 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:10:39.173005 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d0d46-243a-4303-998a-5c6a9455d927 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:39.173392 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d0d46-243a-4303-998a-5c6a9455d927 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:39.173570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d0d46-243a-4303-998a-5c6a9455d927 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:39.175203 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 439/889] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:39.180709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab6bc4-ba40-478e-8f16-09a7569265c7 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:39.180894 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab6bc4-ba40-478e-8f16-09a7569265c7 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:39.181139 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab6bc4-ba40-478e-8f16-09a7569265c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:39.186236 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:39.198334 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-a0ab6bc4-ba40-478e-8f16-09a7569265c7 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:39.199514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a0ab6bc4-ba40-478e-8f16-09a7569265c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:39.268185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 451/890] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:39.290568 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d0d46-243a-4303-998a-5c6a9455d927 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:39.393531 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d0d46-243a-4303-998a-5c6a9455d927 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:39.427501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11601cb-8518-4ca2-8ab3-f9a5c231dff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:39.428222 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11601cb-8518-4ca2-8ab3-f9a5c231dff3 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:39.428500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11601cb-8518-4ca2-8ab3-f9a5c231dff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:39.428771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11601cb-8518-4ca2-8ab3-f9a5c231dff3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:39.429409 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11601cb-8518-4ca2-8ab3-f9a5c231dff3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:39.431357 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11601cb-8518-4ca2-8ab3-f9a5c231dff3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:39.443430 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-d11601cb-8518-4ca2-8ab3-f9a5c231dff3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:10:39.443430 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:39.443430 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:10:39.443430 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:10:39.443430 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:10:39.443430 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:10:39.443430 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:10:39.443430 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:39.443430 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:10:39.443430 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:39.443430 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:10:39.443430 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:39.443430 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:39.443430 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:39.443430 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:39.443430 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:39.444378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:39.444378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:39.444378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:39.444378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:39.444378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:39.444378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:39.444378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:39.444378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:10:39.444378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:10:39.444378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:10:39.444378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:10:39.444378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:39.444378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:39.444378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:39.444378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:39.444378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:39.445216 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:39.445216 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:39.445216 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:39.445216 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:39.445216 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:39.445216 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:39.445216 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:39.445216 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:39.445216 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:39.445216 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:39.445216 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:39.445216 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:10:39.445216 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:39.445216 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:10:39.445216 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:39.445216 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 440/891] 10.222.0.13 () {56 vars in 1132 bytes} [Tue Jul 5 21:10:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:39.451672 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab6bc4-ba40-478e-8f16-09a7569265c7 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:39.556345 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab6bc4-ba40-478e-8f16-09a7569265c7 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:39.601974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1111c53-1170-4e53-8bad-4676a447ad18 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:39.602841 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1111c53-1170-4e53-8bad-4676a447ad18 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:39.602841 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1111c53-1170-4e53-8bad-4676a447ad18 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:39.604083 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 441/892] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:10:39.604348 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed78ee-80ca-44b6-bf50-c342bb61ea0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:39.605026 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed78ee-80ca-44b6-bf50-c342bb61ea0f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:39.605313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed78ee-80ca-44b6-bf50-c342bb61ea0f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:39.605597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed78ee-80ca-44b6-bf50-c342bb61ea0f None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:39.606421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed78ee-80ca-44b6-bf50-c342bb61ea0f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:39.606736 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed78ee-80ca-44b6-bf50-c342bb61ea0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:39.608208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed78ee-80ca-44b6-bf50-c342bb61ea0f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:39.609142 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8ce81-01db-43bc-9cda-bf30ec68ace7 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:39.609428 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8ce81-01db-43bc-9cda-bf30ec68ace7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:39.609704 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8ce81-01db-43bc-9cda-bf30ec68ace7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:39.609838 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:39.614787 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 452/893] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Jul 5 21:10:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:39.621038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:39.621335 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed78ee-80ca-44b6-bf50-c342bb61ea0f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:39.636789 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-81e8ce81-01db-43bc-9cda-bf30ec68ace7 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:39.639310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-81e8ce81-01db-43bc-9cda-bf30ec68ace7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:39.726522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 442/894] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:10:39.732677 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed78ee-80ca-44b6-bf50-c342bb61ea0f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:39.745041 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8305bc-154c-469f-a5d6-45aa8ac376cc None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:39.745626 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8305bc-154c-469f-a5d6-45aa8ac376cc None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:39.745626 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8305bc-154c-469f-a5d6-45aa8ac376cc None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:39.746957 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 443/895] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:39.747805 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8305bc-154c-469f-a5d6-45aa8ac376cc None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:39.772131 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76be58-bc04-4aca-8dec-9e1f69de64b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:39.772789 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76be58-bc04-4aca-8dec-9e1f69de64b8 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:39.773077 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76be58-bc04-4aca-8dec-9e1f69de64b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:39.773352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76be58-bc04-4aca-8dec-9e1f69de64b8 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:39.774211 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76be58-bc04-4aca-8dec-9e1f69de64b8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:39.774670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76be58-bc04-4aca-8dec-9e1f69de64b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:39.776044 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76be58-bc04-4aca-8dec-9e1f69de64b8 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:39.785788 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 453/896] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Jul 5 21:10:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:39.785788 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f9480-20f6-4d4c-a734-cdbde29a9ffb None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:39.785788 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f9480-20f6-4d4c-a734-cdbde29a9ffb None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:39.785788 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f9480-20f6-4d4c-a734-cdbde29a9ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:39.800672 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-454f9480-20f6-4d4c-a734-cdbde29a9ffb None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:39.801846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-454f9480-20f6-4d4c-a734-cdbde29a9ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:39.861004 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:39.861165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8305bc-154c-469f-a5d6-45aa8ac376cc None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:39.872896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 454/897] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:39.874951 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f9480-20f6-4d4c-a734-cdbde29a9ffb None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:39.902339 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9d53f-55f4-422a-8550-d80ea9b8f515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:39.903009 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9d53f-55f4-422a-8550-d80ea9b8f515 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:39.903293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9d53f-55f4-422a-8550-d80ea9b8f515 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:39.903573 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9d53f-55f4-422a-8550-d80ea9b8f515 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:39.904809 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9d53f-55f4-422a-8550-d80ea9b8f515 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:39.906736 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9d53f-55f4-422a-8550-d80ea9b8f515 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:39.909920 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:39.984517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f9480-20f6-4d4c-a734-cdbde29a9ffb None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:40.002147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 444/898] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Jul 5 21:10:39 2022] POST /identity/v3/services => generated 241 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:10:40.002147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9d53f-55f4-422a-8550-d80ea9b8f515 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:40.028252 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e30d8-bdfa-4262-b925-1b172e2a53f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:40.028998 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e30d8-bdfa-4262-b925-1b172e2a53f4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:40.029271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e30d8-bdfa-4262-b925-1b172e2a53f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:40.029548 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e30d8-bdfa-4262-b925-1b172e2a53f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:40.030450 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e30d8-bdfa-4262-b925-1b172e2a53f4 None admin] RBAC: Adding query filter params (interface=public, service_id=5f7052a92c7b4a90817b8d716be0df9a, region_id=RegionOne) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:40.030769 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e30d8-bdfa-4262-b925-1b172e2a53f4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:40.032182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e30d8-bdfa-4262-b925-1b172e2a53f4 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:40.038309 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 455/899] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Jul 5 21:10:39 2022] GET /identity/v3/endpoints?service_id=5f7052a92c7b4a90817b8d716be0df9a&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:40.046364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e30d8-bdfa-4262-b925-1b172e2a53f4 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:40.108579 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:40.148162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9d53f-55f4-422a-8550-d80ea9b8f515 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:40.184636 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e30d8-bdfa-4262-b925-1b172e2a53f4 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:40.192511 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b92dd-2cb1-44f5-8278-e2aafecec07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:40.193764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b92dd-2cb1-44f5-8278-e2aafecec07b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:40.194053 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b92dd-2cb1-44f5-8278-e2aafecec07b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:40.194362 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b92dd-2cb1-44f5-8278-e2aafecec07b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:40.210784 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b92dd-2cb1-44f5-8278-e2aafecec07b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:10:40.219723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-628b92dd-2cb1-44f5-8278-e2aafecec07b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:10:40.219723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:40.219723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:40.219723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:40.219723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:40.219723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:40.219723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:40.219723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:40.219723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:40.219723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:40.219723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:40.219723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:40.219723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:10:40.219723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:10:40.219723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:10:40.219723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:10:40.220684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:10:40.220684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:10:40.220684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:10:40.220684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:10:40.220684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:40.220684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:40.220684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:40.220684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:40.220684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:40.220684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:40.220684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:40.220684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:40.220684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:40.220684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:40.220684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:40.220684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:40.221539 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:40.221539 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:40.221539 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:40.221539 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:40.221539 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:10:40.221539 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:10:40.221539 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:10:40.221539 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:10:40.221539 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:10:40.221539 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:10:40.221539 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:10:40.221539 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:40.221539 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 445/900] 10.222.0.13 () {56 vars in 1120 bytes} [Tue Jul 5 21:10:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:40.227288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b92dd-2cb1-44f5-8278-e2aafecec07b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:40.234026 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfb09a-3fae-4e8e-8586-5d1fa53c4a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:40.234793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfb09a-3fae-4e8e-8586-5d1fa53c4a41 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:40.235026 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfb09a-3fae-4e8e-8586-5d1fa53c4a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:40.235298 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfb09a-3fae-4e8e-8586-5d1fa53c4a41 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:40.235982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbfb09a-3fae-4e8e-8586-5d1fa53c4a41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:40.237355 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbfb09a-3fae-4e8e-8586-5d1fa53c4a41 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:40.247402 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 456/901] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Jul 5 21:10:40 2022] GET /identity/v3/services => generated 1497 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:10:40.294730 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:40.348441 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b92dd-2cb1-44f5-8278-e2aafecec07b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:40.387200 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9baf409-28b7-4a36-911d-01ed7e8a0821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:40.388141 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baf409-28b7-4a36-911d-01ed7e8a0821 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:40.388901 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baf409-28b7-4a36-911d-01ed7e8a0821 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:40.389355 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baf409-28b7-4a36-911d-01ed7e8a0821 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:40.390292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9baf409-28b7-4a36-911d-01ed7e8a0821 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:40.390746 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9baf409-28b7-4a36-911d-01ed7e8a0821 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:40.392295 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9baf409-28b7-4a36-911d-01ed7e8a0821 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:40.403010 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 446/902] 10.222.0.13 () {56 vars in 1115 bytes} [Tue Jul 5 21:10:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:40.408330 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfb09a-3fae-4e8e-8586-5d1fa53c4a41 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:40.515873 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfb09a-3fae-4e8e-8586-5d1fa53c4a41 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:40.532033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:40.553737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c70d0-e11f-4f6a-9ab5-202bc0c15a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:40.554595 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c70d0-e11f-4f6a-9ab5-202bc0c15a54 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:40.554983 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c70d0-e11f-4f6a-9ab5-202bc0c15a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:40.555411 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c70d0-e11f-4f6a-9ab5-202bc0c15a54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:40.566432 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c70d0-e11f-4f6a-9ab5-202bc0c15a54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:40.567891 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c70d0-e11f-4f6a-9ab5-202bc0c15a54 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:40.596333 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-3f1c70d0-e11f-4f6a-9ab5-202bc0c15a54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:40.596333 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:40.596333 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:40.596333 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:40.596333 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:40.596333 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:40.596333 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:40.596333 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:40.596333 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:40.596333 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:40.596333 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:40.596333 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:40.596333 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:40.596333 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:40.596333 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:40.597219 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:40.597219 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:40.597219 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:40.597219 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:40.597219 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:40.597219 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:40.597219 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:40.597219 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:40.597219 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:40.597219 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:40.597219 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:40.597219 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:40.597219 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:40.597219 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:40.597219 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:40.597219 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:40.597219 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:40.598157 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:40.598157 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:40.598157 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:40.598157 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:40.598389 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22250a74-82a7-4a9a-a172-4443a680d7cb None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:40.598389 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22250a74-82a7-4a9a-a172-4443a680d7cb None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:40.598389 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22250a74-82a7-4a9a-a172-4443a680d7cb None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:40.598597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 457/903] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:40.599101 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 447/904] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:40.606767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0674e-e5e7-4e5a-880a-7d861fa0a628 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:40.606932 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22250a74-82a7-4a9a-a172-4443a680d7cb None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:40.607086 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0674e-e5e7-4e5a-880a-7d861fa0a628 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:40.607335 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0674e-e5e7-4e5a-880a-7d861fa0a628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:40.630948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-80e0674e-e5e7-4e5a-880a-7d861fa0a628 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:40.632149 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-80e0674e-e5e7-4e5a-880a-7d861fa0a628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:40.713076 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 458/905] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:40.738378 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0674e-e5e7-4e5a-880a-7d861fa0a628 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:40.746436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22250a74-82a7-4a9a-a172-4443a680d7cb None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:40.768806 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:40.789142 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f90ba-8872-490e-a8f8-2f58b1dd6c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:40.790390 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f90ba-8872-490e-a8f8-2f58b1dd6c3a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:40.790886 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f90ba-8872-490e-a8f8-2f58b1dd6c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:40.791395 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f90ba-8872-490e-a8f8-2f58b1dd6c3a None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:40.792333 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f90ba-8872-490e-a8f8-2f58b1dd6c3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:40.792912 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f90ba-8872-490e-a8f8-2f58b1dd6c3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:40.794638 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f90ba-8872-490e-a8f8-2f58b1dd6c3a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:40.808706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 448/906] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:40.813781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f90ba-8872-490e-a8f8-2f58b1dd6c3a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:40.853463 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:40.859844 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0674e-e5e7-4e5a-880a-7d861fa0a628 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:40.900230 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4233a2e-a8e0-4127-96af-a2ba9d867de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:40.901206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4233a2e-a8e0-4127-96af-a2ba9d867de6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:40.901590 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4233a2e-a8e0-4127-96af-a2ba9d867de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:40.901970 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4233a2e-a8e0-4127-96af-a2ba9d867de6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:40.902756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4233a2e-a8e0-4127-96af-a2ba9d867de6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:40.904356 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4233a2e-a8e0-4127-96af-a2ba9d867de6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:40.921377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-e4233a2e-a8e0-4127-96af-a2ba9d867de6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:10:40.921377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:40.921377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:10:40.921377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:10:40.921377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:10:40.921377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:10:40.921377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:10:40.921377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:40.921377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:10:40.921377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:40.921377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:10:40.921377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:40.921377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:40.921377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:40.921377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:40.921377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:40.921377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:40.922461 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:40.922461 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:40.922461 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:40.922461 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:40.922461 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:40.922461 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:40.922461 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:10:40.922461 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:10:40.922461 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:10:40.922461 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:10:40.922461 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:40.922461 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:40.922461 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:40.922461 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:40.922461 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:40.922461 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:40.923313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:40.923313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:40.923313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:40.923313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:40.923313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:40.923313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:40.923313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:40.923313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:40.923313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:40.923313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:40.923313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:10:40.923313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:40.923313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:10:40.923313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:40.927896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 459/907] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 21:10:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:40.929344 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4233a2e-a8e0-4127-96af-a2ba9d867de6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:40.933281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f90ba-8872-490e-a8f8-2f58b1dd6c3a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:40.982459 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e22e7-77b2-48df-8edf-e30acd1ea127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:40.984230 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e22e7-77b2-48df-8edf-e30acd1ea127 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:40.984695 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e22e7-77b2-48df-8edf-e30acd1ea127 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:40.985446 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e22e7-77b2-48df-8edf-e30acd1ea127 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:40.996477 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e22e7-77b2-48df-8edf-e30acd1ea127 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:40.999021 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e22e7-77b2-48df-8edf-e30acd1ea127 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:41.018402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-4a3e22e7-77b2-48df-8edf-e30acd1ea127 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:10:41.018402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:41.018402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:41.018402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:41.018402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:41.018402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:41.018402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:41.018402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:41.018402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:41.018402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:41.018402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:41.018402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:41.018402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:10:41.018402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:10:41.018402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:10:41.018402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:10:41.019507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:41.019507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:41.019507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:10:41.019507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:41.019507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:10:41.019507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:41.019507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:41.019507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:41.019507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:41.019507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:41.019507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:41.019507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:41.019507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:41.019507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:41.019507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:41.019507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:41.019507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:41.019507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:41.020489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:41.020489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:41.020489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:10:41.020489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:10:41.020489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:10:41.020489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:10:41.020489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:10:41.020489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:10:41.020489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:10:41.020489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:41.024604 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 449/908] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Jul 5 21:10:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:41.025948 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e22e7-77b2-48df-8edf-e30acd1ea127 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:41.051955 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4233a2e-a8e0-4127-96af-a2ba9d867de6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:41.061861 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:41.091581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696edf5-d383-4de2-924c-cf13529f71e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:41.092565 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696edf5-d383-4de2-924c-cf13529f71e6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:41.093057 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696edf5-d383-4de2-924c-cf13529f71e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:41.093517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696edf5-d383-4de2-924c-cf13529f71e6 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:41.094426 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696edf5-d383-4de2-924c-cf13529f71e6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:41.094926 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696edf5-d383-4de2-924c-cf13529f71e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:41.096456 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696edf5-d383-4de2-924c-cf13529f71e6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:41.102049 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 460/909] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 21:10:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:41.111111 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696edf5-d383-4de2-924c-cf13529f71e6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:41.130740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e22e7-77b2-48df-8edf-e30acd1ea127 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:41.144368 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:41.169050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f1e35-42a2-4dcc-b166-a33201830b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:41.170505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f1e35-42a2-4dcc-b166-a33201830b5f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:41.170961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f1e35-42a2-4dcc-b166-a33201830b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:41.171674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f1e35-42a2-4dcc-b166-a33201830b5f None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:41.172835 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f1e35-42a2-4dcc-b166-a33201830b5f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:41.173302 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f1e35-42a2-4dcc-b166-a33201830b5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:41.175546 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f1e35-42a2-4dcc-b166-a33201830b5f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:41.207916 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 450/910] 10.222.0.13 () {56 vars in 1149 bytes} [Tue Jul 5 21:10:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:41.209752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f1e35-42a2-4dcc-b166-a33201830b5f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:41.232364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696edf5-d383-4de2-924c-cf13529f71e6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:41.271171 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4993159-1000-4a28-af84-12f759712061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:41.272183 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4993159-1000-4a28-af84-12f759712061 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:41.272668 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4993159-1000-4a28-af84-12f759712061 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:41.273158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4993159-1000-4a28-af84-12f759712061 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:41.274097 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4993159-1000-4a28-af84-12f759712061 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:41.274739 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4993159-1000-4a28-af84-12f759712061 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:41.276309 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4993159-1000-4a28-af84-12f759712061 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:41.286294 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 461/911] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 21:10:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:41.288199 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4993159-1000-4a28-af84-12f759712061 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:41.310903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:41.318196 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f1e35-42a2-4dcc-b166-a33201830b5f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:41.363582 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3bbbd-b4fb-461e-a72d-dbca62914dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:41.364870 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3bbbd-b4fb-461e-a72d-dbca62914dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:41.365331 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3bbbd-b4fb-461e-a72d-dbca62914dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:41.365756 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3bbbd-b4fb-461e-a72d-dbca62914dd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:41.400151 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:41.417128 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4993159-1000-4a28-af84-12f759712061 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:41.457733 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3bbbd-b4fb-461e-a72d-dbca62914dd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:41.459210 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3bbbd-b4fb-461e-a72d-dbca62914dd7 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:41.467426 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3fe15-5663-42b7-8d51-3276a0c367e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:41.468882 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3fe15-5663-42b7-8d51-3276a0c367e6 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:41.469375 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3fe15-5663-42b7-8d51-3276a0c367e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:41.469852 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3fe15-5663-42b7-8d51-3276a0c367e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:41.471321 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3fe15-5663-42b7-8d51-3276a0c367e6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:41.473796 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3fe15-5663-42b7-8d51-3276a0c367e6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:41.558755 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:41.567771 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 462/912] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Jul 5 21:10:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:10:41.571546 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 451/913] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:10:41 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:10:41.577387 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3fe15-5663-42b7-8d51-3276a0c367e6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:41.704766 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3fe15-5663-42b7-8d51-3276a0c367e6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:41.744241 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10faf074-64cd-44a6-9d58-72e739379783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:41.745060 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10faf074-64cd-44a6-9d58-72e739379783 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:41.745342 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10faf074-64cd-44a6-9d58-72e739379783 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:41.745615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10faf074-64cd-44a6-9d58-72e739379783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:41.756077 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:41.759890 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10faf074-64cd-44a6-9d58-72e739379783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:41.761449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10faf074-64cd-44a6-9d58-72e739379783 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:41.780158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-10faf074-64cd-44a6-9d58-72e739379783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:41.780158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:41.780158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:41.780158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:41.780158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:41.780158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:41.780158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:41.780158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:41.780158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:41.780158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:41.780158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:41.780158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:41.780158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:41.780158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:41.780158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:41.781112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:41.781112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:41.781112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:41.781112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:41.781112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:41.781112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:41.781112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:41.781112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:41.781112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:41.781112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:41.781112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:41.781112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:41.781112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:41.781112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:41.781112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:41.781112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:41.781112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:41.782339 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:41.782339 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:41.782339 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:41.782339 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:41.782339 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 463/914] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:41.788676 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3bbbd-b4fb-461e-a72d-dbca62914dd7 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:41.905568 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3bbbd-b4fb-461e-a72d-dbca62914dd7 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:41.943446 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bf087-9e27-414c-b55c-e460c7ddd8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:41.944116 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bf087-9e27-414c-b55c-e460c7ddd8ff None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:41.944400 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bf087-9e27-414c-b55c-e460c7ddd8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:41.944677 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bf087-9e27-414c-b55c-e460c7ddd8ff None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:41.946051 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878bf087-9e27-414c-b55c-e460c7ddd8ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:41.946402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878bf087-9e27-414c-b55c-e460c7ddd8ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:41.947822 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878bf087-9e27-414c-b55c-e460c7ddd8ff None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:41.964719 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 452/915] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:41.966084 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10faf074-64cd-44a6-9d58-72e739379783 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:42.082855 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10faf074-64cd-44a6-9d58-72e739379783 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:42.121063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af2d89-730a-46b5-b844-683d7a9e9886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:42.122207 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af2d89-730a-46b5-b844-683d7a9e9886 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:42.122645 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af2d89-730a-46b5-b844-683d7a9e9886 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:42.123076 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af2d89-730a-46b5-b844-683d7a9e9886 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:42.130191 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af2d89-730a-46b5-b844-683d7a9e9886 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:42.131831 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af2d89-730a-46b5-b844-683d7a9e9886 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:42.146924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-96af2d89-730a-46b5-b844-683d7a9e9886 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:42.146924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:42.146924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:42.146924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:42.146924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:42.146924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:42.146924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:42.146924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:42.146924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:42.146924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:42.146924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:42.146924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:42.146924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:10:42.146924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:10:42.146924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:10:42.148034 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:10:42.148034 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:42.148034 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:42.148034 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:42.148034 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:42.148034 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:42.148034 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:42.148034 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:42.148034 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:42.148034 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:42.148034 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:42.148034 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:42.148034 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:42.148034 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:42.148034 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:42.148034 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:42.148034 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:42.149196 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:10:42.149196 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:10:42.149196 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:10:42.149196 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:10:42.149196 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:10:42.149196 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:10:42.149196 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:42.149196 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:42.155865 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 464/916] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:42.157399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bf087-9e27-414c-b55c-e460c7ddd8ff None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:42.217800 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:42.251750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad0375-3b3e-422b-b355-74896f3f469b None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:42.252038 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad0375-3b3e-422b-b355-74896f3f469b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:42.252324 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad0375-3b3e-422b-b355-74896f3f469b None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:42.254221 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 465/917] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:42.261051 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f5781-6301-4b24-b094-88e1c9f797a5 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:42.261718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f5781-6301-4b24-b094-88e1c9f797a5 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:42.262553 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f5781-6301-4b24-b094-88e1c9f797a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:42.271367 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bf087-9e27-414c-b55c-e460c7ddd8ff None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:42.285655 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-4f4f5781-6301-4b24-b094-88e1c9f797a5 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:42.287410 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4f4f5781-6301-4b24-b094-88e1c9f797a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:42.310495 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc53e6f-6f84-43f0-a231-001797d59afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:42.311162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc53e6f-6f84-43f0-a231-001797d59afd None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:42.311731 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc53e6f-6f84-43f0-a231-001797d59afd None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:42.311731 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc53e6f-6f84-43f0-a231-001797d59afd None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:42.312574 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc53e6f-6f84-43f0-a231-001797d59afd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:42.312885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc53e6f-6f84-43f0-a231-001797d59afd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:42.314336 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc53e6f-6f84-43f0-a231-001797d59afd None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:42.332320 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 453/918] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:10:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:42.333664 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc53e6f-6f84-43f0-a231-001797d59afd None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:42.353707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:42.386144 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 466/919] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:10:42.403806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f5781-6301-4b24-b094-88e1c9f797a5 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:42.463942 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc53e6f-6f84-43f0-a231-001797d59afd None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:42.479853 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:42.501984 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6bf24-b499-4b0b-8fca-f529c221f301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:42.502765 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6bf24-b499-4b0b-8fca-f529c221f301 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:42.503048 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6bf24-b499-4b0b-8fca-f529c221f301 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:42.503320 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6bf24-b499-4b0b-8fca-f529c221f301 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:42.504140 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6bf24-b499-4b0b-8fca-f529c221f301 None admin] RBAC: Adding query filter params (role.id=16c0534ca3dd473eb63776e14107ad0b, scope.project.id=1076c94b43b2483eb4fc06173f9204c3, user.id=063ce3b820a74d648d709ab6ac4d7be2) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:42.504448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6bf24-b499-4b0b-8fca-f529c221f301 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:42.506147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6bf24-b499-4b0b-8fca-f529c221f301 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:42.509019 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f5781-6301-4b24-b094-88e1c9f797a5 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:42.521158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 454/920] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:10:42 2022] GET /identity/v3/role_assignments?user.id=063ce3b820a74d648d709ab6ac4d7be2&scope.project.id=1076c94b43b2483eb4fc06173f9204c3&role.id=16c0534ca3dd473eb63776e14107ad0b => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:42.521158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb06c0-5ce9-4772-aa03-47c7ccfd75d7 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:42.521158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb06c0-5ce9-4772-aa03-47c7ccfd75d7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:42.521158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb06c0-5ce9-4772-aa03-47c7ccfd75d7 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:42.521158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 455/921] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:42.521675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb6626-6361-4c00-a1f2-389fe858627c None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:42.521895 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb6626-6361-4c00-a1f2-389fe858627c None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:42.522195 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb6626-6361-4c00-a1f2-389fe858627c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:42.541738 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-33eb6626-6361-4c00-a1f2-389fe858627c None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:42.543006 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-33eb6626-6361-4c00-a1f2-389fe858627c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:42.560495 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47039a6a-daf6-4f6b-b1ed-03acb9726c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:42.561943 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47039a6a-daf6-4f6b-b1ed-03acb9726c87 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:42.562689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47039a6a-daf6-4f6b-b1ed-03acb9726c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:42.563618 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47039a6a-daf6-4f6b-b1ed-03acb9726c87 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:42.564516 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47039a6a-daf6-4f6b-b1ed-03acb9726c87 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:42.566202 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47039a6a-daf6-4f6b-b1ed-03acb9726c87 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:42.581453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-47039a6a-daf6-4f6b-b1ed-03acb9726c87 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:10:42.581453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:42.581453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:10:42.581453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:10:42.581453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:10:42.581453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:10:42.581453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:10:42.581453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:42.581453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:10:42.581453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:42.581453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:10:42.581453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:42.581453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:42.581453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:42.581453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:42.581453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:42.581453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:42.583263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:42.583263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:42.583263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:42.583263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:42.583263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:42.583263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:42.583263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:10:42.583263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:10:42.583263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:10:42.583263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:10:42.583263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:42.583263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:42.583263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:42.583263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:42.583263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:42.583263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:42.584427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:42.584427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:42.584427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:42.584427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:42.584427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:42.584427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:42.584427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:42.584427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:42.584427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:42.584427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:42.584427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:10:42.584427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:42.584427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:10:42.584427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:42.584427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 467/922] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Jul 5 21:10:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:42.594310 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47039a6a-daf6-4f6b-b1ed-03acb9726c87 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:42.646111 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:42.658175 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 456/923] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:42.675318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb6626-6361-4c00-a1f2-389fe858627c None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:42.731738 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47039a6a-daf6-4f6b-b1ed-03acb9726c87 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:42.778756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902dcba-e622-44b3-8f21-c3ae48cc6ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:42.779893 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902dcba-e622-44b3-8f21-c3ae48cc6ccf None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:42.780177 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902dcba-e622-44b3-8f21-c3ae48cc6ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:42.780493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902dcba-e622-44b3-8f21-c3ae48cc6ccf None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:42.781867 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902dcba-e622-44b3-8f21-c3ae48cc6ccf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:42.782223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902dcba-e622-44b3-8f21-c3ae48cc6ccf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:42.783891 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902dcba-e622-44b3-8f21-c3ae48cc6ccf None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:42.791515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 468/924] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Jul 5 21:10:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:42.798162 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902dcba-e622-44b3-8f21-c3ae48cc6ccf None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:42.812039 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb6626-6361-4c00-a1f2-389fe858627c None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:42.823204 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:42.849686 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b429da-742e-45bf-9dc5-0e3d358c5475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:42.850616 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b429da-742e-45bf-9dc5-0e3d358c5475 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:42.850966 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b429da-742e-45bf-9dc5-0e3d358c5475 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:42.851309 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b429da-742e-45bf-9dc5-0e3d358c5475 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:42.852417 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b429da-742e-45bf-9dc5-0e3d358c5475 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:42.854002 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b429da-742e-45bf-9dc5-0e3d358c5475 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:42.869161 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-a5b429da-742e-45bf-9dc5-0e3d358c5475 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:10:42.869161 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:42.869161 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:10:42.869161 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:10:42.869161 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:10:42.869161 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:10:42.869161 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:10:42.869161 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:42.869161 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:10:42.869161 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:42.869161 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:10:42.869161 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:42.869161 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:42.869161 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:42.869161 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:42.869161 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:42.870208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:42.870208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:42.870208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:42.870208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:42.870208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:42.870208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:42.870208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:42.870208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:10:42.870208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:10:42.870208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:10:42.870208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:10:42.870208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:42.870208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:42.870208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:42.870208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:42.870208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:42.871126 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:42.871126 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:42.871126 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:42.871126 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:42.871126 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:42.871126 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:42.871126 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:42.871126 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:42.871126 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:42.871126 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:42.871126 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:42.871126 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:10:42.871126 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:42.871126 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:10:42.871126 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:42.871126 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 457/925] 10.222.0.13 () {56 vars in 1132 bytes} [Tue Jul 5 21:10:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:42.876365 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b429da-742e-45bf-9dc5-0e3d358c5475 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:42.930914 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902dcba-e622-44b3-8f21-c3ae48cc6ccf None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:42.943307 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:42.968940 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5e546-06f9-456c-bbb8-cf44e0bee8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:42.969958 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5e546-06f9-456c-bbb8-cf44e0bee8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:42.970472 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5e546-06f9-456c-bbb8-cf44e0bee8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:42.970957 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5e546-06f9-456c-bbb8-cf44e0bee8f9 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:42.971885 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5e546-06f9-456c-bbb8-cf44e0bee8f9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:42.972416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5e546-06f9-456c-bbb8-cf44e0bee8f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:42.973997 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5e546-06f9-456c-bbb8-cf44e0bee8f9 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:42.980212 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 469/926] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Jul 5 21:10:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:42.986677 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5e546-06f9-456c-bbb8-cf44e0bee8f9 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:43.022087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b429da-742e-45bf-9dc5-0e3d358c5475 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:43.063796 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5849e1c-4b47-48e1-8484-04bf4033afdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:43.064465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5849e1c-4b47-48e1-8484-04bf4033afdb None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:43.064835 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5849e1c-4b47-48e1-8484-04bf4033afdb None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:43.065423 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5849e1c-4b47-48e1-8484-04bf4033afdb None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:43.066482 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5849e1c-4b47-48e1-8484-04bf4033afdb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:43.067055 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5849e1c-4b47-48e1-8484-04bf4033afdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:43.068612 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5849e1c-4b47-48e1-8484-04bf4033afdb None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:43.076126 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 458/927] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Jul 5 21:10:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:43.081676 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5849e1c-4b47-48e1-8484-04bf4033afdb None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:43.121458 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5e546-06f9-456c-bbb8-cf44e0bee8f9 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:43.127159 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:43.157748 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb872a-304b-4b4f-876e-c6af0d8bcad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:43.158466 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb872a-304b-4b4f-876e-c6af0d8bcad1 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:43.158750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb872a-304b-4b4f-876e-c6af0d8bcad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:43.159028 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb872a-304b-4b4f-876e-c6af0d8bcad1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:43.159826 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb872a-304b-4b4f-876e-c6af0d8bcad1 None admin] RBAC: Adding query filter params (interface=public, service_id=5b284060f9174d0db5413bc58c615ca4, region_id=RegionOne) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:43.160141 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb872a-304b-4b4f-876e-c6af0d8bcad1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:43.161529 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb872a-304b-4b4f-876e-c6af0d8bcad1 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:43.171920 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 470/928] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Jul 5 21:10:42 2022] GET /identity/v3/endpoints?service_id=5b284060f9174d0db5413bc58c615ca4&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:43.172947 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb872a-304b-4b4f-876e-c6af0d8bcad1 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:43.213949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5849e1c-4b47-48e1-8484-04bf4033afdb None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:43.225603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:43.258866 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b062b-f73d-4cca-8a03-df3f40b8409b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:43.259441 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b062b-f73d-4cca-8a03-df3f40b8409b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:43.259720 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b062b-f73d-4cca-8a03-df3f40b8409b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:43.259993 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b062b-f73d-4cca-8a03-df3f40b8409b None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:43.260699 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b062b-f73d-4cca-8a03-df3f40b8409b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:43.261004 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b062b-f73d-4cca-8a03-df3f40b8409b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:43.262658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b062b-f73d-4cca-8a03-df3f40b8409b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:43.270341 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 459/929] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Jul 5 21:10:43 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:43.275666 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b062b-f73d-4cca-8a03-df3f40b8409b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:43.311067 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb872a-304b-4b4f-876e-c6af0d8bcad1 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:43.356508 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80bbed-cf49-48e1-9bc3-32457afa46e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:43.357725 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80bbed-cf49-48e1-9bc3-32457afa46e3 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:43.358703 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80bbed-cf49-48e1-9bc3-32457afa46e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:43.359184 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80bbed-cf49-48e1-9bc3-32457afa46e3 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:43.360286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80bbed-cf49-48e1-9bc3-32457afa46e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:43.362797 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80bbed-cf49-48e1-9bc3-32457afa46e3 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:43.382240 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 471/930] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Jul 5 21:10:43 2022] GET /identity/v3/services => generated 1497 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:10:43.409991 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:43.414904 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b062b-f73d-4cca-8a03-df3f40b8409b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:43.456004 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ae716-8b3e-4de9-9353-f922131ef44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:43.457000 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ae716-8b3e-4de9-9353-f922131ef44a None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:43.457461 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ae716-8b3e-4de9-9353-f922131ef44a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:43.457913 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ae716-8b3e-4de9-9353-f922131ef44a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:43.458950 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ae716-8b3e-4de9-9353-f922131ef44a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:43.460570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ae716-8b3e-4de9-9353-f922131ef44a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:43.568587 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 460/931] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Jul 5 21:10:43 2022] POST /identity/v3/endpoints => generated 347 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:10:43.744936 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15907174-829e-4efd-be9a-100c5d75177c None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:43.745474 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15907174-829e-4efd-be9a-100c5d75177c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:43.745474 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15907174-829e-4efd-be9a-100c5d75177c None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:43.747167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 472/932] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:43.752427 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fe27f-735c-40a3-97f6-063461c2aeed None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:43.752722 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fe27f-735c-40a3-97f6-063461c2aeed None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:43.753003 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fe27f-735c-40a3-97f6-063461c2aeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:43.772147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-1e9fe27f-735c-40a3-97f6-063461c2aeed None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:43.773691 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1e9fe27f-735c-40a3-97f6-063461c2aeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:43.858377 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 461/933] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:43.881763 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15907174-829e-4efd-be9a-100c5d75177c None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:43.996638 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15907174-829e-4efd-be9a-100c5d75177c None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:43.998667 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:44.032158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39be948-d28c-4003-87d1-bbe4822ca744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:44.032837 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39be948-d28c-4003-87d1-bbe4822ca744 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:44.033137 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39be948-d28c-4003-87d1-bbe4822ca744 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:44.033398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39be948-d28c-4003-87d1-bbe4822ca744 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:44.034137 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39be948-d28c-4003-87d1-bbe4822ca744 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:44.035590 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39be948-d28c-4003-87d1-bbe4822ca744 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:44.036969 dv-cinder-847335-3-smb devstack@keystone.service[80247]: WARNING keystone.server.flask.common [None req-f39be948-d28c-4003-87d1-bbe4822ca744 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 05 21:10:44.080723 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.sql.core [None req-f39be948-d28c-4003-87d1-bbe4822ca744 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 21:10:44.080723 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 05 21:10:44.080723 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [parameters: {'id': '7648659827ef4320910e697dffaa1eca', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 05 21:10:44.080723 dv-cinder-847335-3-smb devstack@keystone.service[80247]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80247) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 21:10:44.089185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-f39be948-d28c-4003-87d1-bbe4822ca744 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7648659827ef4320910e697dffaa1eca.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7648659827ef4320910e697dffaa1eca. Jul 05 21:10:44.089185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:44.089185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 21:10:44.089185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 21:10:44.089185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 21:10:44.089185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 21:10:44.089185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 21:10:44.089185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 21:10:44.089185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 21:10:44.089185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application conn.query(q) Jul 05 21:10:44.089185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 21:10:44.089185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 21:10:44.089185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 21:10:44.090008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application result.read() Jul 05 21:10:44.090008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 21:10:44.090008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 21:10:44.090008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 21:10:44.090008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 21:10:44.090008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 21:10:44.090008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 21:10:44.090008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 21:10:44.090008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 21:10:44.090008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 21:10:44.090008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:44.090008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 21:10:44.090008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:44.090008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:44.090008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 21:10:44.090008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 21:10:44.090008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 05 21:10:44.090008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 05 21:10:44.091052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 21:10:44.091052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application next(self.gen) Jul 05 21:10:44.091052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 21:10:44.091052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application yield resource Jul 05 21:10:44.091052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 21:10:44.091052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application next(self.gen) Jul 05 21:10:44.091052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 21:10:44.091052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 21:10:44.091052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 21:10:44.091052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 21:10:44.091052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 21:10:44.091052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise self.value Jul 05 21:10:44.091052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 21:10:44.091052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 21:10:44.091052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 21:10:44.091052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application session.commit() Jul 05 21:10:44.091052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 21:10:44.091962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 21:10:44.091962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 21:10:44.091962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 21:10:44.091962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 21:10:44.091962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self.session.flush() Jul 05 21:10:44.091962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 21:10:44.091962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 21:10:44.091962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 21:10:44.091962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 21:10:44.091962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 21:10:44.091962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application compat.raise_( Jul 05 21:10:44.091962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 21:10:44.091962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception Jul 05 21:10:44.091962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 21:10:44.091962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 21:10:44.091962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 21:10:44.091962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 21:10:44.092875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 21:10:44.092875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 21:10:44.092875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 21:10:44.092875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 21:10:44.092875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 05 21:10:44.092875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 05 21:10:44.092875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 21:10:44.092875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 21:10:44.092875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 21:10:44.092875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 21:10:44.092875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 21:10:44.092875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 21:10:44.092875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 21:10:44.092875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 21:10:44.092875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 21:10:44.093755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 21:10:44.093755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 21:10:44.093755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception Jul 05 21:10:44.093755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 21:10:44.093755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 21:10:44.093755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 21:10:44.093755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 21:10:44.093755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 21:10:44.093755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 21:10:44.093755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 21:10:44.093755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application conn.query(q) Jul 05 21:10:44.093755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 21:10:44.093755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 21:10:44.093755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 21:10:44.093755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application result.read() Jul 05 21:10:44.093755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 21:10:44.093755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 21:10:44.096247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 21:10:44.096247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 21:10:44.096247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 21:10:44.096247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 21:10:44.096247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 21:10:44.096247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 21:10:44.096247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 21:10:44.096247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 05 21:10:44.096247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [parameters: {'id': '7648659827ef4320910e697dffaa1eca', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 05 21:10:44.096247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 21:10:44.096247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:44.096247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:10:44.096247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:44.096247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:44.096247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 05 21:10:44.098185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 05 21:10:44.098185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 21:10:44.098185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 21:10:44.098185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 05 21:10:44.098185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:44.098185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:10:44.098185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:44.098185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:44.098185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:44.098185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:44.098185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:44.098185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:44.098185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:44.098185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:44.098185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:44.098185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:44.098185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:44.100352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:44.100352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 05 21:10:44.100352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 05 21:10:44.100352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:44.100352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:44.100352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 05 21:10:44.100352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 05 21:10:44.100352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7648659827ef4320910e697dffaa1eca. Jul 05 21:10:44.100352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:44.100352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 473/934] 10.222.0.13 () {60 vars in 1140 bytes} [Tue Jul 5 21:10:43 2022] POST /identity/v3/projects => generated 262 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:44.101655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fe27f-735c-40a3-97f6-063461c2aeed None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:44.188636 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:44.207923 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fe27f-735c-40a3-97f6-063461c2aeed None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:44.244742 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62087a6-aa1f-4e12-8f51-842956a3ec41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:44.246730 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62087a6-aa1f-4e12-8f51-842956a3ec41 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:44.246730 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62087a6-aa1f-4e12-8f51-842956a3ec41 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:44.246730 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62087a6-aa1f-4e12-8f51-842956a3ec41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:44.253110 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62087a6-aa1f-4e12-8f51-842956a3ec41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:44.254588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62087a6-aa1f-4e12-8f51-842956a3ec41 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:44.269648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-c62087a6-aa1f-4e12-8f51-842956a3ec41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:44.269648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:44.269648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:44.269648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:44.269648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:44.269648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:44.269648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:44.269648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:44.269648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:44.269648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:44.269648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:44.269648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:44.269648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:10:44.269648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:10:44.269648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:10:44.270681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:10:44.270681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:44.270681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:44.270681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:44.270681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:44.270681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:44.270681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:44.270681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:44.270681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:44.270681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:44.270681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:44.270681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:44.270681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:44.270681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:44.270681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:44.270681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:44.270681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:44.271652 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:10:44.271652 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:10:44.271652 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:10:44.271652 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:10:44.271652 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:10:44.271652 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:10:44.271652 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:44.271652 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:44.271652 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 462/935] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:44.277599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39be948-d28c-4003-87d1-bbe4822ca744 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:44.389360 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39be948-d28c-4003-87d1-bbe4822ca744 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:44.425225 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24deb455-fa80-409a-a573-8aeceffd9f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:44.425896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24deb455-fa80-409a-a573-8aeceffd9f26 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:44.426206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24deb455-fa80-409a-a573-8aeceffd9f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:44.426492 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24deb455-fa80-409a-a573-8aeceffd9f26 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:44.427257 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24deb455-fa80-409a-a573-8aeceffd9f26 None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:44.427566 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24deb455-fa80-409a-a573-8aeceffd9f26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:44.429203 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24deb455-fa80-409a-a573-8aeceffd9f26 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:44.450713 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 474/936] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Jul 5 21:10:44 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:44.645296 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e86def-7ec8-44a0-918e-48439c738cd0 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:44.645939 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e86def-7ec8-44a0-918e-48439c738cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:44.645939 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e86def-7ec8-44a0-918e-48439c738cd0 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:44.647700 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 463/937] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:44.653743 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad5e56-807c-429f-9934-dabca2128c6e None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:44.654039 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad5e56-807c-429f-9934-dabca2128c6e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:44.654354 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad5e56-807c-429f-9934-dabca2128c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:44.672702 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f7ad5e56-807c-429f-9934-dabca2128c6e None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:44.674422 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f7ad5e56-807c-429f-9934-dabca2128c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:44.689472 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:44.748314 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 475/938] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:44.770975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e86def-7ec8-44a0-918e-48439c738cd0 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:44.880552 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e86def-7ec8-44a0-918e-48439c738cd0 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:44.916442 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03526043-7974-4748-ad37-4947e7188992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:44.917251 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03526043-7974-4748-ad37-4947e7188992 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:44.917533 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03526043-7974-4748-ad37-4947e7188992 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:44.917807 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03526043-7974-4748-ad37-4947e7188992 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:44.928890 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03526043-7974-4748-ad37-4947e7188992 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:10:44.937674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-03526043-7974-4748-ad37-4947e7188992 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:10:44.937674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:44.937674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:44.937674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:44.937674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:44.937674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:44.937674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:44.937674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:44.937674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:44.937674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:44.937674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:44.937674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:44.937674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:10:44.937674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:10:44.937674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:10:44.937674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:10:44.938691 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:10:44.938691 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:10:44.938691 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:10:44.938691 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:10:44.938691 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:44.938691 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:44.938691 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:44.938691 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:44.938691 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:44.938691 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:44.938691 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:44.938691 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:44.938691 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:44.938691 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:44.938691 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:44.938691 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:44.939563 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:44.939563 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:44.939563 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:44.939563 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:44.939563 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:10:44.939563 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:10:44.939563 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:10:44.939563 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:10:44.939563 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:10:44.939563 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:10:44.939563 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:10:44.939563 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:44.939563 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 464/939] 10.222.0.13 () {56 vars in 1120 bytes} [Tue Jul 5 21:10:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:44.945134 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad5e56-807c-429f-9934-dabca2128c6e None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:45.061996 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad5e56-807c-429f-9934-dabca2128c6e None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:45.098735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511f6e7-b6be-4945-9fe9-34e6df4dcca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:45.099837 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511f6e7-b6be-4945-9fe9-34e6df4dcca9 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:45.100339 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511f6e7-b6be-4945-9fe9-34e6df4dcca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:45.100829 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511f6e7-b6be-4945-9fe9-34e6df4dcca9 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:45.101801 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511f6e7-b6be-4945-9fe9-34e6df4dcca9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:45.102376 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511f6e7-b6be-4945-9fe9-34e6df4dcca9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:45.103962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511f6e7-b6be-4945-9fe9-34e6df4dcca9 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:45.112874 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 476/940] 10.222.0.13 () {56 vars in 1115 bytes} [Tue Jul 5 21:10:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:45.119461 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03526043-7974-4748-ad37-4947e7188992 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:45.122316 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:45.226961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03526043-7974-4748-ad37-4947e7188992 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:45.266243 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd8363-0e85-44d9-8366-79e0ccda0b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:45.267413 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd8363-0e85-44d9-8366-79e0ccda0b22 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:45.267908 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd8363-0e85-44d9-8366-79e0ccda0b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:45.268446 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd8363-0e85-44d9-8366-79e0ccda0b22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:45.280242 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd8363-0e85-44d9-8366-79e0ccda0b22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:45.281980 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd8363-0e85-44d9-8366-79e0ccda0b22 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:45.300496 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-dbdd8363-0e85-44d9-8366-79e0ccda0b22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:45.300496 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:45.300496 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:45.300496 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:45.300496 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:45.300496 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:45.300496 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:45.300496 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:45.300496 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:45.300496 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:45.300496 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:45.300496 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:45.300496 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:45.300496 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:45.300496 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:45.301454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:45.301454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:45.301454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:45.301454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:45.301454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:45.301454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:45.301454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:45.301454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:45.301454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:45.301454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:45.301454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:45.301454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:45.301454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:45.301454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:45.301454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:45.301454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:45.301454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:45.302406 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:45.302406 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:45.302406 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:45.302406 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:45.304648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 465/941] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:45.310665 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511f6e7-b6be-4945-9fe9-34e6df4dcca9 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:45.324722 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:45.417730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511f6e7-b6be-4945-9fe9-34e6df4dcca9 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:45.453740 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1af3ae-e66e-47a6-9a67-fb0ed1a37017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:45.454792 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1af3ae-e66e-47a6-9a67-fb0ed1a37017 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:45.455296 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1af3ae-e66e-47a6-9a67-fb0ed1a37017 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:45.455784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1af3ae-e66e-47a6-9a67-fb0ed1a37017 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:45.456708 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1af3ae-e66e-47a6-9a67-fb0ed1a37017 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:45.457216 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1af3ae-e66e-47a6-9a67-fb0ed1a37017 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:45.458830 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1af3ae-e66e-47a6-9a67-fb0ed1a37017 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:45.471863 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 477/942] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:45.477752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd8363-0e85-44d9-8366-79e0ccda0b22 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:45.539764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:45.574458 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552af0cd-d13f-4680-a1d8-54d9cc7ea765 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:45.575196 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552af0cd-d13f-4680-a1d8-54d9cc7ea765 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:45.575700 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552af0cd-d13f-4680-a1d8-54d9cc7ea765 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:45.577522 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 478/943] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:45.582746 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4250c13-424f-4364-a3f9-21b9d4214a40 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:45.583355 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4250c13-424f-4364-a3f9-21b9d4214a40 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:45.583833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4250c13-424f-4364-a3f9-21b9d4214a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:45.593379 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd8363-0e85-44d9-8366-79e0ccda0b22 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:45.615446 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-c4250c13-424f-4364-a3f9-21b9d4214a40 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:45.616655 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c4250c13-424f-4364-a3f9-21b9d4214a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:45.633779 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04acc56-7e5b-4886-8530-eba31c9831dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:45.634839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04acc56-7e5b-4886-8530-eba31c9831dc None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:45.635129 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04acc56-7e5b-4886-8530-eba31c9831dc None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:45.635500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04acc56-7e5b-4886-8530-eba31c9831dc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:45.645933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04acc56-7e5b-4886-8530-eba31c9831dc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:45.647666 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04acc56-7e5b-4886-8530-eba31c9831dc None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:45.664933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-e04acc56-7e5b-4886-8530-eba31c9831dc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:10:45.664933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:45.664933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:45.664933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:45.664933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:45.664933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:45.664933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:45.664933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:45.664933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:45.664933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:45.664933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:45.664933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:45.664933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:10:45.664933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:10:45.664933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:10:45.664933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:10:45.665982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:45.665982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:45.665982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:10:45.665982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:45.665982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:10:45.665982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:45.665982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:45.665982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:45.665982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:45.665982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:45.665982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:45.665982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:45.665982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:45.665982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:45.665982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:45.665982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:45.665982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:45.665982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:45.666998 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:45.666998 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:45.666998 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:10:45.666998 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:10:45.666998 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:10:45.666998 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:10:45.666998 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:10:45.666998 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:10:45.666998 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:10:45.666998 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:45.666998 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 466/944] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Jul 5 21:10:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:45.674326 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04acc56-7e5b-4886-8530-eba31c9831dc None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:45.691949 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:45.697541 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 479/945] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:45.721449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4250c13-424f-4364-a3f9-21b9d4214a40 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:45.812329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04acc56-7e5b-4886-8530-eba31c9831dc None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:45.828448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:45.835112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4250c13-424f-4364-a3f9-21b9d4214a40 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:45.849834 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e3553-866a-4aa0-84cd-265e4cf5e463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:45.850793 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e3553-866a-4aa0-84cd-265e4cf5e463 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:45.851080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e3553-866a-4aa0-84cd-265e4cf5e463 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:45.851362 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e3553-866a-4aa0-84cd-265e4cf5e463 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:45.852308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e3553-866a-4aa0-84cd-265e4cf5e463 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:45.852827 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e3553-866a-4aa0-84cd-265e4cf5e463 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:45.854292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e3553-866a-4aa0-84cd-265e4cf5e463 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:45.876503 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 467/946] 10.222.0.13 () {56 vars in 1149 bytes} [Tue Jul 5 21:10:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:45.876503 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf788d8-3faf-476f-81a5-6950823770c6 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:45.876503 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf788d8-3faf-476f-81a5-6950823770c6 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:45.876503 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf788d8-3faf-476f-81a5-6950823770c6 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:45.876503 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 468/947] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:45.877896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f538fa5-fba2-4521-a613-e862ad4685d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:45.878731 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f538fa5-fba2-4521-a613-e862ad4685d4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:45.879024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f538fa5-fba2-4521-a613-e862ad4685d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:45.879280 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f538fa5-fba2-4521-a613-e862ad4685d4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:45.879728 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf788d8-3faf-476f-81a5-6950823770c6 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:45.879927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f538fa5-fba2-4521-a613-e862ad4685d4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:45.881298 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f538fa5-fba2-4521-a613-e862ad4685d4 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:45.895037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-1f538fa5-fba2-4521-a613-e862ad4685d4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:10:45.895037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:45.895037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:10:45.895037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:10:45.895037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:10:45.895037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:10:45.895037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:10:45.895037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:45.895037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:10:45.895037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:45.895037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:10:45.895037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:45.895037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:45.895037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:45.895037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:45.895037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:45.895037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:45.896115 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:45.896115 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:45.896115 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:45.896115 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:45.896115 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:45.896115 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:45.896115 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:10:45.896115 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:10:45.896115 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:10:45.896115 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:10:45.896115 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:45.896115 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:45.896115 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:45.896115 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:45.896115 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:45.896115 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:45.902756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:45.902756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:45.902756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:45.902756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:45.902756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:45.902756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:45.902756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:45.902756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:45.902756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:45.902756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:45.902756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:10:45.902756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:45.902756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:10:45.902756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:45.902756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 480/948] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Jul 5 21:10:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:45.903583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4f07e-6cd9-49a6-ac89-b7f43f873858 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:45.903583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4f07e-6cd9-49a6-ac89-b7f43f873858 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:45.903583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4f07e-6cd9-49a6-ac89-b7f43f873858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:45.917098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-c6d4f07e-6cd9-49a6-ac89-b7f43f873858 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:45.918307 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c6d4f07e-6cd9-49a6-ac89-b7f43f873858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:45.980662 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:45.988935 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 481/949] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:45.995374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4f07e-6cd9-49a6-ac89-b7f43f873858 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:45.998809 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf788d8-3faf-476f-81a5-6950823770c6 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:46.035525 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9393c02-8673-4815-9d97-fa4ccfdb80d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:46.036319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9393c02-8673-4815-9d97-fa4ccfdb80d8 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:46.036603 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9393c02-8673-4815-9d97-fa4ccfdb80d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:46.036882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9393c02-8673-4815-9d97-fa4ccfdb80d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:46.047777 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9393c02-8673-4815-9d97-fa4ccfdb80d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:46.049222 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9393c02-8673-4815-9d97-fa4ccfdb80d8 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:46.066935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-b9393c02-8673-4815-9d97-fa4ccfdb80d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:46.066935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:46.066935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:46.066935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:46.066935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:46.066935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:46.066935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:46.066935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:46.066935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:46.066935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:46.066935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:46.066935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:46.066935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:46.066935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:46.066935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:46.067927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:46.067927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:46.067927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:46.067927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:46.067927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:46.067927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:46.067927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:46.067927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:46.067927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:46.067927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:46.067927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:46.067927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:46.067927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:46.067927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:46.067927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:46.067927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:46.067927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:46.068831 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:46.068831 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:46.068831 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:46.068831 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:46.068831 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 469/950] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:46.069134 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9393c02-8673-4815-9d97-fa4ccfdb80d8 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:46.102741 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:46.110799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4f07e-6cd9-49a6-ac89-b7f43f873858 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:46.147979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e9dba-1194-4b4a-86f9-ce3c289bb442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:46.148638 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e9dba-1194-4b4a-86f9-ce3c289bb442 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:46.149462 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e9dba-1194-4b4a-86f9-ce3c289bb442 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:46.149933 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e9dba-1194-4b4a-86f9-ce3c289bb442 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:46.150822 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e9dba-1194-4b4a-86f9-ce3c289bb442 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:46.151126 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e9dba-1194-4b4a-86f9-ce3c289bb442 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:46.152492 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e9dba-1194-4b4a-86f9-ce3c289bb442 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:46.157528 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 482/951] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Jul 5 21:10:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:46.158353 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e9dba-1194-4b4a-86f9-ce3c289bb442 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:46.188746 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9393c02-8673-4815-9d97-fa4ccfdb80d8 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:46.219150 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:46.226584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50dc832-4a4e-4d3a-a419-88b294e7bb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:46.227437 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50dc832-4a4e-4d3a-a419-88b294e7bb97 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:46.227737 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50dc832-4a4e-4d3a-a419-88b294e7bb97 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:46.228000 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50dc832-4a4e-4d3a-a419-88b294e7bb97 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:46.228661 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50dc832-4a4e-4d3a-a419-88b294e7bb97 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:46.230031 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50dc832-4a4e-4d3a-a419-88b294e7bb97 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:46.243071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-d50dc832-4a4e-4d3a-a419-88b294e7bb97 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:10:46.243071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:46.243071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:10:46.243071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:10:46.243071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:10:46.243071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:10:46.243071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:10:46.243071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:46.243071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:10:46.243071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:46.243071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:10:46.243071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:46.243071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:46.243071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:46.243071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:46.243071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:46.243071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:46.244712 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:46.244712 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:46.244712 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:46.244712 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:46.244712 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:46.244712 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:46.244712 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:10:46.244712 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:10:46.244712 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:10:46.244712 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:10:46.244712 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:46.244712 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:46.244712 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:46.244712 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:46.244712 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:46.244712 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:46.245635 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:46.245635 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:46.245635 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:46.245635 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:46.245635 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:46.245635 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:46.245635 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:46.245635 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:46.245635 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:46.245635 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:46.245635 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:10:46.245635 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:46.245635 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:10:46.245635 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:46.245635 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 470/952] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:46.246547 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50dc832-4a4e-4d3a-a419-88b294e7bb97 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:46.266596 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e9dba-1194-4b4a-86f9-ce3c289bb442 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:46.301635 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cac25-1708-48a5-8735-3428075c8eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:46.302328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cac25-1708-48a5-8735-3428075c8eef None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:46.302636 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cac25-1708-48a5-8735-3428075c8eef None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:46.302913 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cac25-1708-48a5-8735-3428075c8eef None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:46.303638 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cac25-1708-48a5-8735-3428075c8eef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:46.303947 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cac25-1708-48a5-8735-3428075c8eef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:46.305842 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cac25-1708-48a5-8735-3428075c8eef None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:46.317181 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 483/953] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:46.317981 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cac25-1708-48a5-8735-3428075c8eef None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:46.352112 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:46.363850 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50dc832-4a4e-4d3a-a419-88b294e7bb97 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:46.403472 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6267fc7-e623-451c-aaed-3350d5f7d6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:46.404139 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6267fc7-e623-451c-aaed-3350d5f7d6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:46.404425 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6267fc7-e623-451c-aaed-3350d5f7d6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:46.404700 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6267fc7-e623-451c-aaed-3350d5f7d6c7 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:46.405412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6267fc7-e623-451c-aaed-3350d5f7d6c7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:46.405728 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6267fc7-e623-451c-aaed-3350d5f7d6c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:46.407124 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6267fc7-e623-451c-aaed-3350d5f7d6c7 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:46.412207 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 471/954] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Jul 5 21:10:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:46.417570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6267fc7-e623-451c-aaed-3350d5f7d6c7 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:46.427007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cac25-1708-48a5-8735-3428075c8eef None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:46.447066 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:46.463345 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49626421-ada5-46e8-9c7b-726828997f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:46.464015 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49626421-ada5-46e8-9c7b-726828997f3b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:46.464300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49626421-ada5-46e8-9c7b-726828997f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:46.464664 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49626421-ada5-46e8-9c7b-726828997f3b None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:46.465382 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49626421-ada5-46e8-9c7b-726828997f3b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:46.465728 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49626421-ada5-46e8-9c7b-726828997f3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:46.467134 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49626421-ada5-46e8-9c7b-726828997f3b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:46.476381 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 484/955] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Jul 5 21:10:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:46.476381 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49626421-ada5-46e8-9c7b-726828997f3b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:46.529523 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6267fc7-e623-451c-aaed-3350d5f7d6c7 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:46.567382 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11869d-1de8-41d4-8096-7f0cb683937b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:46.568182 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11869d-1de8-41d4-8096-7f0cb683937b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:46.568462 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11869d-1de8-41d4-8096-7f0cb683937b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:46.568737 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11869d-1de8-41d4-8096-7f0cb683937b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:46.576811 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11869d-1de8-41d4-8096-7f0cb683937b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:46.578399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11869d-1de8-41d4-8096-7f0cb683937b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:46.593284 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49626421-ada5-46e8-9c7b-726828997f3b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:46.593454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-5e11869d-1de8-41d4-8096-7f0cb683937b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:46.593454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:46.593454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:46.593454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:46.593454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:46.593454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:46.593454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:46.593454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:46.593454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:46.593454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:46.593454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:46.593454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:46.593454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:10:46.593454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:10:46.593454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:10:46.594364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:10:46.594364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:46.594364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:46.594364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:46.594364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:46.594364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:46.594364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:46.594364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:46.594364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:46.594364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:46.594364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:46.594364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:46.594364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:46.594364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:46.594364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:46.594364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:46.594364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:46.595320 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:10:46.595320 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:10:46.595320 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:10:46.595320 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:10:46.595320 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:10:46.595320 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:10:46.595320 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:46.595320 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:46.599145 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 472/956] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:46.600006 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11869d-1de8-41d4-8096-7f0cb683937b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:46.616328 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:46.633740 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5460d6b-550b-4c4b-97fa-8ad7a022557d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:46.643715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5460d6b-550b-4c4b-97fa-8ad7a022557d None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:46.643715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5460d6b-550b-4c4b-97fa-8ad7a022557d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:46.643715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5460d6b-550b-4c4b-97fa-8ad7a022557d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:46.643715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5460d6b-550b-4c4b-97fa-8ad7a022557d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:46.643715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5460d6b-550b-4c4b-97fa-8ad7a022557d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:46.700911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11869d-1de8-41d4-8096-7f0cb683937b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:46.717754 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 485/957] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Jul 5 21:10:46 2022] POST /identity/v3/endpoints => generated 349 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:10:46.718637 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5460d6b-550b-4c4b-97fa-8ad7a022557d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:46.751680 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650fb1d1-0657-43c2-aee7-606325a9beac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:46.752839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fb1d1-0657-43c2-aee7-606325a9beac None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:46.753413 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fb1d1-0657-43c2-aee7-606325a9beac None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:46.753874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fb1d1-0657-43c2-aee7-606325a9beac None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:46.754649 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650fb1d1-0657-43c2-aee7-606325a9beac None admin] RBAC: Adding query filter params (type=compute) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:46.754963 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650fb1d1-0657-43c2-aee7-606325a9beac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:46.756383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650fb1d1-0657-43c2-aee7-606325a9beac None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:46.761927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 473/958] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Jul 5 21:10:46 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:46.768969 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:46.776298 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c75158-cf5e-4e24-be71-153eacbee65a None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:46.777206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c75158-cf5e-4e24-be71-153eacbee65a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:46.777716 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c75158-cf5e-4e24-be71-153eacbee65a None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:46.780734 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 474/959] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:46.788714 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cff89-b42d-41b7-b9aa-c6436929dd5d None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:46.788714 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cff89-b42d-41b7-b9aa-c6436929dd5d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:46.788714 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cff89-b42d-41b7-b9aa-c6436929dd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:46.812404 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d32cff89-b42d-41b7-b9aa-c6436929dd5d None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:46.814608 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d32cff89-b42d-41b7-b9aa-c6436929dd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:46.855438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5460d6b-550b-4c4b-97fa-8ad7a022557d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:46.899401 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee8e2e-7a1a-4103-ae1d-1a2f6f6d018a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:46.900325 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee8e2e-7a1a-4103-ae1d-1a2f6f6d018a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:46.900607 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee8e2e-7a1a-4103-ae1d-1a2f6f6d018a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:46.900880 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee8e2e-7a1a-4103-ae1d-1a2f6f6d018a None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:46.901692 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee8e2e-7a1a-4103-ae1d-1a2f6f6d018a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:46.902002 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee8e2e-7a1a-4103-ae1d-1a2f6f6d018a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:46.904338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee8e2e-7a1a-4103-ae1d-1a2f6f6d018a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:46.920128 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 486/960] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:10:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:46.922922 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 475/961] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:10:46.930169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee8e2e-7a1a-4103-ae1d-1a2f6f6d018a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:46.952528 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cff89-b42d-41b7-b9aa-c6436929dd5d None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:46.954716 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:47.055753 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:47.061087 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee8e2e-7a1a-4103-ae1d-1a2f6f6d018a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:47.068722 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cff89-b42d-41b7-b9aa-c6436929dd5d None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:47.108643 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ecc4d-c0fc-49ee-ac16-993e5ef08919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:47.109224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755d9b3-42ef-4db7-930d-5973efd62fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:47.109992 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755d9b3-42ef-4db7-930d-5973efd62fde None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:47.110159 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ecc4d-c0fc-49ee-ac16-993e5ef08919 None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:47.110498 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755d9b3-42ef-4db7-930d-5973efd62fde None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:47.110782 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ecc4d-c0fc-49ee-ac16-993e5ef08919 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:47.110940 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755d9b3-42ef-4db7-930d-5973efd62fde None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:47.111355 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ecc4d-c0fc-49ee-ac16-993e5ef08919 None admin] PATH_INFO: `/v3/projects/1076c94b43b2483eb4fc06173f9204c3/users/063ce3b820a74d648d709ab6ac4d7be2/roles/16c0534ca3dd473eb63776e14107ad0b` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:47.111830 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755d9b3-42ef-4db7-930d-5973efd62fde None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:47.113343 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755d9b3-42ef-4db7-930d-5973efd62fde None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:47.114142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ecc4d-c0fc-49ee-ac16-993e5ef08919 None admin] RBAC: Authorizing `identity:create_grant(project_id=1076c94b43b2483eb4fc06173f9204c3, user_id=063ce3b820a74d648d709ab6ac4d7be2, role_id=16c0534ca3dd473eb63776e14107ad0b)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:47.114866 dv-cinder-847335-3-smb devstack@keystone.service[80246]: WARNING keystone.server.flask.common [None req-a755d9b3-42ef-4db7-930d-5973efd62fde None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 05 21:10:47.115999 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ecc4d-c0fc-49ee-ac16-993e5ef08919 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:47.177974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.sql.core [None req-a755d9b3-42ef-4db7-930d-5973efd62fde None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 21:10:47.177974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 05 21:10:47.177974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [parameters: {'user_id': '5f66d5fdc3c646d2846bef0ddedf4b89', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 05 21:10:47.177974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80246) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 21:10:47.195771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-a755d9b3-42ef-4db7-930d-5973efd62fde None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 05 21:10:47.195771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:47.195771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 21:10:47.195771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 21:10:47.195771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 21:10:47.195771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 21:10:47.195771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 21:10:47.195771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 21:10:47.195771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 21:10:47.195771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application conn.query(q) Jul 05 21:10:47.195771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 21:10:47.195771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 21:10:47.195771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 21:10:47.195771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application result.read() Jul 05 21:10:47.195771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 21:10:47.196725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 21:10:47.196725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 21:10:47.196725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 21:10:47.196725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 21:10:47.196725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 21:10:47.196725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 21:10:47.196725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 21:10:47.196725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 21:10:47.196725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:47.196725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 21:10:47.196725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:47.196725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:47.196725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 21:10:47.196725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 21:10:47.196725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 05 21:10:47.196725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 05 21:10:47.196725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 21:10:47.196725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application next(self.gen) Jul 05 21:10:47.197689 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 21:10:47.197689 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application yield resource Jul 05 21:10:47.197689 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 21:10:47.197689 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application next(self.gen) Jul 05 21:10:47.197689 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 21:10:47.197689 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 21:10:47.197689 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 21:10:47.197689 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 21:10:47.197689 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 21:10:47.197689 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise self.value Jul 05 21:10:47.197689 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 21:10:47.197689 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 21:10:47.197689 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 21:10:47.197689 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application session.commit() Jul 05 21:10:47.197689 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 21:10:47.197689 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 21:10:47.197689 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 21:10:47.198657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 21:10:47.198657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 21:10:47.198657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self.session.flush() Jul 05 21:10:47.198657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 21:10:47.198657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 21:10:47.198657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 21:10:47.198657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 21:10:47.198657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 21:10:47.198657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application compat.raise_( Jul 05 21:10:47.198657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 21:10:47.198657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception Jul 05 21:10:47.198657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 21:10:47.198657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 21:10:47.198657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 21:10:47.198657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 21:10:47.198657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 21:10:47.198657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 21:10:47.200667 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 21:10:47.200667 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 21:10:47.200667 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 05 21:10:47.200667 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 05 21:10:47.200667 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 21:10:47.200667 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 21:10:47.200667 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 21:10:47.200667 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 21:10:47.200667 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 21:10:47.200667 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 21:10:47.200667 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 21:10:47.200667 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 21:10:47.200667 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 21:10:47.200667 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 21:10:47.200667 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 21:10:47.200667 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception Jul 05 21:10:47.202682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 21:10:47.202682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 21:10:47.202682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 21:10:47.202682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 21:10:47.202682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 21:10:47.202682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 21:10:47.202682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 21:10:47.202682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application conn.query(q) Jul 05 21:10:47.202682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 21:10:47.202682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 21:10:47.202682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 21:10:47.202682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application result.read() Jul 05 21:10:47.202682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 21:10:47.202682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 21:10:47.202682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 21:10:47.202682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 21:10:47.204897 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 21:10:47.204897 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 21:10:47.204897 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 21:10:47.204897 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 21:10:47.204897 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 21:10:47.204897 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 05 21:10:47.204897 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [parameters: {'user_id': '5f66d5fdc3c646d2846bef0ddedf4b89', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 05 21:10:47.204897 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 21:10:47.204897 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:47.204897 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:10:47.204897 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:47.204897 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:47.204897 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:47.204897 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:47.204897 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:47.207073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:47.207073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:47.207073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:47.207073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:47.207073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:47.207073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:47.207073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:47.207073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 05 21:10:47.207073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 05 21:10:47.207073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:47.207073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:47.207073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:10:47.207073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:47.207073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:10:47.207073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:47.207073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 05 21:10:47.207073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 05 21:10:47.211275 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 05 21:10:47.211275 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 05 21:10:47.211275 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 21:10:47.211275 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 21:10:47.211275 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 05 21:10:47.211275 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:47.211275 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 476/962] 10.222.0.13 () {60 vars in 1131 bytes} [Tue Jul 5 21:10:46 2022] POST /identity/v3/users => generated 160 bytes in 245 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:47.211275 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755d9b3-42ef-4db7-930d-5973efd62fde None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:47.216688 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 487/963] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 21:10:46 2022] PUT /identity/v3/projects/1076c94b43b2483eb4fc06173f9204c3/users/063ce3b820a74d648d709ab6ac4d7be2/roles/16c0534ca3dd473eb63776e14107ad0b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:10:47.288889 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:47.334500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755d9b3-42ef-4db7-930d-5973efd62fde None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:47.377827 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc77fa-570c-4c6e-b9c5-b3de5623b7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:47.378665 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc77fa-570c-4c6e-b9c5-b3de5623b7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:47.378954 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc77fa-570c-4c6e-b9c5-b3de5623b7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:47.379235 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc77fa-570c-4c6e-b9c5-b3de5623b7e1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:47.388164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc77fa-570c-4c6e-b9c5-b3de5623b7e1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:47.390080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc77fa-570c-4c6e-b9c5-b3de5623b7e1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:47.405822 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-17dc77fa-570c-4c6e-b9c5-b3de5623b7e1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:10:47.405822 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:47.405822 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:47.405822 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:47.405822 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:47.405822 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:47.405822 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:47.405822 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:47.405822 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:47.405822 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:47.405822 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:47.405822 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:47.405822 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:10:47.405822 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:10:47.405822 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:10:47.405822 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:10:47.406921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:47.406921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:47.406921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:10:47.406921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:47.406921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:10:47.406921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:47.406921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:47.406921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:47.406921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:47.406921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:47.406921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:47.406921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:47.406921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:47.406921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:47.406921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:47.406921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:47.406921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:47.406921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:47.407945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:47.407945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:47.407945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:10:47.407945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:10:47.407945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:10:47.407945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:10:47.407945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:10:47.407945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:10:47.407945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:10:47.407945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:47.407945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 477/964] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:10:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:47.412889 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ecc4d-c0fc-49ee-ac16-993e5ef08919 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:47.515052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ecc4d-c0fc-49ee-ac16-993e5ef08919 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:47.551931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5051f-1592-4d44-b66f-5ddeda674937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:47.552608 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5051f-1592-4d44-b66f-5ddeda674937 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:47.552884 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5051f-1592-4d44-b66f-5ddeda674937 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:47.553158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5051f-1592-4d44-b66f-5ddeda674937 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:47.553963 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5051f-1592-4d44-b66f-5ddeda674937 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:47.554294 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5051f-1592-4d44-b66f-5ddeda674937 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:47.555767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5051f-1592-4d44-b66f-5ddeda674937 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:47.593944 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 488/965] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 21:10:47 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:48.885388 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddff6a7-adf7-42bb-87bb-c5268739911b None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:48.885887 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddff6a7-adf7-42bb-87bb-c5268739911b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:48.885887 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddff6a7-adf7-42bb-87bb-c5268739911b None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:48.890266 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 478/966] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:48.895372 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abef84-fa6f-462e-a561-f572d4f20ad6 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:48.895765 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abef84-fa6f-462e-a561-f572d4f20ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:48.895945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abef84-fa6f-462e-a561-f572d4f20ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:48.913309 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-03abef84-fa6f-462e-a561-f572d4f20ad6 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:48.914528 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-03abef84-fa6f-462e-a561-f572d4f20ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:48.924256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f29ff-d730-4841-b94f-4b8055bbadf8 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:48.924542 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f29ff-d730-4841-b94f-4b8055bbadf8 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:48.924822 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f29ff-d730-4841-b94f-4b8055bbadf8 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:48.926706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 479/967] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:10:48.926836 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:48.931090 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376e807-2b83-48d6-b20d-a39ee49af856 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:48.931375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376e807-2b83-48d6-b20d-a39ee49af856 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:48.931650 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376e807-2b83-48d6-b20d-a39ee49af856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:48.950162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-5376e807-2b83-48d6-b20d-a39ee49af856 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:48.951671 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5376e807-2b83-48d6-b20d-a39ee49af856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:48.990962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 489/968] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:49.013779 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abef84-fa6f-462e-a561-f572d4f20ad6 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:49.023318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 480/969] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:10:49.046807 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376e807-2b83-48d6-b20d-a39ee49af856 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:49.108026 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:49.118401 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abef84-fa6f-462e-a561-f572d4f20ad6 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:49.155051 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376e807-2b83-48d6-b20d-a39ee49af856 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:49.156473 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428b1ca-18ae-41fb-a177-f6e03af2582a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:49.157137 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428b1ca-18ae-41fb-a177-f6e03af2582a None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:49.158114 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428b1ca-18ae-41fb-a177-f6e03af2582a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:49.158114 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428b1ca-18ae-41fb-a177-f6e03af2582a None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:49.158441 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428b1ca-18ae-41fb-a177-f6e03af2582a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:49.159807 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428b1ca-18ae-41fb-a177-f6e03af2582a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:49.189897 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a26d8-3f2d-4e29-ad62-099f0a59e22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:49.190776 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a26d8-3f2d-4e29-ad62-099f0a59e22e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:49.191099 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a26d8-3f2d-4e29-ad62-099f0a59e22e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:49.191375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a26d8-3f2d-4e29-ad62-099f0a59e22e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:49.192034 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a26d8-3f2d-4e29-ad62-099f0a59e22e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:49.193398 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a26d8-3f2d-4e29-ad62-099f0a59e22e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:49.206030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-889a26d8-3f2d-4e29-ad62-099f0a59e22e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:10:49.206030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:49.206030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:10:49.206030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:10:49.206030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:10:49.206030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:10:49.206030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:10:49.206030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:49.206030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:10:49.206030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:49.206030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:10:49.206030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:49.206030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:49.206030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:49.206030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:49.206030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:49.206030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:49.207313 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:49.207313 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:49.207313 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:49.207313 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:49.207313 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:49.207313 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:49.207313 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:10:49.207313 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:10:49.207313 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:10:49.207313 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:10:49.207313 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:49.207313 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:49.207313 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:49.207313 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:49.207313 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:49.207313 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:49.208204 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:49.208204 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:49.208204 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:49.208204 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:49.208204 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:49.208204 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:49.208204 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:49.208204 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:49.208204 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:49.208204 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:49.208204 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:10:49.208204 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:49.208204 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:10:49.208204 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:49.208204 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 481/970] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Jul 5 21:10:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:49.213514 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a26d8-3f2d-4e29-ad62-099f0a59e22e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:49.234231 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 490/971] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Jul 5 21:10:49 2022] POST /identity/v3/services => generated 242 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:10:49.327821 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a26d8-3f2d-4e29-ad62-099f0a59e22e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:49.337491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd450ac7-d687-403e-8573-1d8e2e4bec9f None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:49.337811 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd450ac7-d687-403e-8573-1d8e2e4bec9f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:49.338052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd450ac7-d687-403e-8573-1d8e2e4bec9f None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:49.339665 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 491/972] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:10:49.345083 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa88a8-c11a-4cb0-8faf-dd0dcfe5dc0f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:49.345421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa88a8-c11a-4cb0-8faf-dd0dcfe5dc0f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:49.345648 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa88a8-c11a-4cb0-8faf-dd0dcfe5dc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:49.347820 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:49.358608 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:49.364921 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e6aa88a8-c11a-4cb0-8faf-dd0dcfe5dc0f None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:49.366185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e6aa88a8-c11a-4cb0-8faf-dd0dcfe5dc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:49.375574 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78203fad-b028-4798-95bc-9ba34e400d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:49.376751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78203fad-b028-4798-95bc-9ba34e400d3d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:49.377034 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78203fad-b028-4798-95bc-9ba34e400d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:49.377311 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78203fad-b028-4798-95bc-9ba34e400d3d None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:49.378027 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78203fad-b028-4798-95bc-9ba34e400d3d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:49.378361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78203fad-b028-4798-95bc-9ba34e400d3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:49.379751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78203fad-b028-4798-95bc-9ba34e400d3d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:49.385744 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 482/973] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Jul 5 21:10:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:49.391634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78203fad-b028-4798-95bc-9ba34e400d3d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:49.445938 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 492/974] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:10:49.470046 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa88a8-c11a-4cb0-8faf-dd0dcfe5dc0f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:49.502918 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78203fad-b028-4798-95bc-9ba34e400d3d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:49.539436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c5ea8-13c9-487e-a12c-7454a205825d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:49.540324 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c5ea8-13c9-487e-a12c-7454a205825d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:49.540604 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c5ea8-13c9-487e-a12c-7454a205825d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:49.540881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c5ea8-13c9-487e-a12c-7454a205825d None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:49.541585 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c5ea8-13c9-487e-a12c-7454a205825d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:49.541892 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c5ea8-13c9-487e-a12c-7454a205825d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:49.543292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c5ea8-13c9-487e-a12c-7454a205825d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:49.548782 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 483/975] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Jul 5 21:10:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:49.554324 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c5ea8-13c9-487e-a12c-7454a205825d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:49.575710 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa88a8-c11a-4cb0-8faf-dd0dcfe5dc0f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:49.605971 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:49.619609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a15d1-5252-450c-91da-aeead5c6f237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:49.620761 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a15d1-5252-450c-91da-aeead5c6f237 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:49.621049 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a15d1-5252-450c-91da-aeead5c6f237 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:49.621330 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a15d1-5252-450c-91da-aeead5c6f237 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:49.624086 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:49.632092 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a15d1-5252-450c-91da-aeead5c6f237 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:10:49.640703 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-014a15d1-5252-450c-91da-aeead5c6f237 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:10:49.640703 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:49.640703 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:49.640703 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:49.640703 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:49.640703 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:49.640703 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:49.640703 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:49.640703 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:49.640703 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:49.640703 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:49.640703 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:49.640703 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:10:49.640703 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:10:49.640703 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:10:49.640703 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:10:49.641671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:10:49.641671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:10:49.641671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:10:49.641671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:10:49.641671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:49.641671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:49.641671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:49.641671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:49.641671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:49.641671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:49.641671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:49.641671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:49.641671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:49.641671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:49.641671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:49.641671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:49.647945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:49.647945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:49.647945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:49.647945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:49.647945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:10:49.647945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:10:49.647945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:10:49.647945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:10:49.647945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:10:49.647945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:10:49.647945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:10:49.647945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:49.647945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 493/976] 10.222.0.13 () {56 vars in 1120 bytes} [Tue Jul 5 21:10:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:49.648732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a15d1-5252-450c-91da-aeead5c6f237 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:49.670915 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c5ea8-13c9-487e-a12c-7454a205825d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:49.705937 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8d7a6-e14c-4151-9741-65b9571b2712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:49.706545 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8d7a6-e14c-4151-9741-65b9571b2712 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:49.706835 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8d7a6-e14c-4151-9741-65b9571b2712 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:49.707112 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8d7a6-e14c-4151-9741-65b9571b2712 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:49.707922 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8d7a6-e14c-4151-9741-65b9571b2712 None admin] RBAC: Adding query filter params (interface=admin, service_id=5b284060f9174d0db5413bc58c615ca4, region_id=RegionOne) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:49.708241 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8d7a6-e14c-4151-9741-65b9571b2712 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:49.709611 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8d7a6-e14c-4151-9741-65b9571b2712 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:49.756840 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a15d1-5252-450c-91da-aeead5c6f237 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:49.791192 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5a5f3-67df-4ea2-8984-5a4ace1b8d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:49.791869 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5a5f3-67df-4ea2-8984-5a4ace1b8d46 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:49.796525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5a5f3-67df-4ea2-8984-5a4ace1b8d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:49.801404 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 484/977] 10.222.0.13 () {56 vars in 1249 bytes} [Tue Jul 5 21:10:49 2022] GET /identity/v3/endpoints?service_id=5b284060f9174d0db5413bc58c615ca4&interface=admin®ion_id=RegionOne => generated 193 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:49.801541 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5a5f3-67df-4ea2-8984-5a4ace1b8d46 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:49.801541 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5a5f3-67df-4ea2-8984-5a4ace1b8d46 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:49.801541 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5a5f3-67df-4ea2-8984-5a4ace1b8d46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:49.801541 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5a5f3-67df-4ea2-8984-5a4ace1b8d46 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:49.801851 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8d7a6-e14c-4151-9741-65b9571b2712 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:49.805094 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 494/978] 10.222.0.13 () {56 vars in 1115 bytes} [Tue Jul 5 21:10:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:49.811446 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5a5f3-67df-4ea2-8984-5a4ace1b8d46 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:49.873694 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:49.911622 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8d7a6-e14c-4151-9741-65b9571b2712 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:49.918811 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5a5f3-67df-4ea2-8984-5a4ace1b8d46 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:49.921415 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:49.955198 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc94021-771e-4514-90b7-22d066ec4fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:49.956065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc94021-771e-4514-90b7-22d066ec4fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:49.956295 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc94021-771e-4514-90b7-22d066ec4fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:49.956572 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc94021-771e-4514-90b7-22d066ec4fe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:49.957134 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a38171-3d7a-4f63-af11-0bd9083607b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:49.957800 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a38171-3d7a-4f63-af11-0bd9083607b1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:49.958086 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a38171-3d7a-4f63-af11-0bd9083607b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:49.958402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a38171-3d7a-4f63-af11-0bd9083607b1 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:49.959151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a38171-3d7a-4f63-af11-0bd9083607b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:49.960558 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a38171-3d7a-4f63-af11-0bd9083607b1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:49.968831 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc94021-771e-4514-90b7-22d066ec4fe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:49.970279 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 485/979] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Jul 5 21:10:49 2022] GET /identity/v3/services => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:10:49.970426 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc94021-771e-4514-90b7-22d066ec4fe6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:49.989833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-3fc94021-771e-4514-90b7-22d066ec4fe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:49.989833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:49.989833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:49.989833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:49.989833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:49.989833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:49.989833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:49.989833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:49.989833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:49.989833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:49.989833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:49.989833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:49.989833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:49.989833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:49.989833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:49.990976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:49.990976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:49.990976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:49.990976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:49.990976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:49.990976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:49.990976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:49.990976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:49.990976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:49.990976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:49.990976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:49.990976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:49.990976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:49.990976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:49.990976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:49.990976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:49.990976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:49.991913 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:49.991913 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:49.991913 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:49.991913 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:49.991913 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 495/980] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:49.996956 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a38171-3d7a-4f63-af11-0bd9083607b1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:50.110195 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a38171-3d7a-4f63-af11-0bd9083607b1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:50.148757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eae71b-de75-4e9b-a9f4-09cc029919f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:50.149936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eae71b-de75-4e9b-a9f4-09cc029919f2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:50.150249 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eae71b-de75-4e9b-a9f4-09cc029919f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:50.150529 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eae71b-de75-4e9b-a9f4-09cc029919f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:50.151304 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eae71b-de75-4e9b-a9f4-09cc029919f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:50.151609 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eae71b-de75-4e9b-a9f4-09cc029919f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:50.152973 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eae71b-de75-4e9b-a9f4-09cc029919f2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:50.166088 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 486/981] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:50.171527 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc94021-771e-4514-90b7-22d066ec4fe6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:50.280635 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc94021-771e-4514-90b7-22d066ec4fe6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:50.292125 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:50.315340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026840bc-7556-4552-a5ce-477afa43efdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:50.316139 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026840bc-7556-4552-a5ce-477afa43efdf None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:50.316420 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026840bc-7556-4552-a5ce-477afa43efdf None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:50.316690 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026840bc-7556-4552-a5ce-477afa43efdf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:50.325177 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026840bc-7556-4552-a5ce-477afa43efdf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:50.326671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026840bc-7556-4552-a5ce-477afa43efdf None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:50.342663 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-026840bc-7556-4552-a5ce-477afa43efdf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:10:50.342663 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:50.342663 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:50.342663 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:50.342663 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:50.342663 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:50.342663 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:50.342663 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:50.342663 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:50.342663 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:50.342663 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:50.342663 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:50.342663 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:10:50.342663 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:10:50.342663 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:10:50.342663 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:10:50.343666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:50.343666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:50.343666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:10:50.343666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:50.343666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:10:50.343666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:50.343666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:50.343666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:50.343666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:50.343666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:50.343666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:50.343666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:50.343666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:50.343666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:50.343666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:50.343666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:50.343666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:50.343666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:50.344626 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:50.344626 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:50.344626 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:10:50.344626 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:10:50.344626 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:10:50.344626 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:10:50.344626 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:10:50.344626 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:10:50.344626 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:10:50.344626 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:50.344626 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 496/982] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Jul 5 21:10:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:50.351074 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eae71b-de75-4e9b-a9f4-09cc029919f2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:50.384872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:50.459843 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eae71b-de75-4e9b-a9f4-09cc029919f2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:50.494248 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3b216-33a1-476e-9bbc-cac964ca635d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:50.494922 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3b216-33a1-476e-9bbc-cac964ca635d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:50.495202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3b216-33a1-476e-9bbc-cac964ca635d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:50.495523 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3b216-33a1-476e-9bbc-cac964ca635d None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:50.496356 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c3b216-33a1-476e-9bbc-cac964ca635d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:50.496664 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c3b216-33a1-476e-9bbc-cac964ca635d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:50.498085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c3b216-33a1-476e-9bbc-cac964ca635d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:50.516612 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 487/983] 10.222.0.13 () {56 vars in 1149 bytes} [Tue Jul 5 21:10:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:50.521984 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026840bc-7556-4552-a5ce-477afa43efdf None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:50.632218 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026840bc-7556-4552-a5ce-477afa43efdf None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:50.667091 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afdee44-80eb-45cb-84a2-83cf70489432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:50.668112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdee44-80eb-45cb-84a2-83cf70489432 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:50.668112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdee44-80eb-45cb-84a2-83cf70489432 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:50.668286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdee44-80eb-45cb-84a2-83cf70489432 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:50.708556 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:50.737890 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afdee44-80eb-45cb-84a2-83cf70489432 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:50.739928 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afdee44-80eb-45cb-84a2-83cf70489432 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:50.844539 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 497/984] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:10:50 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:10:50.845896 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3b216-33a1-476e-9bbc-cac964ca635d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:50.937124 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:50.950803 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3b216-33a1-476e-9bbc-cac964ca635d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:50.984607 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85db17-fedc-4d27-9f60-ba1f80c1db11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:50.985403 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85db17-fedc-4d27-9f60-ba1f80c1db11 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:50.985686 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85db17-fedc-4d27-9f60-ba1f80c1db11 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:50.985961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85db17-fedc-4d27-9f60-ba1f80c1db11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:50.996944 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea85db17-fedc-4d27-9f60-ba1f80c1db11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:50.998420 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea85db17-fedc-4d27-9f60-ba1f80c1db11 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:51.017119 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-ea85db17-fedc-4d27-9f60-ba1f80c1db11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:51.017119 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:51.017119 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:51.017119 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:51.017119 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:51.017119 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:51.017119 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:51.017119 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:51.017119 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:51.017119 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:51.017119 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:51.017119 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:51.017119 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:51.017119 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:51.017119 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:51.018058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:51.018058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:51.018058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:51.018058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:51.018058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:51.018058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:51.018058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:51.018058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:51.018058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:51.018058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:51.018058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:51.018058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:51.018058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:51.018058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:51.018058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:51.018058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:51.018058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:51.019025 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:51.019025 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:51.019025 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:51.019025 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:51.022439 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 488/985] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:51.024027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afdee44-80eb-45cb-84a2-83cf70489432 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:51.092823 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:51.125399 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afdee44-80eb-45cb-84a2-83cf70489432 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:51.159948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e0b39-a71e-49cf-83ea-46fa2dba0299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:51.160622 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e0b39-a71e-49cf-83ea-46fa2dba0299 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:51.160904 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e0b39-a71e-49cf-83ea-46fa2dba0299 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:51.161180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e0b39-a71e-49cf-83ea-46fa2dba0299 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:51.161896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e0b39-a71e-49cf-83ea-46fa2dba0299 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:51.162230 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e0b39-a71e-49cf-83ea-46fa2dba0299 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:51.163669 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e0b39-a71e-49cf-83ea-46fa2dba0299 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:51.176394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 498/986] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:51.182571 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85db17-fedc-4d27-9f60-ba1f80c1db11 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:51.284572 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85db17-fedc-4d27-9f60-ba1f80c1db11 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:51.313880 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5cc11-2162-462d-adf6-9c23fe1d0681 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:51.314201 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5cc11-2162-462d-adf6-9c23fe1d0681 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:51.314506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5cc11-2162-462d-adf6-9c23fe1d0681 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:51.315970 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 499/987] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:10:51.319522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2a365-60d8-4906-9658-b861d025bd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:51.320170 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2a365-60d8-4906-9658-b861d025bd26 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:51.320453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2a365-60d8-4906-9658-b861d025bd26 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:51.320564 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941c368-f345-42c9-aef8-8aa2a1a1e51a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:51.320722 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2a365-60d8-4906-9658-b861d025bd26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:51.320834 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941c368-f345-42c9-aef8-8aa2a1a1e51a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:51.321206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941c368-f345-42c9-aef8-8aa2a1a1e51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:51.328123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2a365-60d8-4906-9658-b861d025bd26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:51.329565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2a365-60d8-4906-9658-b861d025bd26 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:51.333218 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:51.341038 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-7941c368-f345-42c9-aef8-8aa2a1a1e51a None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:51.342368 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7941c368-f345-42c9-aef8-8aa2a1a1e51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:51.346342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-e2f2a365-60d8-4906-9658-b861d025bd26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:51.346342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:51.346342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:51.346342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:51.346342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:51.346342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:51.346342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:51.346342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:51.346342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:51.346342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:51.346342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:51.346342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:51.346342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:10:51.346342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:10:51.346342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:10:51.349632 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:10:51.349632 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:51.349632 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:51.349632 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:51.349632 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:51.349632 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:51.349632 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:51.349632 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:51.349632 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:51.349632 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:51.349632 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:51.349632 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:51.349632 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:51.349632 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:51.349632 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:51.349632 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:51.349632 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:51.350590 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:10:51.350590 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:10:51.350590 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:10:51.350590 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:10:51.350590 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:10:51.350590 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:10:51.350590 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:51.350590 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:51.350590 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 489/988] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:51.353985 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2a365-60d8-4906-9658-b861d025bd26 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:51.413609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 500/989] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:10:51.436697 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941c368-f345-42c9-aef8-8aa2a1a1e51a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:51.458694 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2a365-60d8-4906-9658-b861d025bd26 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:51.495579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479bd72-c50a-4eb8-a8bb-af51cbedd87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:51.496240 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479bd72-c50a-4eb8-a8bb-af51cbedd87f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:51.496527 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479bd72-c50a-4eb8-a8bb-af51cbedd87f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:51.496808 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479bd72-c50a-4eb8-a8bb-af51cbedd87f None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:51.497594 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7479bd72-c50a-4eb8-a8bb-af51cbedd87f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:51.497909 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7479bd72-c50a-4eb8-a8bb-af51cbedd87f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:51.498647 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:51.499384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7479bd72-c50a-4eb8-a8bb-af51cbedd87f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:51.512382 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 490/990] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:10:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:51.518949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479bd72-c50a-4eb8-a8bb-af51cbedd87f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:51.544537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941c368-f345-42c9-aef8-8aa2a1a1e51a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:51.581396 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77cf88-21f9-4142-a9ee-d59259755779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:51.582220 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77cf88-21f9-4142-a9ee-d59259755779 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:51.582506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77cf88-21f9-4142-a9ee-d59259755779 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:51.582783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77cf88-21f9-4142-a9ee-d59259755779 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:51.583428 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77cf88-21f9-4142-a9ee-d59259755779 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:51.584720 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:51.584836 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77cf88-21f9-4142-a9ee-d59259755779 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:51.603879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-9c77cf88-21f9-4142-a9ee-d59259755779 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:10:51.603879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:51.603879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:10:51.603879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:10:51.603879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:10:51.603879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:10:51.603879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:10:51.603879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:51.603879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:10:51.603879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:51.603879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:10:51.603879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:51.603879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:51.603879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:51.603879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:51.603879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:51.603879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:51.604875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:51.604875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:51.604875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:51.604875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:51.604875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:51.604875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:51.604875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:10:51.604875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:10:51.604875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:10:51.604875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:10:51.604875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:51.604875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:51.604875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:51.604875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:51.604875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:51.604875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:51.605790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:51.605790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:51.605790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:51.605790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:51.605790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:51.605790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:51.605790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:51.605790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:51.605790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:51.605790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:51.605790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:10:51.605790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:51.605790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:10:51.605790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:51.605790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 501/991] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:51.611429 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77cf88-21f9-4142-a9ee-d59259755779 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:51.632836 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479bd72-c50a-4eb8-a8bb-af51cbedd87f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:51.670095 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc023bff-2d45-4e06-99ff-b5cc43ff2b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:51.670905 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc023bff-2d45-4e06-99ff-b5cc43ff2b76 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:51.671189 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc023bff-2d45-4e06-99ff-b5cc43ff2b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:51.671471 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc023bff-2d45-4e06-99ff-b5cc43ff2b76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:51.672298 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc023bff-2d45-4e06-99ff-b5cc43ff2b76 None admin] RBAC: Adding query filter params (role.id=16c0534ca3dd473eb63776e14107ad0b, scope.project.id=1076c94b43b2483eb4fc06173f9204c3, user.id=063ce3b820a74d648d709ab6ac4d7be2) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:51.672615 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc023bff-2d45-4e06-99ff-b5cc43ff2b76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:51.674056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc023bff-2d45-4e06-99ff-b5cc43ff2b76 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:51.690156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 491/992] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:10:51 2022] GET /identity/v3/role_assignments?user.id=063ce3b820a74d648d709ab6ac4d7be2&scope.project.id=1076c94b43b2483eb4fc06173f9204c3&role.id=16c0534ca3dd473eb63776e14107ad0b => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:51.730778 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77cf88-21f9-4142-a9ee-d59259755779 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:51.757493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:51.770333 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e6ceb-3e4f-4f06-95da-8549cf1b958b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:51.771016 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e6ceb-3e4f-4f06-95da-8549cf1b958b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:51.771404 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e6ceb-3e4f-4f06-95da-8549cf1b958b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:51.771657 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e6ceb-3e4f-4f06-95da-8549cf1b958b None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:51.772406 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e6ceb-3e4f-4f06-95da-8549cf1b958b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:51.772717 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e6ceb-3e4f-4f06-95da-8549cf1b958b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:51.774245 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e6ceb-3e4f-4f06-95da-8549cf1b958b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:51.784691 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 502/993] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Jul 5 21:10:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:51.786086 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc023bff-2d45-4e06-99ff-b5cc43ff2b76 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:51.902544 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc023bff-2d45-4e06-99ff-b5cc43ff2b76 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:51.927316 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:51.938555 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeeaf3b-b83c-470a-9869-5ee897682e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:51.939979 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeeaf3b-b83c-470a-9869-5ee897682e7e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:51.939979 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeeaf3b-b83c-470a-9869-5ee897682e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:51.939979 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeeaf3b-b83c-470a-9869-5ee897682e7e None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:51.940507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeeaf3b-b83c-470a-9869-5ee897682e7e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:51.940814 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeeaf3b-b83c-470a-9869-5ee897682e7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:51.942203 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeeaf3b-b83c-470a-9869-5ee897682e7e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:51.947624 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 492/994] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Jul 5 21:10:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:51.953693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e6ceb-3e4f-4f06-95da-8549cf1b958b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:52.042896 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab06e04-a5ac-48eb-a1f7-e136ef618259 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:52.043241 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab06e04-a5ac-48eb-a1f7-e136ef618259 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:52.043465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab06e04-a5ac-48eb-a1f7-e136ef618259 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:52.044968 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 493/995] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:10:52.049966 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83102532-1332-4714-a7ee-6514501150f5 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:52.050288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83102532-1332-4714-a7ee-6514501150f5 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:52.050570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83102532-1332-4714-a7ee-6514501150f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:52.060187 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e6ceb-3e4f-4f06-95da-8549cf1b958b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:52.068066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-83102532-1332-4714-a7ee-6514501150f5 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:52.069257 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-83102532-1332-4714-a7ee-6514501150f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:52.104140 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b376b6-318e-4af7-a93b-2c2668234179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:52.105037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b376b6-318e-4af7-a93b-2c2668234179 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:52.105493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b376b6-318e-4af7-a93b-2c2668234179 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:52.105941 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b376b6-318e-4af7-a93b-2c2668234179 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:52.106923 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b376b6-318e-4af7-a93b-2c2668234179 None admin] RBAC: Adding query filter params (interface=public, service_id=71306e43a27842739fafbc4ad473a367, region_id=RegionOne) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:52.107408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b376b6-318e-4af7-a93b-2c2668234179 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:52.108982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b376b6-318e-4af7-a93b-2c2668234179 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:52.114808 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 503/996] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Jul 5 21:10:51 2022] GET /identity/v3/endpoints?service_id=71306e43a27842739fafbc4ad473a367&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:52.120456 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b376b6-318e-4af7-a93b-2c2668234179 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:52.147657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 494/997] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:52.171845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83102532-1332-4714-a7ee-6514501150f5 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:52.177681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:52.232634 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b376b6-318e-4af7-a93b-2c2668234179 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:52.267753 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649a640-3d08-41ff-b1ef-6268f649e234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:52.268407 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649a640-3d08-41ff-b1ef-6268f649e234 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:52.268693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649a640-3d08-41ff-b1ef-6268f649e234 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:52.268966 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649a640-3d08-41ff-b1ef-6268f649e234 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:52.269640 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649a640-3d08-41ff-b1ef-6268f649e234 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:52.271059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649a640-3d08-41ff-b1ef-6268f649e234 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:52.278893 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83102532-1332-4714-a7ee-6514501150f5 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:52.287228 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 504/998] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Jul 5 21:10:52 2022] GET /identity/v3/services => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:10:52.299358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:52.319033 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0acbb-fa01-433c-a99f-78bd20e38c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:52.319884 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0acbb-fa01-433c-a99f-78bd20e38c34 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:52.320203 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0acbb-fa01-433c-a99f-78bd20e38c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:52.320471 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0acbb-fa01-433c-a99f-78bd20e38c34 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:52.321211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0acbb-fa01-433c-a99f-78bd20e38c34 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:52.322944 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0acbb-fa01-433c-a99f-78bd20e38c34 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:52.336505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-44e0acbb-fa01-433c-a99f-78bd20e38c34 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:10:52.336505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:52.336505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:10:52.336505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:10:52.336505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:10:52.336505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:10:52.336505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:10:52.336505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:52.336505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:10:52.336505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:52.336505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:10:52.336505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:52.336505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:52.336505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:52.336505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:52.336505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:52.336505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:52.338592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:52.338592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:52.338592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:52.338592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:52.338592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:52.338592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:52.338592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:10:52.338592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:10:52.338592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:10:52.338592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:10:52.338592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:52.338592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:52.338592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:52.338592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:52.338592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:52.338592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:52.339588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:52.339588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:52.339588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:52.339588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:52.339588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:52.339588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:52.339588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:52.339588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:52.339588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:52.339588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:52.339588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:10:52.339588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:52.339588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:10:52.339588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:52.342741 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 495/999] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Jul 5 21:10:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:52.348774 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649a640-3d08-41ff-b1ef-6268f649e234 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:52.465566 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649a640-3d08-41ff-b1ef-6268f649e234 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:52.482054 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:52.499820 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322583e-3deb-452d-b084-4f9062534640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:52.500489 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322583e-3deb-452d-b084-4f9062534640 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:52.500775 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322583e-3deb-452d-b084-4f9062534640 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:52.501055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322583e-3deb-452d-b084-4f9062534640 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:52.501761 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322583e-3deb-452d-b084-4f9062534640 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:52.502071 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322583e-3deb-452d-b084-4f9062534640 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:52.503504 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322583e-3deb-452d-b084-4f9062534640 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:52.508502 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 505/1000] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Jul 5 21:10:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:52.515183 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0acbb-fa01-433c-a99f-78bd20e38c34 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:52.629065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0acbb-fa01-433c-a99f-78bd20e38c34 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:52.662892 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb93fc5-8ce6-4656-b8bd-ba060ca2ffa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:52.663559 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb93fc5-8ce6-4656-b8bd-ba060ca2ffa2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:52.663842 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb93fc5-8ce6-4656-b8bd-ba060ca2ffa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:52.664121 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb93fc5-8ce6-4656-b8bd-ba060ca2ffa2 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:52.665350 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb93fc5-8ce6-4656-b8bd-ba060ca2ffa2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:52.665737 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb93fc5-8ce6-4656-b8bd-ba060ca2ffa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:52.667122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb93fc5-8ce6-4656-b8bd-ba060ca2ffa2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:52.676581 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 496/1001] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Jul 5 21:10:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:52.678067 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322583e-3deb-452d-b084-4f9062534640 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:52.781395 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322583e-3deb-452d-b084-4f9062534640 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:52.815800 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f3a3c-bec2-4e8f-9a8d-38076f7050a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:52.816458 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f3a3c-bec2-4e8f-9a8d-38076f7050a1 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:52.816737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f3a3c-bec2-4e8f-9a8d-38076f7050a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:52.817010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f3a3c-bec2-4e8f-9a8d-38076f7050a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:52.817759 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f3a3c-bec2-4e8f-9a8d-38076f7050a1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:52.819155 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f3a3c-bec2-4e8f-9a8d-38076f7050a1 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:52.924954 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 506/1002] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Jul 5 21:10:52 2022] POST /identity/v3/endpoints => generated 325 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:10:53.758257 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95508bd6-d852-430e-b115-8551ac5df06a None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:53.759400 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95508bd6-d852-430e-b115-8551ac5df06a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:53.759555 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95508bd6-d852-430e-b115-8551ac5df06a None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:53.761246 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 497/1003] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:53.766577 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71008b23-9f1a-4198-8f94-738af3ef71dd None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:53.766983 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71008b23-9f1a-4198-8f94-738af3ef71dd None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:53.767141 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71008b23-9f1a-4198-8f94-738af3ef71dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:53.784641 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-71008b23-9f1a-4198-8f94-738af3ef71dd None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:53.785830 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-71008b23-9f1a-4198-8f94-738af3ef71dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:53.821922 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:53.862212 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 507/1004] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:53 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:53.882938 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95508bd6-d852-430e-b115-8551ac5df06a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:53.933099 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:53.987474 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95508bd6-d852-430e-b115-8551ac5df06a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:54.027842 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548d0d7-8a78-489c-95ce-6c83d2da92e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:54.028662 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548d0d7-8a78-489c-95ce-6c83d2da92e2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:54.028942 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548d0d7-8a78-489c-95ce-6c83d2da92e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:54.029215 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548d0d7-8a78-489c-95ce-6c83d2da92e2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:54.029882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548d0d7-8a78-489c-95ce-6c83d2da92e2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:54.031324 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548d0d7-8a78-489c-95ce-6c83d2da92e2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:54.044383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-d548d0d7-8a78-489c-95ce-6c83d2da92e2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:10:54.044383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:54.044383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:10:54.044383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:10:54.044383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:10:54.044383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:10:54.044383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:10:54.044383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:54.044383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:10:54.044383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:54.044383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:10:54.044383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:54.044383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:54.044383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:54.044383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:54.044383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:54.044383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:54.045477 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:54.045477 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:54.045477 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:54.045477 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:54.045477 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:54.045477 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:54.045477 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:10:54.045477 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:10:54.045477 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:10:54.045477 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:10:54.045477 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:54.045477 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:54.045477 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:54.045477 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:54.045477 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:54.045477 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:54.046943 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:54.046943 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:54.046943 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:54.046943 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:54.046943 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:54.046943 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:54.046943 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:54.046943 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:54.046943 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:54.046943 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:54.046943 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:10:54.046943 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:54.046943 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:10:54.046943 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:54.050252 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 498/1005] 10.222.0.13 () {56 vars in 1105 bytes} [Tue Jul 5 21:10:53 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:54.051599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71008b23-9f1a-4198-8f94-738af3ef71dd None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:54.154046 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71008b23-9f1a-4198-8f94-738af3ef71dd None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:54.184794 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456e6f0-f654-4dc0-a95f-bf4bbf1d1c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:54.185463 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456e6f0-f654-4dc0-a95f-bf4bbf1d1c13 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:54.185745 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456e6f0-f654-4dc0-a95f-bf4bbf1d1c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:54.186021 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456e6f0-f654-4dc0-a95f-bf4bbf1d1c13 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:54.186750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456e6f0-f654-4dc0-a95f-bf4bbf1d1c13 None admin] RBAC: Adding query filter params (name=image) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:54.187056 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456e6f0-f654-4dc0-a95f-bf4bbf1d1c13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:54.188413 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456e6f0-f654-4dc0-a95f-bf4bbf1d1c13 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:54.193405 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 508/1006] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:54.198999 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548d0d7-8a78-489c-95ce-6c83d2da92e2 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:54.297969 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548d0d7-8a78-489c-95ce-6c83d2da92e2 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:54.308766 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:54.332977 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c8472-459f-45fa-b524-e3f66e7373af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:54.333858 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c8472-459f-45fa-b524-e3f66e7373af None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:54.334319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c8472-459f-45fa-b524-e3f66e7373af None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:54.334748 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c8472-459f-45fa-b524-e3f66e7373af None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:54.335601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c8472-459f-45fa-b524-e3f66e7373af None admin] RBAC: Adding query filter params (type=image) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:54.336081 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c8472-459f-45fa-b524-e3f66e7373af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:54.338108 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c8472-459f-45fa-b524-e3f66e7373af None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:54.343604 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 499/1007] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:54 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:54.378867 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f43a0-a9a0-465c-a808-ec793448ddd3 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:54.379197 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f43a0-a9a0-465c-a808-ec793448ddd3 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:54.379425 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f43a0-a9a0-465c-a808-ec793448ddd3 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:54.380867 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 509/1008] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:54.387000 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5652a-8b66-4968-b0cf-a6d1bdf7bc54 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:54.387305 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5652a-8b66-4968-b0cf-a6d1bdf7bc54 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:54.387555 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5652a-8b66-4968-b0cf-a6d1bdf7bc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:54.406854 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-54a5652a-8b66-4968-b0cf-a6d1bdf7bc54 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:54.407994 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-54a5652a-8b66-4968-b0cf-a6d1bdf7bc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:54.487528 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 500/1009] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:54 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:54.509855 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f43a0-a9a0-465c-a808-ec793448ddd3 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:54.543426 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:54.618497 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f43a0-a9a0-465c-a808-ec793448ddd3 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:54.654656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263d0c9-c245-4cfe-8e2a-2385abec168d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:54.655457 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263d0c9-c245-4cfe-8e2a-2385abec168d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:54.655744 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263d0c9-c245-4cfe-8e2a-2385abec168d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:54.656020 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263d0c9-c245-4cfe-8e2a-2385abec168d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:54.656667 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263d0c9-c245-4cfe-8e2a-2385abec168d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:54.658098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263d0c9-c245-4cfe-8e2a-2385abec168d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:54.671514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-4263d0c9-c245-4cfe-8e2a-2385abec168d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:10:54.671514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:54.671514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:10:54.671514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:10:54.671514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:10:54.671514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:10:54.671514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:10:54.671514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:54.671514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:10:54.671514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:54.671514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:10:54.671514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:54.671514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:54.671514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:54.671514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:54.671514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:54.671514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:54.672583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:54.672583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:54.672583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:54.672583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:54.672583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:54.672583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:54.672583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:10:54.672583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:10:54.672583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:10:54.672583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:10:54.672583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:54.672583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:54.672583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:54.672583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:54.672583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:54.672583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:54.673475 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:54.673475 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:54.673475 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:54.673475 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:54.673475 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:54.673475 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:54.673475 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:54.673475 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:54.673475 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:54.673475 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:54.673475 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:10:54.673475 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:54.673475 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:10:54.673475 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:54.673475 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 510/1010] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:54.678793 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5652a-8b66-4968-b0cf-a6d1bdf7bc54 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:54.778975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5652a-8b66-4968-b0cf-a6d1bdf7bc54 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:54.781308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:54.813272 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c86001-d3ea-490c-a829-0093175b2240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:54.815237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c86001-d3ea-490c-a829-0093175b2240 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:54.815237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c86001-d3ea-490c-a829-0093175b2240 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:54.815237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c86001-d3ea-490c-a829-0093175b2240 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:54.815237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c86001-d3ea-490c-a829-0093175b2240 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:54.815491 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c86001-d3ea-490c-a829-0093175b2240 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:54.816839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c86001-d3ea-490c-a829-0093175b2240 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:54.827087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 501/1011] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Jul 5 21:10:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:54.828542 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263d0c9-c245-4cfe-8e2a-2385abec168d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:54.924395 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:54.931583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263d0c9-c245-4cfe-8e2a-2385abec168d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:54.966339 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f4d5d-d249-4790-8111-ca21a7d4eb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:54.967008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f4d5d-d249-4790-8111-ca21a7d4eb87 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:54.967293 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f4d5d-d249-4790-8111-ca21a7d4eb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:54.967568 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f4d5d-d249-4790-8111-ca21a7d4eb87 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:54.968278 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f4d5d-d249-4790-8111-ca21a7d4eb87 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:54.968583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f4d5d-d249-4790-8111-ca21a7d4eb87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:54.969959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f4d5d-d249-4790-8111-ca21a7d4eb87 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:54.979812 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 511/1012] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Jul 5 21:10:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:54.981069 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c86001-d3ea-490c-a829-0093175b2240 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:54.984687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21c05f-60c5-42b3-9bfc-1cf51667e780 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:54.984986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21c05f-60c5-42b3-9bfc-1cf51667e780 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:54.985269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21c05f-60c5-42b3-9bfc-1cf51667e780 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:54.986660 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 512/1013] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:10:54.991480 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4ca5e-9108-43ab-abe6-4c7ba594d499 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:54.991770 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4ca5e-9108-43ab-abe6-4c7ba594d499 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:54.992053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4ca5e-9108-43ab-abe6-4c7ba594d499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:55.009946 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-aaa4ca5e-9108-43ab-abe6-4c7ba594d499 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:55.011418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-aaa4ca5e-9108-43ab-abe6-4c7ba594d499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:55.084376 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 513/1014] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:54 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:10:55.089736 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c86001-d3ea-490c-a829-0093175b2240 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:55.107960 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4ca5e-9108-43ab-abe6-4c7ba594d499 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:55.128329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6295c07-b9c6-49b8-87c9-4146a7ddcabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:55.128985 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6295c07-b9c6-49b8-87c9-4146a7ddcabd None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:55.129269 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6295c07-b9c6-49b8-87c9-4146a7ddcabd None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:55.129543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6295c07-b9c6-49b8-87c9-4146a7ddcabd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:55.130308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6295c07-b9c6-49b8-87c9-4146a7ddcabd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:55.131666 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6295c07-b9c6-49b8-87c9-4146a7ddcabd None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:55.198085 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:55.209427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4ca5e-9108-43ab-abe6-4c7ba594d499 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:55.238147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 502/1015] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Jul 5 21:10:54 2022] POST /identity/v3/endpoints => generated 334 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:10:55.258514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3872e-e6b3-4c87-8441-4f8522c5b5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:55.260036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3872e-e6b3-4c87-8441-4f8522c5b5ba None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:55.260342 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3872e-e6b3-4c87-8441-4f8522c5b5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:55.260625 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3872e-e6b3-4c87-8441-4f8522c5b5ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:55.261873 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3872e-e6b3-4c87-8441-4f8522c5b5ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:55.263459 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3872e-e6b3-4c87-8441-4f8522c5b5ba None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:55.265993 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 514/1016] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:55.271432 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6295c07-b9c6-49b8-87c9-4146a7ddcabd None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:55.299865 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:55.380433 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6295c07-b9c6-49b8-87c9-4146a7ddcabd None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:55.421518 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119d2d1-7652-45ce-af89-a6f2f3a6994f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:55.422216 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119d2d1-7652-45ce-af89-a6f2f3a6994f None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:55.422501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119d2d1-7652-45ce-af89-a6f2f3a6994f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:55.422776 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119d2d1-7652-45ce-af89-a6f2f3a6994f None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:55.423497 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119d2d1-7652-45ce-af89-a6f2f3a6994f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:55.424920 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119d2d1-7652-45ce-af89-a6f2f3a6994f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:55.506738 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 503/1017] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Jul 5 21:10:55 2022] POST /identity/v3/projects => generated 311 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:10:56.414708 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0ef77-d5f5-4f15-8430-06275d7c3764 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:56.415253 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0ef77-d5f5-4f15-8430-06275d7c3764 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:56.415443 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0ef77-d5f5-4f15-8430-06275d7c3764 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:56.417116 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 515/1018] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:56.422273 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed389f-83a2-41a5-8ef7-a19c6352345c None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:56.422668 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed389f-83a2-41a5-8ef7-a19c6352345c None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:56.422848 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed389f-83a2-41a5-8ef7-a19c6352345c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:56.439539 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-15ed389f-83a2-41a5-8ef7-a19c6352345c None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:56.440711 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-15ed389f-83a2-41a5-8ef7-a19c6352345c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:56.515422 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 504/1019] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:56 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:56.539046 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0ef77-d5f5-4f15-8430-06275d7c3764 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:56.652603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0ef77-d5f5-4f15-8430-06275d7c3764 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:56.688085 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a5497-7f40-4e47-b8e3-8fe62e052346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:56.688652 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a5497-7f40-4e47-b8e3-8fe62e052346 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:56.688932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a5497-7f40-4e47-b8e3-8fe62e052346 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:56.689204 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a5497-7f40-4e47-b8e3-8fe62e052346 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:56.689920 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a5497-7f40-4e47-b8e3-8fe62e052346 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:56.691313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a5497-7f40-4e47-b8e3-8fe62e052346 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:56.766169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 516/1020] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Jul 5 21:10:56 2022] POST /identity/v3/services => generated 242 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:10:57.395382 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2c60e-f9ae-4a21-9df0-deaa81393cd9 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:57.395714 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2c60e-f9ae-4a21-9df0-deaa81393cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:57.395941 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2c60e-f9ae-4a21-9df0-deaa81393cd9 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:57.397474 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 505/1021] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:57.403061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c0446-30b5-4755-93d5-50bd2a7ceb42 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:57.403354 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c0446-30b5-4755-93d5-50bd2a7ceb42 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:57.403634 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c0446-30b5-4755-93d5-50bd2a7ceb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:57.421201 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-188c0446-30b5-4755-93d5-50bd2a7ceb42 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:57.422434 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-188c0446-30b5-4755-93d5-50bd2a7ceb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:57.430229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:57.498098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 517/1022] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:57.523301 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2c60e-f9ae-4a21-9df0-deaa81393cd9 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:57.533133 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:57.576915 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44652345-3c11-41a8-9fa0-67b8c015413b None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:57.577244 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44652345-3c11-41a8-9fa0-67b8c015413b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:57.577479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44652345-3c11-41a8-9fa0-67b8c015413b None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:57.579022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 518/1023] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:10:57.583619 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8510224-ff4c-4c0d-9678-98acba4e8aea None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:57.583903 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8510224-ff4c-4c0d-9678-98acba4e8aea None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:57.584180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8510224-ff4c-4c0d-9678-98acba4e8aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:57.603684 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e8510224-ff4c-4c0d-9678-98acba4e8aea None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:57.605139 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e8510224-ff4c-4c0d-9678-98acba4e8aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:57.636815 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2c60e-f9ae-4a21-9df0-deaa81393cd9 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:57.674965 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 519/1024] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:10:57.675133 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dc5aa-2311-4c59-a8a1-3d1118493694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:57.675576 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dc5aa-2311-4c59-a8a1-3d1118493694 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:57.675928 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dc5aa-2311-4c59-a8a1-3d1118493694 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:57.676215 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dc5aa-2311-4c59-a8a1-3d1118493694 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:57.686859 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264dc5aa-2311-4c59-a8a1-3d1118493694 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:10:57.695123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-264dc5aa-2311-4c59-a8a1-3d1118493694 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:10:57.695123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:57.695123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:57.695123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:57.695123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:57.695123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:57.695123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:57.695123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:57.695123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:57.695123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:57.695123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:57.695123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:57.695123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:10:57.695123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:10:57.695123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:10:57.695123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:10:57.696151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:10:57.696151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:10:57.696151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:10:57.696151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:10:57.696151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:57.696151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:57.696151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:57.696151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:57.696151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:57.696151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:57.696151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:57.696151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:57.696151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:57.696151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:57.696151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:57.696151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:57.697201 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:57.697201 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:57.697201 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:57.697201 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:57.697201 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:10:57.697201 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:10:57.697201 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:10:57.697201 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:10:57.697201 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:10:57.697201 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:10:57.697201 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:10:57.697201 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:57.698979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8510224-ff4c-4c0d-9678-98acba4e8aea None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:57.701301 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 506/1025] 10.222.0.13 () {56 vars in 1120 bytes} [Tue Jul 5 21:10:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:57.702689 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dc5aa-2311-4c59-a8a1-3d1118493694 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:57.775559 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:57.776203 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:57.811119 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dc5aa-2311-4c59-a8a1-3d1118493694 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:57.815158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8510224-ff4c-4c0d-9678-98acba4e8aea None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:57.850365 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cc88f-1c25-49d1-a348-eb84657fcb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:57.851044 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cc88f-1c25-49d1-a348-eb84657fcb1c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:57.851318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cc88f-1c25-49d1-a348-eb84657fcb1c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:57.851683 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cc88f-1c25-49d1-a348-eb84657fcb1c None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:57.852236 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757756fe-9590-475d-a854-97acd731bce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:57.852436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470cc88f-1c25-49d1-a348-eb84657fcb1c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:57.852869 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470cc88f-1c25-49d1-a348-eb84657fcb1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:57.853354 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757756fe-9590-475d-a854-97acd731bce6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:57.853517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757756fe-9590-475d-a854-97acd731bce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:57.853757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757756fe-9590-475d-a854-97acd731bce6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:57.854241 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470cc88f-1c25-49d1-a348-eb84657fcb1c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:57.854976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757756fe-9590-475d-a854-97acd731bce6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:57.856392 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757756fe-9590-475d-a854-97acd731bce6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:57.858187 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 520/1026] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:57.869514 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 507/1027] 10.222.0.13 () {56 vars in 1115 bytes} [Tue Jul 5 21:10:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:57.869710 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757756fe-9590-475d-a854-97acd731bce6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:57.869794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cc88f-1c25-49d1-a348-eb84657fcb1c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:57.975819 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757756fe-9590-475d-a854-97acd731bce6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:57.983014 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cc88f-1c25-49d1-a348-eb84657fcb1c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:58.011375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:58.011701 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f1ac6-6bef-4460-b70b-b3878f524e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:58.012378 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f1ac6-6bef-4460-b70b-b3878f524e68 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:58.012663 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f1ac6-6bef-4460-b70b-b3878f524e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:58.012937 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f1ac6-6bef-4460-b70b-b3878f524e68 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:58.013653 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f1ac6-6bef-4460-b70b-b3878f524e68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:58.015120 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f1ac6-6bef-4460-b70b-b3878f524e68 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:58.019752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d294e-41c6-43a0-abf9-41f6b457744e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:58.022270 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d294e-41c6-43a0-abf9-41f6b457744e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:58.022270 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d294e-41c6-43a0-abf9-41f6b457744e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:58.022270 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d294e-41c6-43a0-abf9-41f6b457744e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:58.024512 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:58.033363 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d294e-41c6-43a0-abf9-41f6b457744e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:58.035030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d294e-41c6-43a0-abf9-41f6b457744e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:58.052857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-714d294e-41c6-43a0-abf9-41f6b457744e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:58.052857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:58.052857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:58.052857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:58.052857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:58.052857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:58.052857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:58.052857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:58.052857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:58.052857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:58.052857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:58.052857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:58.052857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:58.052857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:58.052857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:58.053767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:58.053767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:58.053767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:58.053767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:58.053767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:58.053767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:58.053767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:58.053767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:58.053767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:58.053767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:58.053767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:58.053767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:58.053767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:58.053767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:58.053767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:58.053767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:58.053767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:58.054740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:58.054740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:58.054740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:58.054740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:58.054740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 508/1028] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:58.059868 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d294e-41c6-43a0-abf9-41f6b457744e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:58.127529 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 521/1029] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 21:10:57 2022] POST /identity/v3/users => generated 285 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:10:58.174855 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d294e-41c6-43a0-abf9-41f6b457744e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:58.214808 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6b932-27b1-4773-9bdf-413e1b00b078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:58.215785 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6b932-27b1-4773-9bdf-413e1b00b078 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:58.216213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6b932-27b1-4773-9bdf-413e1b00b078 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:58.216662 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6b932-27b1-4773-9bdf-413e1b00b078 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:58.217632 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6b932-27b1-4773-9bdf-413e1b00b078 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:58.218081 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6b932-27b1-4773-9bdf-413e1b00b078 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:58.219641 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6b932-27b1-4773-9bdf-413e1b00b078 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:58.235188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 509/1030] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:58.241460 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f1ac6-6bef-4460-b70b-b3878f524e68 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:58.354076 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f1ac6-6bef-4460-b70b-b3878f524e68 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:58.389683 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df650e91-d295-4e16-a417-d387b89ea3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:58.390760 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df650e91-d295-4e16-a417-d387b89ea3ae None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:58.391039 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df650e91-d295-4e16-a417-d387b89ea3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:58.391312 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df650e91-d295-4e16-a417-d387b89ea3ae None admin] PATH_INFO: `/v3/users/nova` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:58.399794 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df650e91-d295-4e16-a417-d387b89ea3ae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:58.401231 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df650e91-d295-4e16-a417-d387b89ea3ae None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:58.415338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-df650e91-d295-4e16-a417-d387b89ea3ae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:10:58.415338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:58.415338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:58.415338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:58.415338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:58.415338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:58.415338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:58.415338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:58.415338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:58.415338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:58.415338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:58.415338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:58.415338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:10:58.415338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:10:58.415338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:10:58.415338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:10:58.416428 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:58.416428 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:58.416428 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:10:58.416428 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:58.416428 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:10:58.416428 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:10:58.416428 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:58.416428 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:58.416428 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:58.416428 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:58.416428 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:58.416428 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:58.416428 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:58.416428 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:58.416428 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:58.416428 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:58.416428 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:58.416428 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:58.417412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:58.417412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:58.417412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:10:58.417412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:10:58.417412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:10:58.417412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:10:58.417412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:10:58.417412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:10:58.417412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:10:58.417412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:58.417412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 522/1031] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Jul 5 21:10:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:58.422533 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6b932-27b1-4773-9bdf-413e1b00b078 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:58.467641 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:58.528888 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6b932-27b1-4773-9bdf-413e1b00b078 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:58.565798 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f47f5-ef51-4f3c-b718-6bb7ed2a9940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:58.566500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f47f5-ef51-4f3c-b718-6bb7ed2a9940 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:58.566787 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f47f5-ef51-4f3c-b718-6bb7ed2a9940 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:58.567064 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f47f5-ef51-4f3c-b718-6bb7ed2a9940 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:58.567904 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f47f5-ef51-4f3c-b718-6bb7ed2a9940 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:58.568214 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f47f5-ef51-4f3c-b718-6bb7ed2a9940 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:58.569644 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f47f5-ef51-4f3c-b718-6bb7ed2a9940 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:58.588782 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 510/1032] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Jul 5 21:10:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:58.599217 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df650e91-d295-4e16-a417-d387b89ea3ae None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:58.653709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:58.703465 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df650e91-d295-4e16-a417-d387b89ea3ae None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:58.738483 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3cb02-f34d-45b5-8664-c8e7b8aaff82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:58.739142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3cb02-f34d-45b5-8664-c8e7b8aaff82 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:58.739421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3cb02-f34d-45b5-8664-c8e7b8aaff82 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:58.739690 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3cb02-f34d-45b5-8664-c8e7b8aaff82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:58.808055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3cb02-f34d-45b5-8664-c8e7b8aaff82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:58.809416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3cb02-f34d-45b5-8664-c8e7b8aaff82 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:58.823939 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1013a-f945-4dfa-9825-184a1ad1831b None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:58.824226 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1013a-f945-4dfa-9825-184a1ad1831b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:58.824504 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1013a-f945-4dfa-9825-184a1ad1831b None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:58.826053 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 511/1033] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:10:58.830544 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a1b7c-cb03-4397-8b7c-fe23c28b3c8e None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:58.830834 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a1b7c-cb03-4397-8b7c-fe23c28b3c8e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:58.831115 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a1b7c-cb03-4397-8b7c-fe23c28b3c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:58.847378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d31a1b7c-cb03-4397-8b7c-fe23c28b3c8e None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:58.848591 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d31a1b7c-cb03-4397-8b7c-fe23c28b3c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:58.862650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:58.914882 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 523/1034] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:10:58 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:10:58.921203 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3cb02-f34d-45b5-8664-c8e7b8aaff82 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:58.922165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 512/1035] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:10:58.944444 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a1b7c-cb03-4397-8b7c-fe23c28b3c8e None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:58.974616 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:59.028754 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3cb02-f34d-45b5-8664-c8e7b8aaff82 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:59.052306 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a1b7c-cb03-4397-8b7c-fe23c28b3c8e None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:59.063024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61aa00-d0bd-4048-b917-60391ee6daad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:59.063749 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61aa00-d0bd-4048-b917-60391ee6daad None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:59.064030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61aa00-d0bd-4048-b917-60391ee6daad None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:59.064308 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61aa00-d0bd-4048-b917-60391ee6daad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:59.074341 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61aa00-d0bd-4048-b917-60391ee6daad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:59.075786 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61aa00-d0bd-4048-b917-60391ee6daad None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:59.087972 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d83f1-2861-4949-9a97-364db3a2316c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:59.088735 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d83f1-2861-4949-9a97-364db3a2316c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:59.089012 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d83f1-2861-4949-9a97-364db3a2316c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:59.089342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d83f1-2861-4949-9a97-364db3a2316c None admin] PATH_INFO: `/v3/services/image` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:59.089991 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d83f1-2861-4949-9a97-364db3a2316c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:59.091443 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d83f1-2861-4949-9a97-364db3a2316c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:59.093320 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-4e61aa00-d0bd-4048-b917-60391ee6daad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:59.093320 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:59.093320 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:59.093320 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:59.093320 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:59.093320 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:59.093320 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:59.093320 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:59.093320 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:59.093320 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:59.093320 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:59.093320 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:59.093320 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:59.093320 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:59.093320 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:59.094269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:59.094269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:59.094269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:59.094269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:59.094269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:59.094269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:59.094269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:59.094269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:59.094269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:59.094269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:59.094269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:59.094269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:59.094269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:59.094269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:59.094269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:59.094269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:59.094269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:59.100391 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:10:59.100391 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:59.100391 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:10:59.100391 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:59.100391 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 524/1036] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:59.100391 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61aa00-d0bd-4048-b917-60391ee6daad None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:59.104552 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:59.111079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-7b0d83f1-2861-4949-9a97-364db3a2316c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:10:59.111079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:59.111079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:10:59.111079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:10:59.111079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:10:59.111079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:10:59.111079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:10:59.111079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:59.111079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:10:59.111079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:59.111079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:10:59.111079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:59.111079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:59.111079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:59.111079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:59.111079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:59.111079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:59.116849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:59.116849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:59.116849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:59.116849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:59.116849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:59.116849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:59.116849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:10:59.116849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:10:59.116849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:10:59.116849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:10:59.116849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:59.116849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:59.116849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:59.116849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:59.116849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:59.116849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:59.117907 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:59.117907 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:59.117907 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:59.117907 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:59.117907 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:59.117907 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:59.117907 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:59.117907 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:59.117907 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:59.117907 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:59.117907 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:10:59.117907 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:10:59.117907 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:10:59.117907 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:10:59.117907 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 513/1037] 10.222.0.13 () {56 vars in 1105 bytes} [Tue Jul 5 21:10:58 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:59.120849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d83f1-2861-4949-9a97-364db3a2316c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:59.208068 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61aa00-d0bd-4048-b917-60391ee6daad None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:59.211937 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:59.221767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d83f1-2861-4949-9a97-364db3a2316c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:59.244745 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4122a-35b2-458b-a7d1-8774a5bbcf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:59.245404 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4122a-35b2-458b-a7d1-8774a5bbcf02 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:59.245688 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4122a-35b2-458b-a7d1-8774a5bbcf02 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:59.246003 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4122a-35b2-458b-a7d1-8774a5bbcf02 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:59.246917 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e4122a-35b2-458b-a7d1-8774a5bbcf02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:59.247027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e4122a-35b2-458b-a7d1-8774a5bbcf02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:59.248371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e4122a-35b2-458b-a7d1-8774a5bbcf02 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:59.258451 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdb710-950b-4cf0-ba3a-02f639ce24ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:59.259239 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdb710-950b-4cf0-ba3a-02f639ce24ea None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:59.259602 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdb710-950b-4cf0-ba3a-02f639ce24ea None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:59.259888 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdb710-950b-4cf0-ba3a-02f639ce24ea None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:59.264528 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 525/1038] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:59.264652 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cdb710-950b-4cf0-ba3a-02f639ce24ea None admin] RBAC: Adding query filter params (name=image) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:59.264652 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cdb710-950b-4cf0-ba3a-02f639ce24ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:59.264652 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cdb710-950b-4cf0-ba3a-02f639ce24ea None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:59.265748 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4122a-35b2-458b-a7d1-8774a5bbcf02 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:59.269800 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 514/1039] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:59.275707 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdb710-950b-4cf0-ba3a-02f639ce24ea None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:59.332018 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:59.373722 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4122a-35b2-458b-a7d1-8774a5bbcf02 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:59.389670 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdb710-950b-4cf0-ba3a-02f639ce24ea None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:59.410771 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870d359-7d78-455a-a821-c238a6060e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:59.411563 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870d359-7d78-455a-a821-c238a6060e61 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:59.411846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870d359-7d78-455a-a821-c238a6060e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:59.412126 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870d359-7d78-455a-a821-c238a6060e61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:59.419590 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870d359-7d78-455a-a821-c238a6060e61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:59.421040 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870d359-7d78-455a-a821-c238a6060e61 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:59.428739 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a6538-569e-472c-9f93-04d9385d7a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:59.429622 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a6538-569e-472c-9f93-04d9385d7a3c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:59.430092 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a6538-569e-472c-9f93-04d9385d7a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:59.430575 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a6538-569e-472c-9f93-04d9385d7a3c None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:59.431466 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a6538-569e-472c-9f93-04d9385d7a3c None admin] RBAC: Adding query filter params (type=image) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:59.431944 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a6538-569e-472c-9f93-04d9385d7a3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:59.433466 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a6538-569e-472c-9f93-04d9385d7a3c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:59.435584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-8870d359-7d78-455a-a821-c238a6060e61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:59.435584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:59.435584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:59.435584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:59.435584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:59.435584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:59.435584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:59.435584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:59.435584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:59.435584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:59.435584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:59.435584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:59.435584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:10:59.435584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:10:59.435584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:10:59.436480 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:10:59.436480 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:59.436480 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:59.436480 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:59.436480 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:59.436480 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:59.436480 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:59.436480 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:59.436480 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:59.436480 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:59.436480 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:59.436480 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:59.436480 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:59.436480 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:59.436480 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:59.436480 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:59.436480 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:59.437405 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:10:59.437405 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:10:59.437405 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:10:59.437405 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:10:59.437405 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:10:59.437405 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:10:59.437405 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:10:59.437405 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:10:59.437405 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 526/1040] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:10:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:10:59.442398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870d359-7d78-455a-a821-c238a6060e61 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:59.443028 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 515/1041] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:10:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:59.449232 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a6538-569e-472c-9f93-04d9385d7a3c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:59.471815 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:59.553055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870d359-7d78-455a-a821-c238a6060e61 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:59.558208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a6538-569e-472c-9f93-04d9385d7a3c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:59.579132 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:59.590473 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b83409-6c76-4ec8-8fc1-976509185c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:59.591066 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b83409-6c76-4ec8-8fc1-976509185c67 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:59.591351 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b83409-6c76-4ec8-8fc1-976509185c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:59.591630 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b83409-6c76-4ec8-8fc1-976509185c67 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:59.592440 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b83409-6c76-4ec8-8fc1-976509185c67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:59.592732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b83409-6c76-4ec8-8fc1-976509185c67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:59.594277 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b83409-6c76-4ec8-8fc1-976509185c67 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:59.601161 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b1293-2c6d-4834-a8f6-133c5da5659e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:59.602008 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b1293-2c6d-4834-a8f6-133c5da5659e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:59.602322 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b1293-2c6d-4834-a8f6-133c5da5659e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:59.602606 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b1293-2c6d-4834-a8f6-133c5da5659e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:59.603983 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b1293-2c6d-4834-a8f6-133c5da5659e None admin] RBAC: Adding query filter params (interface=public, service_id=60b2acfb8a55422fb4bdb3d26f385312, region_id=RegionOne) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:59.604285 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b1293-2c6d-4834-a8f6-133c5da5659e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:59.605637 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b1293-2c6d-4834-a8f6-133c5da5659e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:59.607103 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 527/1042] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:10:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:59.615521 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 516/1043] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Jul 5 21:10:59 2022] GET /identity/v3/endpoints?service_id=60b2acfb8a55422fb4bdb3d26f385312&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:59.615681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b83409-6c76-4ec8-8fc1-976509185c67 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:59.616982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b1293-2c6d-4834-a8f6-133c5da5659e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:59.705848 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:59.721837 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b1293-2c6d-4834-a8f6-133c5da5659e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:59.724071 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b83409-6c76-4ec8-8fc1-976509185c67 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:59.759923 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf9ec1-95c7-4da6-b501-5eacc1eb7bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:59.760615 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf9ec1-95c7-4da6-b501-5eacc1eb7bfa None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:59.760903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf9ec1-95c7-4da6-b501-5eacc1eb7bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:59.761183 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf9ec1-95c7-4da6-b501-5eacc1eb7bfa None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:59.761861 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf9ec1-95c7-4da6-b501-5eacc1eb7bfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:59.762944 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186de38b-d44c-4d0c-99c2-05b394c29f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:59.763278 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf9ec1-95c7-4da6-b501-5eacc1eb7bfa None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:59.763593 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186de38b-d44c-4d0c-99c2-05b394c29f89 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:59.763874 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186de38b-d44c-4d0c-99c2-05b394c29f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:59.764225 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186de38b-d44c-4d0c-99c2-05b394c29f89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:59.765119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186de38b-d44c-4d0c-99c2-05b394c29f89 None admin] RBAC: Adding query filter params (role.id=16c0534ca3dd473eb63776e14107ad0b, scope.project.id=1076c94b43b2483eb4fc06173f9204c3, user.id=910cd341df8943f18af2765e2a30b238) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:59.765773 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186de38b-d44c-4d0c-99c2-05b394c29f89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:59.767100 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186de38b-d44c-4d0c-99c2-05b394c29f89 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:59.771080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 517/1044] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Jul 5 21:10:59 2022] GET /identity/v3/services => generated 1957 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:10:59.782153 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 528/1045] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:10:59 2022] GET /identity/v3/role_assignments?user.id=910cd341df8943f18af2765e2a30b238&scope.project.id=1076c94b43b2483eb4fc06173f9204c3&role.id=16c0534ca3dd473eb63776e14107ad0b => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:00.290180 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ac594-ab32-4d98-bf80-0187a56e740c None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:00.291123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ac594-ab32-4d98-bf80-0187a56e740c None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:00.291478 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ac594-ab32-4d98-bf80-0187a56e740c None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:00.293034 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 518/1046] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:11:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:11:00.297996 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4afc62-4f2b-4cde-b277-e0767d72de5c None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:00.298317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4afc62-4f2b-4cde-b277-e0767d72de5c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:00.298597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4afc62-4f2b-4cde-b277-e0767d72de5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:00.316081 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-2e4afc62-4f2b-4cde-b277-e0767d72de5c None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:00.317263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2e4afc62-4f2b-4cde-b277-e0767d72de5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:00.363066 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:00.386662 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 529/1047] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:11:00.410467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ac594-ab32-4d98-bf80-0187a56e740c None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:00.517298 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ac594-ab32-4d98-bf80-0187a56e740c None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:00.552997 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecc4cd-0087-47a1-aa75-f10ae9f45748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:00.553756 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecc4cd-0087-47a1-aa75-f10ae9f45748 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:00.554038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecc4cd-0087-47a1-aa75-f10ae9f45748 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:00.554405 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecc4cd-0087-47a1-aa75-f10ae9f45748 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:00.564621 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ecc4cd-0087-47a1-aa75-f10ae9f45748 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:11:00.572574 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-99ecc4cd-0087-47a1-aa75-f10ae9f45748 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:11:00.572574 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:00.572574 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:00.572574 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:00.572574 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:00.572574 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:00.572574 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:00.572574 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:00.572574 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:00.572574 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:00.572574 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:00.572574 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:00.572574 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:11:00.572574 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:11:00.572574 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:11:00.572574 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:11:00.573528 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:11:00.573528 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:11:00.573528 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:11:00.573528 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:11:00.573528 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:00.573528 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:00.573528 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:00.573528 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:00.573528 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:00.573528 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:00.573528 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:00.573528 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:00.573528 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:00.573528 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:00.573528 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:00.573528 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:00.574443 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:00.574443 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:00.574443 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:00.574443 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:00.574443 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:11:00.574443 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:11:00.574443 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:11:00.574443 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:11:00.574443 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:11:00.574443 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:11:00.574443 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:11:00.574443 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:11:00.578735 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 519/1048] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:11:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:00.579959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4afc62-4f2b-4cde-b277-e0767d72de5c None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:00.695585 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4afc62-4f2b-4cde-b277-e0767d72de5c None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:00.731064 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e9864-1512-49f0-ac37-57ad9d56ecdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:00.731733 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e9864-1512-49f0-ac37-57ad9d56ecdf None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:00.732021 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e9864-1512-49f0-ac37-57ad9d56ecdf None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:00.732299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e9864-1512-49f0-ac37-57ad9d56ecdf None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:00.733047 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e9864-1512-49f0-ac37-57ad9d56ecdf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:00.733356 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e9864-1512-49f0-ac37-57ad9d56ecdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:00.734884 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e9864-1512-49f0-ac37-57ad9d56ecdf None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:00.743893 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 530/1049] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:11:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:00.749332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecc4cd-0087-47a1-aa75-f10ae9f45748 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:00.760895 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:00.852038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecc4cd-0087-47a1-aa75-f10ae9f45748 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:00.886325 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64230d6-156d-4eb3-929e-fe877de3e2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:00.887232 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64230d6-156d-4eb3-929e-fe877de3e2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:00.887511 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64230d6-156d-4eb3-929e-fe877de3e2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:00.887784 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64230d6-156d-4eb3-929e-fe877de3e2c8 None admin] PATH_INFO: `/v3/users/41255e1dc4cc44c7811d4acd9d4902a5` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:00.905115 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64230d6-156d-4eb3-929e-fe877de3e2c8 None admin] RBAC: Authorizing `identity:get_user(user_id=41255e1dc4cc44c7811d4acd9d4902a5)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:00.906618 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64230d6-156d-4eb3-929e-fe877de3e2c8 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:00.908575 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 520/1050] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:11:00 2022] GET /identity/v3/users/41255e1dc4cc44c7811d4acd9d4902a5 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:00.914067 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e9864-1512-49f0-ac37-57ad9d56ecdf None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:00.956445 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:01.015958 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e9864-1512-49f0-ac37-57ad9d56ecdf None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:01.049655 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c06a52-877b-40a4-af24-a3147f665d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:01.050317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c06a52-877b-40a4-af24-a3147f665d3c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:01.050602 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c06a52-877b-40a4-af24-a3147f665d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:01.050877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c06a52-877b-40a4-af24-a3147f665d3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:01.117703 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c06a52-877b-40a4-af24-a3147f665d3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:01.119129 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c06a52-877b-40a4-af24-a3147f665d3c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:01.158506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:01.215922 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 531/1051] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:11:00 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:11:01.221518 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64230d6-156d-4eb3-929e-fe877de3e2c8 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:01.290143 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:01.325725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64230d6-156d-4eb3-929e-fe877de3e2c8 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:01.359863 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26a4bc-27cd-4c81-841d-daa3ebc9c824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:01.360723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26a4bc-27cd-4c81-841d-daa3ebc9c824 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:01.361005 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26a4bc-27cd-4c81-841d-daa3ebc9c824 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:01.361278 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26a4bc-27cd-4c81-841d-daa3ebc9c824 None admin] PATH_INFO: `/v3/projects/efbf69cb0e914ecf811c2b83a28bcc07` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:01.362491 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26a4bc-27cd-4c81-841d-daa3ebc9c824 None admin] RBAC: Authorizing `identity:get_project(project_id=efbf69cb0e914ecf811c2b83a28bcc07)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:01.363924 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26a4bc-27cd-4c81-841d-daa3ebc9c824 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:01.370224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 521/1052] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:11:01 2022] GET /identity/v3/projects/efbf69cb0e914ecf811c2b83a28bcc07 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:11:01.372565 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c06a52-877b-40a4-af24-a3147f665d3c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:01.474344 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c06a52-877b-40a4-af24-a3147f665d3c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:01.508345 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbcd24e-feb1-4aff-ac71-ed37a0e290e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:01.508994 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcd24e-feb1-4aff-ac71-ed37a0e290e1 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:01.510008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcd24e-feb1-4aff-ac71-ed37a0e290e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:01.510328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcd24e-feb1-4aff-ac71-ed37a0e290e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:01.511205 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbcd24e-feb1-4aff-ac71-ed37a0e290e1 None admin] RBAC: Adding query filter params (role.id=15cf04fec8c6477088a33bf286f1bbdb, scope.project.id=efbf69cb0e914ecf811c2b83a28bcc07, user.id=41255e1dc4cc44c7811d4acd9d4902a5) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:01.511516 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbcd24e-feb1-4aff-ac71-ed37a0e290e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:01.512950 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbcd24e-feb1-4aff-ac71-ed37a0e290e1 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:01.521265 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 532/1053] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:11:01 2022] GET /identity/v3/role_assignments?user.id=41255e1dc4cc44c7811d4acd9d4902a5&scope.project.id=efbf69cb0e914ecf811c2b83a28bcc07&role.id=15cf04fec8c6477088a33bf286f1bbdb => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:01.835091 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12674591-2db2-4ee0-8679-892bff506e3a None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:01.835638 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12674591-2db2-4ee0-8679-892bff506e3a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:01.835638 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12674591-2db2-4ee0-8679-892bff506e3a None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:01.836352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb154ae2-79ab-4eac-a35a-6ee816b627bd None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:01.836751 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb154ae2-79ab-4eac-a35a-6ee816b627bd None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:01.836927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb154ae2-79ab-4eac-a35a-6ee816b627bd None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:01.837318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 522/1054] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:11:01.838523 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 533/1055] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:11:01.842420 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf5fc4-17fe-4a8e-be74-e5c12c70c7f8 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:01.842912 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf5fc4-17fe-4a8e-be74-e5c12c70c7f8 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:01.843197 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf5fc4-17fe-4a8e-be74-e5c12c70c7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:01.843596 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2196f0-14cd-4c00-9b0d-51bbdf3caa95 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:01.843881 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2196f0-14cd-4c00-9b0d-51bbdf3caa95 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:01.844159 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2196f0-14cd-4c00-9b0d-51bbdf3caa95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:01.849917 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:01.861531 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d7cf5fc4-17fe-4a8e-be74-e5c12c70c7f8 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:01.864642 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d7cf5fc4-17fe-4a8e-be74-e5c12c70c7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:01.864757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-fe2196f0-14cd-4c00-9b0d-51bbdf3caa95 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:01.865577 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-fe2196f0-14cd-4c00-9b0d-51bbdf3caa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:01.931622 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 523/1056] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:11:01.942873 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 534/1057] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:11:01.954164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf5fc4-17fe-4a8e-be74-e5c12c70c7f8 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:01.965713 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2196f0-14cd-4c00-9b0d-51bbdf3caa95 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:02.020309 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:02.060303 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf5fc4-17fe-4a8e-be74-e5c12c70c7f8 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:02.066701 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2196f0-14cd-4c00-9b0d-51bbdf3caa95 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:02.094440 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cbd8b5-f583-4b26-bd60-27c1579611e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:02.095146 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbd8b5-f583-4b26-bd60-27c1579611e0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:02.095425 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbd8b5-f583-4b26-bd60-27c1579611e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:02.095697 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbd8b5-f583-4b26-bd60-27c1579611e0 None admin] PATH_INFO: `/v3/services/image` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:02.096337 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cbd8b5-f583-4b26-bd60-27c1579611e0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:02.097693 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cbd8b5-f583-4b26-bd60-27c1579611e0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:02.101711 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7eca7b-2281-4e25-a8cd-6c6d2b05f754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:02.102548 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7eca7b-2281-4e25-a8cd-6c6d2b05f754 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:02.102889 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7eca7b-2281-4e25-a8cd-6c6d2b05f754 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:02.103656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7eca7b-2281-4e25-a8cd-6c6d2b05f754 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:02.105539 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:02.109601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-87cbd8b5-f583-4b26-bd60-27c1579611e0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:11:02.109601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:02.109601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:11:02.109601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:11:02.109601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:11:02.109601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:11:02.109601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:11:02.109601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:11:02.109601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:11:02.109601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:11:02.109601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:11:02.109601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:11:02.109601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:02.109601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:02.109601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:02.109601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:02.109601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:02.110690 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:02.110690 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:02.110690 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:02.110690 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:02.110690 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:02.110690 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:02.110690 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:11:02.110690 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:11:02.110690 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:11:02.110690 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:11:02.110690 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:02.110690 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:02.110690 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:02.110690 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:02.110690 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:02.110690 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:02.111562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:02.111562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:02.111562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:02.111562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:02.111562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:02.111562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:02.111562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:02.111562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:02.111562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:02.111562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:02.111562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:11:02.111562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:11:02.111562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:11:02.111562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:11:02.111562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 524/1058] 10.222.0.13 () {56 vars in 1105 bytes} [Tue Jul 5 21:11:01 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:11:02.116726 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cbd8b5-f583-4b26-bd60-27c1579611e0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:02.117965 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7eca7b-2281-4e25-a8cd-6c6d2b05f754 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:11:02.126436 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-da7eca7b-2281-4e25-a8cd-6c6d2b05f754 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:11:02.126436 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:02.126436 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:02.126436 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:02.126436 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:02.126436 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:02.126436 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:02.126436 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:02.126436 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:02.126436 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:02.126436 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:02.126436 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:02.126436 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:11:02.126436 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:11:02.126436 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:11:02.126436 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:11:02.127416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:11:02.127416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:11:02.127416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:11:02.127416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:11:02.127416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:02.127416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:02.127416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:02.127416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:02.127416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:02.127416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:02.127416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:02.127416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:02.127416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:02.127416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:02.127416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:02.127416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:02.128281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:02.128281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:02.128281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:02.128281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:02.128281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:11:02.128281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:11:02.128281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:11:02.128281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:11:02.128281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:11:02.128281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:11:02.128281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:11:02.128281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:11:02.128281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 535/1059] 10.222.0.13 () {56 vars in 1120 bytes} [Tue Jul 5 21:11:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:11:02.134603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7eca7b-2281-4e25-a8cd-6c6d2b05f754 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:02.224795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cbd8b5-f583-4b26-bd60-27c1579611e0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:02.237490 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7eca7b-2281-4e25-a8cd-6c6d2b05f754 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:02.253104 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:02.263722 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8d87e-284e-4c67-8e8e-aa2fc3b50e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:02.264622 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8d87e-284e-4c67-8e8e-aa2fc3b50e2a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:02.265064 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8d87e-284e-4c67-8e8e-aa2fc3b50e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:02.265177 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8d87e-284e-4c67-8e8e-aa2fc3b50e2a None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:02.266097 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8d87e-284e-4c67-8e8e-aa2fc3b50e2a None admin] RBAC: Adding query filter params (name=image) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:02.266775 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8d87e-284e-4c67-8e8e-aa2fc3b50e2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:02.267781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8d87e-284e-4c67-8e8e-aa2fc3b50e2a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:02.277224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 525/1060] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:11:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:11:02.277367 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fc6d7-b1a4-46fb-a70c-5324273e4d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:02.277367 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fc6d7-b1a4-46fb-a70c-5324273e4d7f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:02.277367 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fc6d7-b1a4-46fb-a70c-5324273e4d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:02.277367 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fc6d7-b1a4-46fb-a70c-5324273e4d7f None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:02.277702 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7fc6d7-b1a4-46fb-a70c-5324273e4d7f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:02.277702 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7fc6d7-b1a4-46fb-a70c-5324273e4d7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:02.277702 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7fc6d7-b1a4-46fb-a70c-5324273e4d7f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:02.279477 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8d87e-284e-4c67-8e8e-aa2fc3b50e2a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:02.287002 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 536/1061] 10.222.0.13 () {56 vars in 1115 bytes} [Tue Jul 5 21:11:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:11:02.293225 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fc6d7-b1a4-46fb-a70c-5324273e4d7f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:02.354956 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:02.383204 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8d87e-284e-4c67-8e8e-aa2fc3b50e2a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:02.403402 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fc6d7-b1a4-46fb-a70c-5324273e4d7f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:02.417994 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa5799-36ad-49dc-8d34-dc0d45fd6c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:02.419676 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa5799-36ad-49dc-8d34-dc0d45fd6c11 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:02.419962 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa5799-36ad-49dc-8d34-dc0d45fd6c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:02.420236 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa5799-36ad-49dc-8d34-dc0d45fd6c11 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:02.420982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa5799-36ad-49dc-8d34-dc0d45fd6c11 None admin] RBAC: Adding query filter params (type=image) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:02.421243 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa5799-36ad-49dc-8d34-dc0d45fd6c11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:02.422704 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa5799-36ad-49dc-8d34-dc0d45fd6c11 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:02.433175 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 526/1062] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:11:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:11:02.433973 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa5799-36ad-49dc-8d34-dc0d45fd6c11 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:02.440713 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea0736-2e9e-4e1d-96df-22fc5ffbe1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:02.441503 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea0736-2e9e-4e1d-96df-22fc5ffbe1fd None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:02.441780 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea0736-2e9e-4e1d-96df-22fc5ffbe1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:02.442049 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea0736-2e9e-4e1d-96df-22fc5ffbe1fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:02.453340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea0736-2e9e-4e1d-96df-22fc5ffbe1fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:02.454796 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea0736-2e9e-4e1d-96df-22fc5ffbe1fd None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:02.472360 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-0bea0736-2e9e-4e1d-96df-22fc5ffbe1fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:02.472360 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:02.472360 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:02.472360 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:02.472360 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:02.472360 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:02.472360 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:02.472360 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:02.472360 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:02.472360 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:02.472360 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:02.472360 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:02.472360 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:11:02.472360 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:11:02.472360 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:11:02.473299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:11:02.473299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:02.473299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:02.473299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:02.473299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:02.473299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:02.473299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:02.473299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:02.473299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:02.473299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:02.473299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:02.473299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:02.473299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:02.473299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:02.473299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:02.473299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:02.473299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:02.474421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:11:02.474421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:11:02.474421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:02.474421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:11:02.474421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 537/1063] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:11:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:11:02.479296 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea0736-2e9e-4e1d-96df-22fc5ffbe1fd None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:02.494307 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:02.541866 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa5799-36ad-49dc-8d34-dc0d45fd6c11 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:02.576496 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69892285-0da9-4f77-9a20-090b2c64ffeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:02.577298 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69892285-0da9-4f77-9a20-090b2c64ffeb None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:02.577593 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69892285-0da9-4f77-9a20-090b2c64ffeb None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:02.577889 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69892285-0da9-4f77-9a20-090b2c64ffeb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:02.578618 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69892285-0da9-4f77-9a20-090b2c64ffeb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:02.580186 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69892285-0da9-4f77-9a20-090b2c64ffeb None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:02.585670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea0736-2e9e-4e1d-96df-22fc5ffbe1fd None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:02.598421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:02.624982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0ad89-3257-4139-b7fe-1c7d18024652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:02.625650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0ad89-3257-4139-b7fe-1c7d18024652 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:02.625929 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0ad89-3257-4139-b7fe-1c7d18024652 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:02.626235 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0ad89-3257-4139-b7fe-1c7d18024652 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:02.626968 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0ad89-3257-4139-b7fe-1c7d18024652 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:02.627272 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0ad89-3257-4139-b7fe-1c7d18024652 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:02.628634 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0ad89-3257-4139-b7fe-1c7d18024652 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:02.641706 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 538/1064] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:11:02.648636 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0ad89-3257-4139-b7fe-1c7d18024652 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:02.678341 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 527/1065] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Jul 5 21:11:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:11:02.772066 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0ad89-3257-4139-b7fe-1c7d18024652 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:02.815527 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf6958-a55b-4293-bcaf-c0a00f4b2460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:02.816323 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf6958-a55b-4293-bcaf-c0a00f4b2460 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:02.816609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf6958-a55b-4293-bcaf-c0a00f4b2460 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:02.816890 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf6958-a55b-4293-bcaf-c0a00f4b2460 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:02.825326 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf6958-a55b-4293-bcaf-c0a00f4b2460 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:02.826818 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf6958-a55b-4293-bcaf-c0a00f4b2460 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:02.841537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-fbbf6958-a55b-4293-bcaf-c0a00f4b2460 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:11:02.841537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:02.841537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:02.841537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:02.841537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:02.841537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:02.841537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:02.841537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:02.841537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:02.841537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:02.841537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:02.841537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:02.841537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:11:02.841537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:11:02.841537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:11:02.841537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:11:02.843030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:02.843030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:02.843030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:11:02.843030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:11:02.843030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:11:02.843030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:11:02.843030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:02.843030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:02.843030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:02.843030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:02.843030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:02.843030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:02.843030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:02.843030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:02.843030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:02.843030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:02.843030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:02.843030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:02.844010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:02.844010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:02.844010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:11:02.844010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:11:02.844010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:11:02.844010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:11:02.844010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:11:02.844010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:11:02.844010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:11:02.844010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:11:02.844010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 539/1066] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Jul 5 21:11:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:11:02.848488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69892285-0da9-4f77-9a20-090b2c64ffeb None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:02.957383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69892285-0da9-4f77-9a20-090b2c64ffeb None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:02.975592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:02.998588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f27b1-e760-44a9-adc2-83f25b3254e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:02.999272 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f27b1-e760-44a9-adc2-83f25b3254e8 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:03.003062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f27b1-e760-44a9-adc2-83f25b3254e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:03.003062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f27b1-e760-44a9-adc2-83f25b3254e8 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:03.003062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f27b1-e760-44a9-adc2-83f25b3254e8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:03.003062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f27b1-e760-44a9-adc2-83f25b3254e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:03.003062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f27b1-e760-44a9-adc2-83f25b3254e8 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:03.034250 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 528/1067] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Jul 5 21:11:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:03.037662 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf6958-a55b-4293-bcaf-c0a00f4b2460 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:03.067977 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:03.156369 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf6958-a55b-4293-bcaf-c0a00f4b2460 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:03.199599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e22f5-eb6f-4d1b-a70f-eb385f01cb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:03.200405 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e22f5-eb6f-4d1b-a70f-eb385f01cb80 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:03.200691 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e22f5-eb6f-4d1b-a70f-eb385f01cb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:03.200974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e22f5-eb6f-4d1b-a70f-eb385f01cb80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:03.212659 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e22f5-eb6f-4d1b-a70f-eb385f01cb80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:03.214150 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e22f5-eb6f-4d1b-a70f-eb385f01cb80 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:03.235279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-719e22f5-eb6f-4d1b-a70f-eb385f01cb80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:03.235279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:03.235279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:03.235279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:03.235279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:03.235279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:03.235279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:03.235279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:03.235279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:03.235279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:03.235279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:03.235279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:03.235279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:11:03.235279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:11:03.235279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:11:03.236283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:11:03.236283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:03.236283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:03.236283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:03.236283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:03.236283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:03.236283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:03.236283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:03.236283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:03.236283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:03.236283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:03.236283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:03.236283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:03.236283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:03.236283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:03.236283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:03.236283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:03.237203 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:11:03.237203 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:11:03.237203 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:03.237203 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:11:03.237432 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 540/1068] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:11:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:03.243199 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f27b1-e760-44a9-adc2-83f25b3254e8 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:03.349401 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f27b1-e760-44a9-adc2-83f25b3254e8 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:03.391815 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c709e-2f65-4322-9850-933ca1338cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:03.392478 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c709e-2f65-4322-9850-933ca1338cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:03.392761 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c709e-2f65-4322-9850-933ca1338cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:03.393039 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c709e-2f65-4322-9850-933ca1338cb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:03.393765 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c709e-2f65-4322-9850-933ca1338cb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:03.394072 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c709e-2f65-4322-9850-933ca1338cb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:03.395495 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c709e-2f65-4322-9850-933ca1338cb5 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:03.416030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 529/1069] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:11:03.417626 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e22f5-eb6f-4d1b-a70f-eb385f01cb80 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:03.513402 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:03.543031 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e22f5-eb6f-4d1b-a70f-eb385f01cb80 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:03.552601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449d547-57c9-4ed7-a043-bb59c7746728 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:03.553003 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449d547-57c9-4ed7-a043-bb59c7746728 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:03.553160 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449d547-57c9-4ed7-a043-bb59c7746728 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:03.554671 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 530/1070] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:11:03.560173 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2baf737-6c08-4867-b998-b3f93c294990 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:03.560455 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2baf737-6c08-4867-b998-b3f93c294990 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:03.560732 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2baf737-6c08-4867-b998-b3f93c294990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:03.580061 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-a2baf737-6c08-4867-b998-b3f93c294990 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:03.581272 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a2baf737-6c08-4867-b998-b3f93c294990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:03.594821 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc4beb-ea14-4f13-9464-05bf70265a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:03.595747 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc4beb-ea14-4f13-9464-05bf70265a48 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:03.596031 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc4beb-ea14-4f13-9464-05bf70265a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:03.596382 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc4beb-ea14-4f13-9464-05bf70265a48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:03.605306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc4beb-ea14-4f13-9464-05bf70265a48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:03.606856 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc4beb-ea14-4f13-9464-05bf70265a48 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:03.609968 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:03.622534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-e3dc4beb-ea14-4f13-9464-05bf70265a48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:11:03.622534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:03.622534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:03.622534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:03.622534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:03.622534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:03.622534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:03.622534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:03.622534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:03.622534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:03.622534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:03.622534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:03.622534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:11:03.622534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:11:03.622534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:11:03.624469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:11:03.624469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:03.624469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:03.624469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:03.624469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:03.624469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:03.624469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:03.624469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:03.624469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:03.624469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:03.624469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:03.624469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:03.624469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:03.624469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:03.624469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:03.624469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:03.624469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:03.625391 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:11:03.625391 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:11:03.625391 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:11:03.625391 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:11:03.625391 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:11:03.625391 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:11:03.625391 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:11:03.625391 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:11:03.625391 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 541/1071] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:11:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:03.628973 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc4beb-ea14-4f13-9464-05bf70265a48 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:03.659841 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 531/1072] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:11:03.682771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2baf737-6c08-4867-b998-b3f93c294990 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:03.732441 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc4beb-ea14-4f13-9464-05bf70265a48 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:03.768768 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698869f7-e427-4f3f-8875-68bd09a640f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:03.769439 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698869f7-e427-4f3f-8875-68bd09a640f5 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:03.769721 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698869f7-e427-4f3f-8875-68bd09a640f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:03.769996 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698869f7-e427-4f3f-8875-68bd09a640f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:03.771189 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698869f7-e427-4f3f-8875-68bd09a640f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:03.771498 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698869f7-e427-4f3f-8875-68bd09a640f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:03.773249 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698869f7-e427-4f3f-8875-68bd09a640f5 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:03.776617 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:03.786893 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 542/1073] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:11:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:11:03.793348 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698869f7-e427-4f3f-8875-68bd09a640f5 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:03.794734 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2baf737-6c08-4867-b998-b3f93c294990 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:03.832113 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db66415-1a6b-43dc-9452-576eb2686b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:03.832910 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db66415-1a6b-43dc-9452-576eb2686b16 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:03.833255 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db66415-1a6b-43dc-9452-576eb2686b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:03.833534 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db66415-1a6b-43dc-9452-576eb2686b16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:03.844760 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db66415-1a6b-43dc-9452-576eb2686b16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:11:03.852525 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-3db66415-1a6b-43dc-9452-576eb2686b16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:11:03.852525 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:03.852525 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:03.852525 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:03.852525 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:03.852525 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:03.852525 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:03.852525 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:03.852525 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:03.852525 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:03.852525 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:03.852525 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:03.852525 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:11:03.852525 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:11:03.852525 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:11:03.852525 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:11:03.854658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:11:03.854658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:11:03.854658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:11:03.854658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:11:03.854658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:03.854658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:03.854658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:03.854658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:03.854658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:03.854658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:03.854658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:03.854658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:03.854658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:03.854658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:03.854658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:03.854658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:03.855567 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:03.855567 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:03.855567 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:03.855567 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:03.855567 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:11:03.855567 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:11:03.855567 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:11:03.855567 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:11:03.855567 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:11:03.855567 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:11:03.855567 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:11:03.855567 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:11:03.855567 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 532/1074] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:11:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:11:03.862228 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db66415-1a6b-43dc-9452-576eb2686b16 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:03.892511 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:03.906369 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698869f7-e427-4f3f-8875-68bd09a640f5 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:03.947253 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fdb07-1e51-4032-8088-ffd62f4450ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:03.948245 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fdb07-1e51-4032-8088-ffd62f4450ea None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:03.948534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fdb07-1e51-4032-8088-ffd62f4450ea None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:03.948808 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fdb07-1e51-4032-8088-ffd62f4450ea None admin] PATH_INFO: `/v3/projects/1076c94b43b2483eb4fc06173f9204c3/users/910cd341df8943f18af2765e2a30b238/roles/16c0534ca3dd473eb63776e14107ad0b` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:03.951111 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fdb07-1e51-4032-8088-ffd62f4450ea None admin] RBAC: Authorizing `identity:create_grant(project_id=1076c94b43b2483eb4fc06173f9204c3, user_id=910cd341df8943f18af2765e2a30b238, role_id=16c0534ca3dd473eb63776e14107ad0b)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:03.952541 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fdb07-1e51-4032-8088-ffd62f4450ea None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:03.988235 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db66415-1a6b-43dc-9452-576eb2686b16 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:04.028823 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c614d5b-4c33-4da1-819b-9431a3ac296d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:04.029401 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c614d5b-4c33-4da1-819b-9431a3ac296d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:04.029682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c614d5b-4c33-4da1-819b-9431a3ac296d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:04.029953 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c614d5b-4c33-4da1-819b-9431a3ac296d None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:04.030727 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c614d5b-4c33-4da1-819b-9431a3ac296d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:04.031028 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c614d5b-4c33-4da1-819b-9431a3ac296d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:04.032384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c614d5b-4c33-4da1-819b-9431a3ac296d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:04.039984 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 543/1075] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 21:11:03 2022] PUT /identity/v3/projects/1076c94b43b2483eb4fc06173f9204c3/users/910cd341df8943f18af2765e2a30b238/roles/16c0534ca3dd473eb63776e14107ad0b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:11:04.049761 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 533/1076] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:11:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:11:04.057033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fdb07-1e51-4032-8088-ffd62f4450ea None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:04.121148 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:04.169222 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fdb07-1e51-4032-8088-ffd62f4450ea None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:04.207949 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac466695-7df5-49bf-b6e6-68d31b8d2bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:04.208824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac466695-7df5-49bf-b6e6-68d31b8d2bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:04.209113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac466695-7df5-49bf-b6e6-68d31b8d2bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:04.209385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac466695-7df5-49bf-b6e6-68d31b8d2bd9 None admin] PATH_INFO: `/v3/users/41255e1dc4cc44c7811d4acd9d4902a5` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:04.210595 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac466695-7df5-49bf-b6e6-68d31b8d2bd9 None admin] RBAC: Authorizing `identity:get_user(user_id=41255e1dc4cc44c7811d4acd9d4902a5)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:04.212022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac466695-7df5-49bf-b6e6-68d31b8d2bd9 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:04.214759 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 544/1077] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:11:04 2022] GET /identity/v3/users/41255e1dc4cc44c7811d4acd9d4902a5 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:04.220719 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c614d5b-4c33-4da1-819b-9431a3ac296d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:04.303653 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:04.321748 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c614d5b-4c33-4da1-819b-9431a3ac296d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:04.358949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e03c7-7972-4245-a3ed-7a63deb7d550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:04.359800 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e03c7-7972-4245-a3ed-7a63deb7d550 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:04.360076 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e03c7-7972-4245-a3ed-7a63deb7d550 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:04.360344 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e03c7-7972-4245-a3ed-7a63deb7d550 None admin] PATH_INFO: `/v3/projects/efbf69cb0e914ecf811c2b83a28bcc07` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:04.361513 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e03c7-7972-4245-a3ed-7a63deb7d550 None admin] RBAC: Authorizing `identity:get_project(project_id=efbf69cb0e914ecf811c2b83a28bcc07)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:04.362977 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e03c7-7972-4245-a3ed-7a63deb7d550 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:04.364887 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 534/1078] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:11:04 2022] GET /identity/v3/projects/efbf69cb0e914ecf811c2b83a28bcc07 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:11:04.370854 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac466695-7df5-49bf-b6e6-68d31b8d2bd9 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:04.473770 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac466695-7df5-49bf-b6e6-68d31b8d2bd9 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:04.497835 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:04.508684 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c4b8d-ea6b-49db-bd69-a12187f89672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:04.510606 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c4b8d-ea6b-49db-bd69-a12187f89672 None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:04.510606 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c4b8d-ea6b-49db-bd69-a12187f89672 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:04.510606 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c4b8d-ea6b-49db-bd69-a12187f89672 None admin] PATH_INFO: `/v3/projects/efbf69cb0e914ecf811c2b83a28bcc07/users/41255e1dc4cc44c7811d4acd9d4902a5/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:04.513735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c4b8d-ea6b-49db-bd69-a12187f89672 None admin] RBAC: Authorizing `identity:create_grant(project_id=efbf69cb0e914ecf811c2b83a28bcc07, user_id=41255e1dc4cc44c7811d4acd9d4902a5, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:04.513735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c4b8d-ea6b-49db-bd69-a12187f89672 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:04.582480 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 545/1079] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 21:11:04 2022] PUT /identity/v3/projects/efbf69cb0e914ecf811c2b83a28bcc07/users/41255e1dc4cc44c7811d4acd9d4902a5/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:11:04.848682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b38ae-e1ce-4b94-8bd8-a1d220dd218c None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:04.848976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b38ae-e1ce-4b94-8bd8-a1d220dd218c None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:04.849161 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b38ae-e1ce-4b94-8bd8-a1d220dd218c None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:04.850731 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 535/1080] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:11:04.855640 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13b613-da18-44d6-a2c7-d7333cc8317f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:04.855933 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13b613-da18-44d6-a2c7-d7333cc8317f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:04.856216 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13b613-da18-44d6-a2c7-d7333cc8317f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:04.872808 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-1f13b613-da18-44d6-a2c7-d7333cc8317f None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:04.873994 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-1f13b613-da18-44d6-a2c7-d7333cc8317f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:04.943328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 546/1081] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:11:04.966110 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b38ae-e1ce-4b94-8bd8-a1d220dd218c None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:05.071144 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b38ae-e1ce-4b94-8bd8-a1d220dd218c None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:05.105606 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f8976-dc0a-4f84-9dc2-8c5300f9e6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:05.106200 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f8976-dc0a-4f84-9dc2-8c5300f9e6db None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:05.106486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f8976-dc0a-4f84-9dc2-8c5300f9e6db None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:05.106762 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f8976-dc0a-4f84-9dc2-8c5300f9e6db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:05.126422 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:05.178319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f8976-dc0a-4f84-9dc2-8c5300f9e6db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:05.179804 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f8976-dc0a-4f84-9dc2-8c5300f9e6db None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:05.285232 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 536/1082] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:11:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:11:05.287092 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13b613-da18-44d6-a2c7-d7333cc8317f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:05.388551 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13b613-da18-44d6-a2c7-d7333cc8317f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:05.402883 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:05.423098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44318d12-1ef5-4c15-92a9-7cbe9ef1a518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:05.423894 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44318d12-1ef5-4c15-92a9-7cbe9ef1a518 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:05.424172 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44318d12-1ef5-4c15-92a9-7cbe9ef1a518 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:05.424444 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44318d12-1ef5-4c15-92a9-7cbe9ef1a518 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:05.434823 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44318d12-1ef5-4c15-92a9-7cbe9ef1a518 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:05.436266 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44318d12-1ef5-4c15-92a9-7cbe9ef1a518 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:05.454846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-44318d12-1ef5-4c15-92a9-7cbe9ef1a518 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:05.454846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:05.454846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:05.454846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:05.454846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:05.454846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:05.454846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:05.454846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:05.454846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:05.454846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:05.454846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:05.454846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:05.454846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:11:05.454846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:11:05.454846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:11:05.455769 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:11:05.455769 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:05.455769 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:05.455769 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:05.455769 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:05.455769 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:05.455769 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:05.455769 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:05.455769 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:05.455769 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:05.455769 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:05.455769 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:05.455769 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:05.455769 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:05.455769 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:05.455769 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:05.455769 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:05.461675 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:11:05.461675 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:11:05.461675 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:05.461675 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:11:05.461675 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 547/1083] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:11:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:05.463633 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f8976-dc0a-4f84-9dc2-8c5300f9e6db None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:05.513643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:05.564941 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f8976-dc0a-4f84-9dc2-8c5300f9e6db None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:05.607367 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b8ac4-e427-4a3e-bffa-928d2a12c5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:05.608275 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b8ac4-e427-4a3e-bffa-928d2a12c5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:05.608742 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b8ac4-e427-4a3e-bffa-928d2a12c5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:05.609216 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b8ac4-e427-4a3e-bffa-928d2a12c5f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:05.610149 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b8ac4-e427-4a3e-bffa-928d2a12c5f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:05.610659 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b8ac4-e427-4a3e-bffa-928d2a12c5f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:05.612209 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b8ac4-e427-4a3e-bffa-928d2a12c5f1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:05.625646 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 537/1084] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:06.113352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774d7ad-8e8b-47a1-9b86-a4ca21b3d58b None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:06.113910 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774d7ad-8e8b-47a1-9b86-a4ca21b3d58b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:06.113910 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774d7ad-8e8b-47a1-9b86-a4ca21b3d58b None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:06.115309 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 548/1085] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:11:06.120560 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632cadb-5246-4128-8a27-aa0452464080 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:06.120966 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632cadb-5246-4128-8a27-aa0452464080 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:06.121107 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632cadb-5246-4128-8a27-aa0452464080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:06.137818 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-e632cadb-5246-4128-8a27-aa0452464080 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:06.139018 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e632cadb-5246-4128-8a27-aa0452464080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:06.204504 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 538/1086] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:11:06.228025 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774d7ad-8e8b-47a1-9b86-a4ca21b3d58b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:06.328689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774d7ad-8e8b-47a1-9b86-a4ca21b3d58b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:06.361932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1108d-d69e-49c2-8dd1-476cfe871f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:06.362760 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1108d-d69e-49c2-8dd1-476cfe871f3b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:06.363042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1108d-d69e-49c2-8dd1-476cfe871f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:06.363313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1108d-d69e-49c2-8dd1-476cfe871f3b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:06.373354 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1108d-d69e-49c2-8dd1-476cfe871f3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:11:06.381494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-9ad1108d-d69e-49c2-8dd1-476cfe871f3b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:11:06.381494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:06.381494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:06.381494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:06.381494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:06.381494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:06.381494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:06.381494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:06.381494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:06.381494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:06.381494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:06.381494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:06.381494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:11:06.381494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:11:06.381494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:11:06.381494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:11:06.382524 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:11:06.382524 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:11:06.382524 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:11:06.382524 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:11:06.382524 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:06.382524 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:06.382524 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:06.382524 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:06.382524 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:06.382524 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:06.382524 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:06.382524 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:06.382524 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:06.382524 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:06.382524 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:06.382524 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:06.383434 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:06.383434 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:06.383434 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:06.383434 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:06.383434 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:11:06.383434 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:11:06.383434 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:11:06.383434 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:11:06.383434 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:11:06.383434 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:11:06.383434 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:11:06.383434 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:11:06.386419 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 549/1087] 10.222.0.13 () {56 vars in 1120 bytes} [Tue Jul 5 21:11:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:06.389367 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632cadb-5246-4128-8a27-aa0452464080 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:06.430060 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:06.486746 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632cadb-5246-4128-8a27-aa0452464080 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:06.521698 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e32cb3-85f0-46c6-89b9-396395aaafde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:06.522392 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e32cb3-85f0-46c6-89b9-396395aaafde None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:06.522675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e32cb3-85f0-46c6-89b9-396395aaafde None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:06.522949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e32cb3-85f0-46c6-89b9-396395aaafde None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:06.523687 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e32cb3-85f0-46c6-89b9-396395aaafde None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:06.523992 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e32cb3-85f0-46c6-89b9-396395aaafde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:06.525864 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e32cb3-85f0-46c6-89b9-396395aaafde None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:06.533965 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 539/1088] 10.222.0.13 () {56 vars in 1115 bytes} [Tue Jul 5 21:11:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:06.539626 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1108d-d69e-49c2-8dd1-476cfe871f3b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:06.568591 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:06.631233 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15449d9a-b84c-468d-a863-30ac901f06a4 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:06.631439 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15449d9a-b84c-468d-a863-30ac901f06a4 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:06.631724 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15449d9a-b84c-468d-a863-30ac901f06a4 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:06.633092 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 540/1089] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:11:06.638440 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ece5d-132d-455f-a2e2-23515fc0b35b None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:06.638730 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ece5d-132d-455f-a2e2-23515fc0b35b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:06.639015 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ece5d-132d-455f-a2e2-23515fc0b35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:06.640952 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1108d-d69e-49c2-8dd1-476cfe871f3b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:06.655608 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-774ece5d-132d-455f-a2e2-23515fc0b35b None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:06.656804 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-774ece5d-132d-455f-a2e2-23515fc0b35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:06.675787 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414df62-7a41-4b8a-8673-139b43b506b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:06.676577 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414df62-7a41-4b8a-8673-139b43b506b0 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:06.676863 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414df62-7a41-4b8a-8673-139b43b506b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:06.677142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414df62-7a41-4b8a-8673-139b43b506b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:06.688491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414df62-7a41-4b8a-8673-139b43b506b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:06.689939 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414df62-7a41-4b8a-8673-139b43b506b0 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:06.707448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-5414df62-7a41-4b8a-8673-139b43b506b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:06.707448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:06.707448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:06.707448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:06.707448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:06.707448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:06.707448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:06.707448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:06.707448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:06.707448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:06.707448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:06.707448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:06.707448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:11:06.707448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:11:06.707448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:11:06.708379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:11:06.708379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:06.708379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:06.708379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:06.708379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:06.708379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:06.708379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:06.708379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:06.708379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:06.708379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:06.708379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:06.708379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:06.708379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:06.708379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:06.708379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:06.708379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:06.708379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:06.709314 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:11:06.709314 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:11:06.709314 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:06.709314 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:11:06.709314 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 550/1090] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:11:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:06.714306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414df62-7a41-4b8a-8673-139b43b506b0 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:06.726578 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 541/1091] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:11:06.750097 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ece5d-132d-455f-a2e2-23515fc0b35b None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:06.781062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:06.792452 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:06.813800 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414df62-7a41-4b8a-8673-139b43b506b0 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:06.847482 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2fcb7-546d-414e-8ec0-3ce993765e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:06.848172 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2fcb7-546d-414e-8ec0-3ce993765e84 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:06.848458 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2fcb7-546d-414e-8ec0-3ce993765e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:06.848755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2fcb7-546d-414e-8ec0-3ce993765e84 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:06.849464 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2fcb7-546d-414e-8ec0-3ce993765e84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:06.849772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2fcb7-546d-414e-8ec0-3ce993765e84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:06.850626 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ece5d-132d-455f-a2e2-23515fc0b35b None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:06.851200 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2fcb7-546d-414e-8ec0-3ce993765e84 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:06.864065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 551/1092] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:11:06.869959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2fcb7-546d-414e-8ec0-3ce993765e84 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:06.886022 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93ee30-eb81-4e9d-ac82-f189339159b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:06.886765 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93ee30-eb81-4e9d-ac82-f189339159b1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:06.887050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93ee30-eb81-4e9d-ac82-f189339159b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:06.887322 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93ee30-eb81-4e9d-ac82-f189339159b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:06.897352 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93ee30-eb81-4e9d-ac82-f189339159b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:11:06.904974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-2b93ee30-eb81-4e9d-ac82-f189339159b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:11:06.904974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:06.904974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:06.904974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:06.904974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:06.904974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:06.904974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:06.904974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:06.904974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:06.904974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:06.904974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:06.904974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:06.904974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:11:06.904974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:11:06.904974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:11:06.904974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:11:06.905964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:11:06.905964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:11:06.905964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:11:06.905964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:11:06.905964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:06.905964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:06.905964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:06.905964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:06.905964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:06.905964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:06.905964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:06.905964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:06.905964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:06.905964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:06.905964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:06.905964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:06.906891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:06.906891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:06.906891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:06.906891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:06.906891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:11:06.906891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:11:06.906891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:11:06.906891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:11:06.906891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:11:06.906891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:11:06.906891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:11:06.906891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:11:06.906891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 542/1093] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:11:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:11:06.911949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93ee30-eb81-4e9d-ac82-f189339159b1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:06.970058 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2fcb7-546d-414e-8ec0-3ce993765e84 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:07.001959 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:07.005755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ac45a-284c-4e92-9700-30b6afdae04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:07.012106 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ac45a-284c-4e92-9700-30b6afdae04b None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:07.012106 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ac45a-284c-4e92-9700-30b6afdae04b None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:07.012106 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ac45a-284c-4e92-9700-30b6afdae04b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:07.012458 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93ee30-eb81-4e9d-ac82-f189339159b1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:07.014052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ac45a-284c-4e92-9700-30b6afdae04b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:07.015507 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ac45a-284c-4e92-9700-30b6afdae04b None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:07.017511 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:07.035814 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-d82ac45a-284c-4e92-9700-30b6afdae04b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:11:07.035814 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:07.035814 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:07.035814 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:07.035814 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:07.035814 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:07.035814 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:07.035814 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:07.035814 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:07.035814 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:07.035814 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:07.035814 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:07.035814 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:11:07.035814 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:11:07.035814 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:11:07.035814 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:11:07.038352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:07.038352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:07.038352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:11:07.038352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:11:07.038352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:11:07.038352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:11:07.038352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:07.038352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:07.038352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:07.038352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:07.038352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:07.038352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:07.038352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:07.038352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:07.038352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:07.038352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:07.038352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:07.038352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:07.039329 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:07.039329 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:07.039329 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:11:07.039329 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:11:07.039329 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:11:07.039329 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:11:07.039329 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:11:07.039329 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:11:07.039329 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:11:07.039329 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:11:07.039329 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 552/1094] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Jul 5 21:11:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:11:07.044457 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ac45a-284c-4e92-9700-30b6afdae04b None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:07.046085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b053523-50f5-4fc0-a860-c62c7ec0a683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:07.046781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b053523-50f5-4fc0-a860-c62c7ec0a683 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:07.047244 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b053523-50f5-4fc0-a860-c62c7ec0a683 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:07.047527 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b053523-50f5-4fc0-a860-c62c7ec0a683 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:07.048287 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b053523-50f5-4fc0-a860-c62c7ec0a683 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:07.048598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b053523-50f5-4fc0-a860-c62c7ec0a683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:07.049967 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b053523-50f5-4fc0-a860-c62c7ec0a683 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:07.058903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 543/1095] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:11:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:11:07.064820 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b053523-50f5-4fc0-a860-c62c7ec0a683 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:07.145606 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ac45a-284c-4e92-9700-30b6afdae04b None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:07.161832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b053523-50f5-4fc0-a860-c62c7ec0a683 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:07.179908 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56172015-9fd5-4eb9-8858-77d33b6ea202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:07.180563 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56172015-9fd5-4eb9-8858-77d33b6ea202 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:07.180839 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56172015-9fd5-4eb9-8858-77d33b6ea202 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:07.181112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56172015-9fd5-4eb9-8858-77d33b6ea202 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:07.181964 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56172015-9fd5-4eb9-8858-77d33b6ea202 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:07.182298 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56172015-9fd5-4eb9-8858-77d33b6ea202 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:07.183817 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56172015-9fd5-4eb9-8858-77d33b6ea202 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:07.195133 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5070a6-16e1-4266-a7be-d36453e42a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:07.196002 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5070a6-16e1-4266-a7be-d36453e42a7e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:07.196282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5070a6-16e1-4266-a7be-d36453e42a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:07.196555 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5070a6-16e1-4266-a7be-d36453e42a7e None admin] PATH_INFO: `/v3/users/41255e1dc4cc44c7811d4acd9d4902a5` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:07.198047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5070a6-16e1-4266-a7be-d36453e42a7e None admin] RBAC: Authorizing `identity:get_user(user_id=41255e1dc4cc44c7811d4acd9d4902a5)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:07.199535 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5070a6-16e1-4266-a7be-d36453e42a7e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:07.200596 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 553/1096] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Jul 5 21:11:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:11:07.201171 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 544/1097] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:11:07 2022] GET /identity/v3/users/41255e1dc4cc44c7811d4acd9d4902a5 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:07.206174 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56172015-9fd5-4eb9-8858-77d33b6ea202 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:07.206416 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5070a6-16e1-4266-a7be-d36453e42a7e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:07.230951 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:07.261119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:07.303807 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56172015-9fd5-4eb9-8858-77d33b6ea202 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:07.306573 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5070a6-16e1-4266-a7be-d36453e42a7e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:07.336243 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493c493-cbe1-4376-b736-aafe6f0930b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:07.336888 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493c493-cbe1-4376-b736-aafe6f0930b3 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:07.337173 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493c493-cbe1-4376-b736-aafe6f0930b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:07.337962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493c493-cbe1-4376-b736-aafe6f0930b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:07.340497 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d67dd-dd10-44b9-a041-e4795d75cc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:07.341130 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d67dd-dd10-44b9-a041-e4795d75cc22 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:07.341421 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d67dd-dd10-44b9-a041-e4795d75cc22 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:07.341687 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d67dd-dd10-44b9-a041-e4795d75cc22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:07.405301 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493c493-cbe1-4376-b736-aafe6f0930b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:07.406713 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493c493-cbe1-4376-b736-aafe6f0930b3 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:07.407709 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d67dd-dd10-44b9-a041-e4795d75cc22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:07.409123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d67dd-dd10-44b9-a041-e4795d75cc22 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:07.432455 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:07.460871 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:07.504779 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 554/1098] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:11:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:11:07.511677 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 545/1099] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:11:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 21:11:07.511820 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493c493-cbe1-4376-b736-aafe6f0930b3 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:07.512654 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d67dd-dd10-44b9-a041-e4795d75cc22 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:07.612098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d67dd-dd10-44b9-a041-e4795d75cc22 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:07.612404 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493c493-cbe1-4376-b736-aafe6f0930b3 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:07.633719 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:07.645756 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf94146-ab9c-4fb0-a2c3-6a1203be657e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:07.646562 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea91fe8-1e6d-4b4b-96a4-ade2a8edcfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:07.646684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf94146-ab9c-4fb0-a2c3-6a1203be657e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:07.646903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf94146-ab9c-4fb0-a2c3-6a1203be657e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:07.647176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf94146-ab9c-4fb0-a2c3-6a1203be657e None admin] PATH_INFO: `/v3/projects/efbf69cb0e914ecf811c2b83a28bcc07` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:07.647350 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea91fe8-1e6d-4b4b-96a4-ade2a8edcfb3 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:07.647631 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea91fe8-1e6d-4b4b-96a4-ade2a8edcfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:07.647911 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea91fe8-1e6d-4b4b-96a4-ade2a8edcfb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:07.648334 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf94146-ab9c-4fb0-a2c3-6a1203be657e None admin] RBAC: Authorizing `identity:get_project(project_id=efbf69cb0e914ecf811c2b83a28bcc07)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:07.649818 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf94146-ab9c-4fb0-a2c3-6a1203be657e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:07.652317 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 546/1100] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:11:07 2022] GET /identity/v3/projects/efbf69cb0e914ecf811c2b83a28bcc07 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:07.658347 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf94146-ab9c-4fb0-a2c3-6a1203be657e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:07.658926 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea91fe8-1e6d-4b4b-96a4-ade2a8edcfb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:07.660376 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea91fe8-1e6d-4b4b-96a4-ade2a8edcfb3 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:07.678895 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-7ea91fe8-1e6d-4b4b-96a4-ade2a8edcfb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:07.678895 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:07.678895 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:07.678895 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:07.678895 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:07.678895 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:07.678895 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:07.678895 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:07.678895 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:07.678895 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:07.678895 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:07.678895 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:07.678895 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:11:07.678895 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:11:07.678895 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:11:07.680024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:11:07.680024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:07.680024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:07.680024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:07.680024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:07.680024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:07.680024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:07.680024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:07.680024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:07.680024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:07.680024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:07.680024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:07.680024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:07.680024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:07.680024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:07.680024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:07.680024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:07.685944 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:11:07.685944 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:11:07.685944 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:07.685944 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:11:07.685944 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 555/1101] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:11:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:07.685944 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea91fe8-1e6d-4b4b-96a4-ade2a8edcfb3 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:07.695816 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:07.765648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf94146-ab9c-4fb0-a2c3-6a1203be657e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:07.784027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea91fe8-1e6d-4b4b-96a4-ade2a8edcfb3 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:07.799041 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b5769-4a3f-4156-86d2-c7909b356d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:07.799688 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b5769-4a3f-4156-86d2-c7909b356d9a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:07.799988 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b5769-4a3f-4156-86d2-c7909b356d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:07.800257 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b5769-4a3f-4156-86d2-c7909b356d9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:07.801083 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b5769-4a3f-4156-86d2-c7909b356d9a None admin] RBAC: Adding query filter params (role.id=15cf04fec8c6477088a33bf286f1bbdb, scope.project.id=efbf69cb0e914ecf811c2b83a28bcc07, user.id=41255e1dc4cc44c7811d4acd9d4902a5) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:07.801395 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b5769-4a3f-4156-86d2-c7909b356d9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:07.802865 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b5769-4a3f-4156-86d2-c7909b356d9a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:07.809002 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 547/1102] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:11:07 2022] GET /identity/v3/role_assignments?user.id=41255e1dc4cc44c7811d4acd9d4902a5&scope.project.id=efbf69cb0e914ecf811c2b83a28bcc07&role.id=15cf04fec8c6477088a33bf286f1bbdb => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:11:07.817179 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd7573-6839-442b-99a7-e1cad8e50a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:07.817872 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd7573-6839-442b-99a7-e1cad8e50a47 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:07.818181 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd7573-6839-442b-99a7-e1cad8e50a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:07.818463 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd7573-6839-442b-99a7-e1cad8e50a47 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:07.819203 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd7573-6839-442b-99a7-e1cad8e50a47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:07.819511 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd7573-6839-442b-99a7-e1cad8e50a47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:07.820928 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd7573-6839-442b-99a7-e1cad8e50a47 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:07.834457 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 556/1103] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:07.841452 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b5769-4a3f-4156-86d2-c7909b356d9a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:07.901444 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:07.951081 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b5769-4a3f-4156-86d2-c7909b356d9a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:07.985953 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5c161-91bd-474f-bd9d-8cdb990208f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:07.986781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5c161-91bd-474f-bd9d-8cdb990208f4 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:07.987064 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5c161-91bd-474f-bd9d-8cdb990208f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:07.987337 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5c161-91bd-474f-bd9d-8cdb990208f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:07.994690 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5c161-91bd-474f-bd9d-8cdb990208f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:07.996135 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5c161-91bd-474f-bd9d-8cdb990208f4 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:08.011081 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-e4c5c161-91bd-474f-bd9d-8cdb990208f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:11:08.011081 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:08.011081 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:08.011081 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:08.011081 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:08.011081 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:08.011081 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:08.011081 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:08.011081 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:08.011081 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:08.011081 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:08.011081 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:08.011081 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:11:08.011081 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:11:08.011081 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:11:08.012165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:11:08.012165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:08.012165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:08.012165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:08.012165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:08.012165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:08.012165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:08.012165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:08.012165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:08.012165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:08.012165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:08.012165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:08.012165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:08.012165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:08.012165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:08.012165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:08.012165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:08.013092 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:11:08.013092 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:11:08.013092 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:11:08.013092 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:11:08.013092 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:11:08.013092 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:11:08.013092 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:11:08.013092 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:11:08.013092 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 548/1104] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:11:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:08.018390 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd7573-6839-442b-99a7-e1cad8e50a47 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:08.084964 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:08.118520 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd7573-6839-442b-99a7-e1cad8e50a47 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:08.152992 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed808b5-342b-47b3-b671-6a85d59d24bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:08.153657 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed808b5-342b-47b3-b671-6a85d59d24bc None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:08.153927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed808b5-342b-47b3-b671-6a85d59d24bc None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:08.154235 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed808b5-342b-47b3-b671-6a85d59d24bc None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:08.155019 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed808b5-342b-47b3-b671-6a85d59d24bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:08.155330 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed808b5-342b-47b3-b671-6a85d59d24bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:08.156763 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed808b5-342b-47b3-b671-6a85d59d24bc None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:08.169036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 557/1105] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:11:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:08.175003 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5c161-91bd-474f-bd9d-8cdb990208f4 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:08.274640 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5c161-91bd-474f-bd9d-8cdb990208f4 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:08.289566 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:08.310753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26d9a1-d367-4867-b979-eebeb539d3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:08.311403 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26d9a1-d367-4867-b979-eebeb539d3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:08.311682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26d9a1-d367-4867-b979-eebeb539d3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:08.311955 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26d9a1-d367-4867-b979-eebeb539d3e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:08.312772 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26d9a1-d367-4867-b979-eebeb539d3e6 None admin] RBAC: Adding query filter params (role.id=16c0534ca3dd473eb63776e14107ad0b, scope.project.id=1076c94b43b2483eb4fc06173f9204c3, user.id=910cd341df8943f18af2765e2a30b238) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:08.313079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26d9a1-d367-4867-b979-eebeb539d3e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:08.314515 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26d9a1-d367-4867-b979-eebeb539d3e6 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:08.320329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 549/1106] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:11:08 2022] GET /identity/v3/role_assignments?user.id=910cd341df8943f18af2765e2a30b238&scope.project.id=1076c94b43b2483eb4fc06173f9204c3&role.id=16c0534ca3dd473eb63776e14107ad0b => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:09.891327 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6df3d4-cd2f-4e5f-9495-757085a59a94 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:09.892078 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6df3d4-cd2f-4e5f-9495-757085a59a94 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:09.892078 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6df3d4-cd2f-4e5f-9495-757085a59a94 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:09.893405 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 558/1107] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:11:09.898592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74cdd82-de45-44d2-8112-e821050e0706 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:09.898997 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74cdd82-de45-44d2-8112-e821050e0706 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:09.899139 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74cdd82-de45-44d2-8112-e821050e0706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:09.916157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-c74cdd82-de45-44d2-8112-e821050e0706 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:09.917330 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c74cdd82-de45-44d2-8112-e821050e0706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:09.980914 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 550/1108] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:11:10.005541 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6df3d4-cd2f-4e5f-9495-757085a59a94 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:10.106350 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6df3d4-cd2f-4e5f-9495-757085a59a94 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:10.132080 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:10.140180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107047e9-dc68-49ce-b666-47a89963f402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:10.140961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107047e9-dc68-49ce-b666-47a89963f402 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:10.141246 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107047e9-dc68-49ce-b666-47a89963f402 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:10.141835 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107047e9-dc68-49ce-b666-47a89963f402 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:10.142975 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107047e9-dc68-49ce-b666-47a89963f402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:10.144406 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107047e9-dc68-49ce-b666-47a89963f402 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:10.146008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 559/1109] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:11:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:10.152344 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74cdd82-de45-44d2-8112-e821050e0706 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:10.249474 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74cdd82-de45-44d2-8112-e821050e0706 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:10.258398 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:10.283192 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e96107-3219-4133-b8d8-dfe113160c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:10.283847 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e96107-3219-4133-b8d8-dfe113160c84 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:10.284131 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e96107-3219-4133-b8d8-dfe113160c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:10.284411 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e96107-3219-4133-b8d8-dfe113160c84 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:10.285113 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e96107-3219-4133-b8d8-dfe113160c84 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:10.286574 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e96107-3219-4133-b8d8-dfe113160c84 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:10.368230 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 551/1110] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 21:11:10 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:11:12.424061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc22e8-24f3-42bd-9b4e-b124b58071ee None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:12.424594 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc22e8-24f3-42bd-9b4e-b124b58071ee None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:12.424682 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc22e8-24f3-42bd-9b4e-b124b58071ee None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:12.425980 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 560/1111] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:11:12.431177 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2e347-f690-42c1-be2a-c25d726f19d2 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:12.431593 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2e347-f690-42c1-be2a-c25d726f19d2 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:12.431728 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2e347-f690-42c1-be2a-c25d726f19d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:12.448222 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-32a2e347-f690-42c1-be2a-c25d726f19d2 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:12.449766 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-32a2e347-f690-42c1-be2a-c25d726f19d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:12.514396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 552/1112] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:11:12.538486 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc22e8-24f3-42bd-9b4e-b124b58071ee None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:12.637029 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc22e8-24f3-42bd-9b4e-b124b58071ee None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:12.670676 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf0e90-3ea3-497b-88a1-ce6bb7d1397c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:12.671508 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf0e90-3ea3-497b-88a1-ce6bb7d1397c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:12.671786 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf0e90-3ea3-497b-88a1-ce6bb7d1397c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:12.672058 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf0e90-3ea3-497b-88a1-ce6bb7d1397c None admin] PATH_INFO: `/v3/roles/d39f0a4f271f470490b67062462b2d74` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:12.673515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf0e90-3ea3-497b-88a1-ce6bb7d1397c None admin] RBAC: Authorizing `identity:get_role(role_id=d39f0a4f271f470490b67062462b2d74)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:12.674957 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf0e90-3ea3-497b-88a1-ce6bb7d1397c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:12.676274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 561/1113] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:11:12 2022] GET /identity/v3/roles/d39f0a4f271f470490b67062462b2d74 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:12.682073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2e347-f690-42c1-be2a-c25d726f19d2 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:12.772154 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:12.779102 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2e347-f690-42c1-be2a-c25d726f19d2 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:12.810787 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe78a567-29e0-44be-bc46-78700862332c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:12.811645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78a567-29e0-44be-bc46-78700862332c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:12.811924 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78a567-29e0-44be-bc46-78700862332c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:12.812200 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78a567-29e0-44be-bc46-78700862332c None admin] PATH_INFO: `/v3/users/3929fe1c79d348d79f40e65be968c79a` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:12.825212 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe78a567-29e0-44be-bc46-78700862332c None admin] RBAC: Authorizing `identity:get_user(user_id=3929fe1c79d348d79f40e65be968c79a)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:12.826682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe78a567-29e0-44be-bc46-78700862332c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:12.828315 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 553/1114] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:11:12 2022] GET /identity/v3/users/3929fe1c79d348d79f40e65be968c79a => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:12.833988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf0e90-3ea3-497b-88a1-ce6bb7d1397c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:12.895053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:12.931411 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf0e90-3ea3-497b-88a1-ce6bb7d1397c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:12.964857 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a876a1-bb44-4319-99e7-97fcf85be775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:12.965490 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a876a1-bb44-4319-99e7-97fcf85be775 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:12.965774 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a876a1-bb44-4319-99e7-97fcf85be775 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:12.966055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a876a1-bb44-4319-99e7-97fcf85be775 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:13.031728 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a876a1-bb44-4319-99e7-97fcf85be775 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:13.033163 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a876a1-bb44-4319-99e7-97fcf85be775 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:13.092190 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:13.129443 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 562/1115] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:11:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:11:13.135318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe78a567-29e0-44be-bc46-78700862332c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:13.231904 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe78a567-29e0-44be-bc46-78700862332c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:13.264946 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e807da9-ebe5-43c0-b934-9f4b31aae0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:13.265787 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e807da9-ebe5-43c0-b934-9f4b31aae0dd None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:13.266069 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e807da9-ebe5-43c0-b934-9f4b31aae0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:13.266373 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e807da9-ebe5-43c0-b934-9f4b31aae0dd None admin] PATH_INFO: `/v3/projects/efbf69cb0e914ecf811c2b83a28bcc07` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:13.267801 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e807da9-ebe5-43c0-b934-9f4b31aae0dd None admin] RBAC: Authorizing `identity:get_project(project_id=efbf69cb0e914ecf811c2b83a28bcc07)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:13.269236 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e807da9-ebe5-43c0-b934-9f4b31aae0dd None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:13.270945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 554/1116] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:11:13 2022] GET /identity/v3/projects/efbf69cb0e914ecf811c2b83a28bcc07 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:13.277103 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a876a1-bb44-4319-99e7-97fcf85be775 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:13.372965 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a876a1-bb44-4319-99e7-97fcf85be775 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:13.405907 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4d54e-bdb5-4309-8a07-980d45192932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:13.406571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4d54e-bdb5-4309-8a07-980d45192932 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:13.406856 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4d54e-bdb5-4309-8a07-980d45192932 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:13.407134 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4d54e-bdb5-4309-8a07-980d45192932 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:13.407954 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4d54e-bdb5-4309-8a07-980d45192932 None admin] RBAC: Adding query filter params (role.id=d39f0a4f271f470490b67062462b2d74, scope.project.id=efbf69cb0e914ecf811c2b83a28bcc07, user.id=3929fe1c79d348d79f40e65be968c79a) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:13.408266 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4d54e-bdb5-4309-8a07-980d45192932 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:13.409686 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4d54e-bdb5-4309-8a07-980d45192932 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:13.414987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 563/1117] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:11:13 2022] GET /identity/v3/role_assignments?user.id=3929fe1c79d348d79f40e65be968c79a&scope.project.id=efbf69cb0e914ecf811c2b83a28bcc07&role.id=d39f0a4f271f470490b67062462b2d74 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:15.389489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c202813-dbe5-4622-b7a3-f4e33c9b1e81 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:15.390147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c202813-dbe5-4622-b7a3-f4e33c9b1e81 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:15.390147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c202813-dbe5-4622-b7a3-f4e33c9b1e81 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:15.391427 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 555/1118] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:11:15.396726 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b1eed-3553-4254-94b9-da556405cf41 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:15.397154 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b1eed-3553-4254-94b9-da556405cf41 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:15.397283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b1eed-3553-4254-94b9-da556405cf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:15.414078 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-6e1b1eed-3553-4254-94b9-da556405cf41 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:15.415291 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6e1b1eed-3553-4254-94b9-da556405cf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:15.437672 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:15.479346 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 564/1119] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:11:15.502133 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c202813-dbe5-4622-b7a3-f4e33c9b1e81 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:15.523679 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:15.602472 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c202813-dbe5-4622-b7a3-f4e33c9b1e81 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:15.635835 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898ec08-9898-45dc-8701-f0f81f3260d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:15.636735 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898ec08-9898-45dc-8701-f0f81f3260d8 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:15.637020 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898ec08-9898-45dc-8701-f0f81f3260d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:15.637298 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898ec08-9898-45dc-8701-f0f81f3260d8 None admin] PATH_INFO: `/v3/roles/d39f0a4f271f470490b67062462b2d74` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:15.638819 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898ec08-9898-45dc-8701-f0f81f3260d8 None admin] RBAC: Authorizing `identity:get_role(role_id=d39f0a4f271f470490b67062462b2d74)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:15.640221 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898ec08-9898-45dc-8701-f0f81f3260d8 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:15.641539 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 556/1120] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:11:15 2022] GET /identity/v3/roles/d39f0a4f271f470490b67062462b2d74 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:15.647569 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b1eed-3553-4254-94b9-da556405cf41 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:15.742669 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b1eed-3553-4254-94b9-da556405cf41 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:15.775834 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c5380-feb4-4d5f-bcc5-fdbd29f36963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:15.776742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c5380-feb4-4d5f-bcc5-fdbd29f36963 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:15.777592 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c5380-feb4-4d5f-bcc5-fdbd29f36963 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:15.777871 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c5380-feb4-4d5f-bcc5-fdbd29f36963 None admin] PATH_INFO: `/v3/users/3929fe1c79d348d79f40e65be968c79a` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:15.779077 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c5380-feb4-4d5f-bcc5-fdbd29f36963 None admin] RBAC: Authorizing `identity:get_user(user_id=3929fe1c79d348d79f40e65be968c79a)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:15.780494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c5380-feb4-4d5f-bcc5-fdbd29f36963 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:15.782088 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 565/1121] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:11:15 2022] GET /identity/v3/users/3929fe1c79d348d79f40e65be968c79a => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:15.787771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898ec08-9898-45dc-8701-f0f81f3260d8 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:15.872023 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:15.883444 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898ec08-9898-45dc-8701-f0f81f3260d8 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:15.917213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3171e-cd5b-4a96-82a8-fff0b87e1eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:15.918013 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3171e-cd5b-4a96-82a8-fff0b87e1eae None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:15.918324 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3171e-cd5b-4a96-82a8-fff0b87e1eae None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:15.918578 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3171e-cd5b-4a96-82a8-fff0b87e1eae None admin] PATH_INFO: `/v3/projects/efbf69cb0e914ecf811c2b83a28bcc07` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:15.919728 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3171e-cd5b-4a96-82a8-fff0b87e1eae None admin] RBAC: Authorizing `identity:get_project(project_id=efbf69cb0e914ecf811c2b83a28bcc07)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:15.921142 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3171e-cd5b-4a96-82a8-fff0b87e1eae None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:15.922832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 557/1122] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:11:15 2022] GET /identity/v3/projects/efbf69cb0e914ecf811c2b83a28bcc07 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:15.928663 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c5380-feb4-4d5f-bcc5-fdbd29f36963 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:15.955745 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:16.028739 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c5380-feb4-4d5f-bcc5-fdbd29f36963 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:16.060653 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924599e1-e157-4f6c-b1e4-77f81d87ec01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:16.061529 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924599e1-e157-4f6c-b1e4-77f81d87ec01 None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:16.061813 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924599e1-e157-4f6c-b1e4-77f81d87ec01 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:16.062089 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924599e1-e157-4f6c-b1e4-77f81d87ec01 None admin] PATH_INFO: `/v3/projects/efbf69cb0e914ecf811c2b83a28bcc07/users/3929fe1c79d348d79f40e65be968c79a/roles/d39f0a4f271f470490b67062462b2d74` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:16.064291 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924599e1-e157-4f6c-b1e4-77f81d87ec01 None admin] RBAC: Authorizing `identity:create_grant(project_id=efbf69cb0e914ecf811c2b83a28bcc07, user_id=3929fe1c79d348d79f40e65be968c79a, role_id=d39f0a4f271f470490b67062462b2d74)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:16.065729 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924599e1-e157-4f6c-b1e4-77f81d87ec01 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:16.127876 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 566/1123] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 21:11:15 2022] PUT /identity/v3/projects/efbf69cb0e914ecf811c2b83a28bcc07/users/3929fe1c79d348d79f40e65be968c79a/roles/d39f0a4f271f470490b67062462b2d74 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:11:18.105420 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f03a2-5163-41c9-8929-80785b02e44d None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:18.105968 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f03a2-5163-41c9-8929-80785b02e44d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:18.105968 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f03a2-5163-41c9-8929-80785b02e44d None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:18.107346 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 558/1124] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:11:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:11:18.112416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06a46d-6bc8-4081-87de-70cd717a2dda None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:18.112810 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06a46d-6bc8-4081-87de-70cd717a2dda None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:18.112976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06a46d-6bc8-4081-87de-70cd717a2dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:18.129814 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0f06a46d-6bc8-4081-87de-70cd717a2dda None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:18.131030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0f06a46d-6bc8-4081-87de-70cd717a2dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:18.196327 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 567/1125] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:11:18.219665 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f03a2-5163-41c9-8929-80785b02e44d None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:18.320294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f03a2-5163-41c9-8929-80785b02e44d None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:18.353042 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196b737-101d-41b2-92bf-cc78b60e5927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:18.353878 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196b737-101d-41b2-92bf-cc78b60e5927 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:18.354188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196b737-101d-41b2-92bf-cc78b60e5927 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:18.354469 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196b737-101d-41b2-92bf-cc78b60e5927 None admin] PATH_INFO: `/v3/roles/d39f0a4f271f470490b67062462b2d74` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:18.356501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196b737-101d-41b2-92bf-cc78b60e5927 None admin] RBAC: Authorizing `identity:get_role(role_id=d39f0a4f271f470490b67062462b2d74)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:18.357816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196b737-101d-41b2-92bf-cc78b60e5927 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:18.359294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 559/1126] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:11:18 2022] GET /identity/v3/roles/d39f0a4f271f470490b67062462b2d74 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:18.365418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06a46d-6bc8-4081-87de-70cd717a2dda None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:18.383038 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:18.460464 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06a46d-6bc8-4081-87de-70cd717a2dda None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:18.494104 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec962add-e3d9-4ecd-9593-3f0d416c581c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:18.494977 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec962add-e3d9-4ecd-9593-3f0d416c581c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:18.495256 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec962add-e3d9-4ecd-9593-3f0d416c581c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:18.495562 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec962add-e3d9-4ecd-9593-3f0d416c581c None admin] PATH_INFO: `/v3/users/3929fe1c79d348d79f40e65be968c79a` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:18.496855 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec962add-e3d9-4ecd-9593-3f0d416c581c None admin] RBAC: Authorizing `identity:get_user(user_id=3929fe1c79d348d79f40e65be968c79a)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:18.498296 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec962add-e3d9-4ecd-9593-3f0d416c581c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:18.499892 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 568/1127] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:11:18 2022] GET /identity/v3/users/3929fe1c79d348d79f40e65be968c79a => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:18.505577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196b737-101d-41b2-92bf-cc78b60e5927 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:18.531213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:18.604162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196b737-101d-41b2-92bf-cc78b60e5927 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:18.637570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f761b2-19d0-4012-9293-e34cbfd8ebaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:18.638178 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f761b2-19d0-4012-9293-e34cbfd8ebaf None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:18.638464 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f761b2-19d0-4012-9293-e34cbfd8ebaf None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:18.638743 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f761b2-19d0-4012-9293-e34cbfd8ebaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:18.703757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f761b2-19d0-4012-9293-e34cbfd8ebaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:18.705198 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f761b2-19d0-4012-9293-e34cbfd8ebaf None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:18.728275 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:18.801376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 560/1128] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:11:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:11:18.807365 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec962add-e3d9-4ecd-9593-3f0d416c581c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:18.887693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:18.903212 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec962add-e3d9-4ecd-9593-3f0d416c581c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:18.935631 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1554f-6588-412f-8803-a3a5c8b94e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:18.936467 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1554f-6588-412f-8803-a3a5c8b94e40 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:18.936742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1554f-6588-412f-8803-a3a5c8b94e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:18.937012 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1554f-6588-412f-8803-a3a5c8b94e40 None admin] PATH_INFO: `/v3/projects/efbf69cb0e914ecf811c2b83a28bcc07` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:18.938188 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1554f-6588-412f-8803-a3a5c8b94e40 None admin] RBAC: Authorizing `identity:get_project(project_id=efbf69cb0e914ecf811c2b83a28bcc07)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:18.939611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1554f-6588-412f-8803-a3a5c8b94e40 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:18.941274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 569/1129] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:11:18 2022] GET /identity/v3/projects/efbf69cb0e914ecf811c2b83a28bcc07 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:18.947299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f761b2-19d0-4012-9293-e34cbfd8ebaf None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:19.045046 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f761b2-19d0-4012-9293-e34cbfd8ebaf None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:19.067257 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:19.077895 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1c2a6-2874-4297-b254-a1e0fe7ae270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:19.078565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1c2a6-2874-4297-b254-a1e0fe7ae270 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:19.078857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1c2a6-2874-4297-b254-a1e0fe7ae270 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:19.079200 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1c2a6-2874-4297-b254-a1e0fe7ae270 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:19.079962 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1c2a6-2874-4297-b254-a1e0fe7ae270 None admin] RBAC: Adding query filter params (role.id=d39f0a4f271f470490b67062462b2d74, scope.project.id=efbf69cb0e914ecf811c2b83a28bcc07, user.id=3929fe1c79d348d79f40e65be968c79a) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:19.080273 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1c2a6-2874-4297-b254-a1e0fe7ae270 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:19.081688 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1c2a6-2874-4297-b254-a1e0fe7ae270 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:19.087329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 561/1130] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:11:18 2022] GET /identity/v3/role_assignments?user.id=3929fe1c79d348d79f40e65be968c79a&scope.project.id=efbf69cb0e914ecf811c2b83a28bcc07&role.id=d39f0a4f271f470490b67062462b2d74 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:21.153494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a049eae-4669-4f2a-93da-811a2d1e526b None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:21.154063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a049eae-4669-4f2a-93da-811a2d1e526b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:21.154063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a049eae-4669-4f2a-93da-811a2d1e526b None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:21.155431 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 570/1131] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:11:21.160465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7ffff-7a36-47f7-b2dd-16a2667ed8f7 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:21.160902 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7ffff-7a36-47f7-b2dd-16a2667ed8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:21.161003 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7ffff-7a36-47f7-b2dd-16a2667ed8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:21.178112 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-0ce7ffff-7a36-47f7-b2dd-16a2667ed8f7 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:21.179319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0ce7ffff-7a36-47f7-b2dd-16a2667ed8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:21.243064 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 562/1132] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:11:21.266581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a049eae-4669-4f2a-93da-811a2d1e526b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:21.364784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a049eae-4669-4f2a-93da-811a2d1e526b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:21.397503 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dda877-27dc-4422-9e4e-6677da068716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:21.398309 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dda877-27dc-4422-9e4e-6677da068716 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:21.398595 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dda877-27dc-4422-9e4e-6677da068716 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:21.398874 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dda877-27dc-4422-9e4e-6677da068716 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:21.400033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dda877-27dc-4422-9e4e-6677da068716 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:21.401460 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dda877-27dc-4422-9e4e-6677da068716 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:21.403639 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 571/1133] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:11:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:21.409340 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7ffff-7a36-47f7-b2dd-16a2667ed8f7 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:21.503586 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7ffff-7a36-47f7-b2dd-16a2667ed8f7 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:21.520423 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:21.537748 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03aff9-e2fb-4dae-a4ae-9525b9858e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:21.538435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03aff9-e2fb-4dae-a4ae-9525b9858e03 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:21.545752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03aff9-e2fb-4dae-a4ae-9525b9858e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:21.545752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03aff9-e2fb-4dae-a4ae-9525b9858e03 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:21.545752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03aff9-e2fb-4dae-a4ae-9525b9858e03 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:21.545752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03aff9-e2fb-4dae-a4ae-9525b9858e03 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:21.621699 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 563/1134] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Jul 5 21:11:21 2022] POST /identity/v3/projects => generated 311 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:11:23.678222 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb4542-f81a-4e3e-9c64-549febc15d7e None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:23.678832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb4542-f81a-4e3e-9c64-549febc15d7e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:23.678832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb4542-f81a-4e3e-9c64-549febc15d7e None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:23.680133 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 572/1135] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:11:23.685861 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962f018-41df-44fc-818f-7d0fb4571014 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:23.686308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962f018-41df-44fc-818f-7d0fb4571014 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:23.686423 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962f018-41df-44fc-818f-7d0fb4571014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:23.703649 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-a962f018-41df-44fc-818f-7d0fb4571014 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:23.704830 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a962f018-41df-44fc-818f-7d0fb4571014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:23.771454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 564/1136] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:11:23.795917 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb4542-f81a-4e3e-9c64-549febc15d7e None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:23.817860 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:23.896683 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb4542-f81a-4e3e-9c64-549febc15d7e None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:23.929040 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6f14f-4afd-460f-9dc7-df222fee5a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:23.929817 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6f14f-4afd-460f-9dc7-df222fee5a43 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:23.930101 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6f14f-4afd-460f-9dc7-df222fee5a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:23.930411 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6f14f-4afd-460f-9dc7-df222fee5a43 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:23.931574 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b6f14f-4afd-460f-9dc7-df222fee5a43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:23.933008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b6f14f-4afd-460f-9dc7-df222fee5a43 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:23.935257 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 573/1137] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:11:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:23.940864 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962f018-41df-44fc-818f-7d0fb4571014 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:24.034337 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:24.037084 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962f018-41df-44fc-818f-7d0fb4571014 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:24.070412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca103cb1-3eac-4ff8-866a-e274faf20a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:24.071067 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca103cb1-3eac-4ff8-866a-e274faf20a4d None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:24.071353 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca103cb1-3eac-4ff8-866a-e274faf20a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:24.071628 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca103cb1-3eac-4ff8-866a-e274faf20a4d None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:24.072324 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca103cb1-3eac-4ff8-866a-e274faf20a4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:24.073744 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca103cb1-3eac-4ff8-866a-e274faf20a4d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:24.128188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 565/1138] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 21:11:23 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:11:26.194496 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83e7c6-90a7-484a-ba33-d9c5f1c1f762 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:26.195051 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83e7c6-90a7-484a-ba33-d9c5f1c1f762 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:26.195051 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83e7c6-90a7-484a-ba33-d9c5f1c1f762 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:26.196417 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 574/1139] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:11:26.202244 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b950e4-653d-49c6-9ff2-f4fc8f189656 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:26.202692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b950e4-653d-49c6-9ff2-f4fc8f189656 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:26.202795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b950e4-653d-49c6-9ff2-f4fc8f189656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:26.219156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-43b950e4-653d-49c6-9ff2-f4fc8f189656 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:26.220371 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-43b950e4-653d-49c6-9ff2-f4fc8f189656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:26.284651 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 566/1140] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:11:26.308166 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83e7c6-90a7-484a-ba33-d9c5f1c1f762 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:26.394659 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:26.406706 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83e7c6-90a7-484a-ba33-d9c5f1c1f762 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:26.439492 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40186bde-cfa7-41e6-bb3a-863651de43a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:26.440457 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40186bde-cfa7-41e6-bb3a-863651de43a5 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:26.441073 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40186bde-cfa7-41e6-bb3a-863651de43a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:26.441349 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40186bde-cfa7-41e6-bb3a-863651de43a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:26.451081 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40186bde-cfa7-41e6-bb3a-863651de43a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:11:26.458757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-40186bde-cfa7-41e6-bb3a-863651de43a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:11:26.458757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:26.458757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:26.458757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:26.458757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:26.458757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:26.458757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:26.458757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:26.458757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:26.458757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:26.458757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:26.458757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:26.458757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:11:26.458757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:11:26.458757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:11:26.458757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:11:26.459776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:11:26.459776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:11:26.459776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:11:26.459776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:11:26.459776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:26.459776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:26.459776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:26.459776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:26.459776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:26.459776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:26.459776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:26.459776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:26.459776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:26.459776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:26.459776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:26.459776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:26.460777 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:26.460777 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:26.460777 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:26.460777 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:26.460777 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:11:26.460777 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:11:26.460777 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:11:26.460777 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:11:26.460777 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:11:26.460777 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:11:26.460777 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:11:26.460777 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:11:26.460777 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 575/1141] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:11:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:26.465950 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b950e4-653d-49c6-9ff2-f4fc8f189656 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:26.549410 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:26.564475 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b950e4-653d-49c6-9ff2-f4fc8f189656 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:26.598420 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c51688-8bde-42f7-930e-6b9f2e73dcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:26.610543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c51688-8bde-42f7-930e-6b9f2e73dcc1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:26.610543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c51688-8bde-42f7-930e-6b9f2e73dcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:26.610543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c51688-8bde-42f7-930e-6b9f2e73dcc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:26.610543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c51688-8bde-42f7-930e-6b9f2e73dcc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:26.610543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c51688-8bde-42f7-930e-6b9f2e73dcc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:26.610543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c51688-8bde-42f7-930e-6b9f2e73dcc1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:26.611018 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 567/1142] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:11:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:26.616510 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40186bde-cfa7-41e6-bb3a-863651de43a5 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:26.717593 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40186bde-cfa7-41e6-bb3a-863651de43a5 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:26.749905 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a807cd9-3c7d-414b-871e-051faf75e3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:26.750784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a807cd9-3c7d-414b-871e-051faf75e3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:26.751066 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a807cd9-3c7d-414b-871e-051faf75e3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:26.751340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a807cd9-3c7d-414b-871e-051faf75e3c1 None admin] PATH_INFO: `/v3/users/9b1372fd5346465d81964abcb1c9a6a9` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:26.766233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a807cd9-3c7d-414b-871e-051faf75e3c1 None admin] RBAC: Authorizing `identity:get_user(user_id=9b1372fd5346465d81964abcb1c9a6a9)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:26.767929 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a807cd9-3c7d-414b-871e-051faf75e3c1 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:26.769616 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 576/1143] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:11:26 2022] GET /identity/v3/users/9b1372fd5346465d81964abcb1c9a6a9 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:26.775338 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c51688-8bde-42f7-930e-6b9f2e73dcc1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:26.872235 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c51688-8bde-42f7-930e-6b9f2e73dcc1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:26.904946 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5950015-2e33-4ad9-8972-19f7f5b416ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:26.905580 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5950015-2e33-4ad9-8972-19f7f5b416ef None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:26.905864 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5950015-2e33-4ad9-8972-19f7f5b416ef None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:26.906160 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5950015-2e33-4ad9-8972-19f7f5b416ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:26.923540 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:26.971883 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5950015-2e33-4ad9-8972-19f7f5b416ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:26.973242 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5950015-2e33-4ad9-8972-19f7f5b416ef None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:27.067943 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 568/1144] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:11:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:11:27.073771 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a807cd9-3c7d-414b-871e-051faf75e3c1 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:27.082986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:27.170805 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a807cd9-3c7d-414b-871e-051faf75e3c1 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:27.203653 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd49df8-0812-4609-a8c7-9d9add458a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:27.204497 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd49df8-0812-4609-a8c7-9d9add458a84 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:27.204775 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd49df8-0812-4609-a8c7-9d9add458a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:27.205048 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd49df8-0812-4609-a8c7-9d9add458a84 None admin] PATH_INFO: `/v3/projects/11925492b4934ef3a59ca59611b48959` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:27.206230 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd49df8-0812-4609-a8c7-9d9add458a84 None admin] RBAC: Authorizing `identity:get_project(project_id=11925492b4934ef3a59ca59611b48959)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:27.207646 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd49df8-0812-4609-a8c7-9d9add458a84 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:27.209315 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 577/1145] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:11:27 2022] GET /identity/v3/projects/11925492b4934ef3a59ca59611b48959 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:27.216333 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5950015-2e33-4ad9-8972-19f7f5b416ef None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:27.264371 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:27.313389 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5950015-2e33-4ad9-8972-19f7f5b416ef None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:27.346388 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6fdad-c43f-4f8d-b074-0f85f9edb6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:27.347021 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6fdad-c43f-4f8d-b074-0f85f9edb6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:27.347300 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6fdad-c43f-4f8d-b074-0f85f9edb6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:27.347574 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6fdad-c43f-4f8d-b074-0f85f9edb6d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:27.348390 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6fdad-c43f-4f8d-b074-0f85f9edb6d4 None admin] RBAC: Adding query filter params (role.id=15cf04fec8c6477088a33bf286f1bbdb, scope.project.id=11925492b4934ef3a59ca59611b48959, user.id=9b1372fd5346465d81964abcb1c9a6a9) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:27.348703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6fdad-c43f-4f8d-b074-0f85f9edb6d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:27.350112 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6fdad-c43f-4f8d-b074-0f85f9edb6d4 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:27.355819 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 569/1146] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:11:27 2022] GET /identity/v3/role_assignments?user.id=9b1372fd5346465d81964abcb1c9a6a9&scope.project.id=11925492b4934ef3a59ca59611b48959&role.id=15cf04fec8c6477088a33bf286f1bbdb => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:29.327879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993a674-af26-4efb-a3de-587cef1bc1f8 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:29.328435 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993a674-af26-4efb-a3de-587cef1bc1f8 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:29.328435 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993a674-af26-4efb-a3de-587cef1bc1f8 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:29.329800 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 578/1147] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:11:29.334907 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e5af7-3c6e-420c-bc1d-81aac27b2918 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:29.335309 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e5af7-3c6e-420c-bc1d-81aac27b2918 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:29.335455 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e5af7-3c6e-420c-bc1d-81aac27b2918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:29.351802 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-2f7e5af7-3c6e-420c-bc1d-81aac27b2918 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:29.352962 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2f7e5af7-3c6e-420c-bc1d-81aac27b2918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:29.418555 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 570/1148] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:11:29.441092 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993a674-af26-4efb-a3de-587cef1bc1f8 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:29.514988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:29.539249 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993a674-af26-4efb-a3de-587cef1bc1f8 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:29.572699 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f394f5-967c-4d53-a660-2a9e976270ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:29.573476 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f394f5-967c-4d53-a660-2a9e976270ee None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:29.573758 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f394f5-967c-4d53-a660-2a9e976270ee None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:29.574031 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f394f5-967c-4d53-a660-2a9e976270ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:29.583911 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f394f5-967c-4d53-a660-2a9e976270ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:11:29.591611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-e0f394f5-967c-4d53-a660-2a9e976270ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:11:29.591611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:29.591611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:29.591611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:29.591611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:29.591611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:29.591611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:29.591611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:29.591611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:29.591611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:29.591611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:29.591611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:29.591611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:11:29.591611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:11:29.591611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:11:29.591611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:11:29.592793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:11:29.592793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:11:29.592793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:11:29.592793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:11:29.592793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:29.592793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:29.592793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:29.592793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:29.592793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:29.592793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:29.592793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:29.592793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:29.592793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:29.592793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:29.592793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:29.592793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:29.593881 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:29.593881 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:29.593881 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:29.593881 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:29.593881 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:11:29.593881 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:11:29.593881 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:11:29.593881 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:11:29.593881 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:11:29.593881 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:11:29.593881 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:11:29.593881 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:11:29.597816 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 579/1149] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:11:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:29.598885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e5af7-3c6e-420c-bc1d-81aac27b2918 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:29.641669 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:29.697326 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e5af7-3c6e-420c-bc1d-81aac27b2918 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:29.731370 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fd2cf-daaf-49d0-b5b6-93e070008d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:29.732017 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fd2cf-daaf-49d0-b5b6-93e070008d90 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:29.732306 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fd2cf-daaf-49d0-b5b6-93e070008d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:29.732581 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fd2cf-daaf-49d0-b5b6-93e070008d90 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:29.733315 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fd2cf-daaf-49d0-b5b6-93e070008d90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:29.733619 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fd2cf-daaf-49d0-b5b6-93e070008d90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:29.735009 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fd2cf-daaf-49d0-b5b6-93e070008d90 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:29.742857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 571/1150] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:11:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:29.748693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f394f5-967c-4d53-a660-2a9e976270ee None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:29.851483 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f394f5-967c-4d53-a660-2a9e976270ee None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:29.884104 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b769a8-df30-4a3b-821d-6742960663d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:29.884961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b769a8-df30-4a3b-821d-6742960663d7 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:29.885242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b769a8-df30-4a3b-821d-6742960663d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:29.885515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b769a8-df30-4a3b-821d-6742960663d7 None admin] PATH_INFO: `/v3/users/9b1372fd5346465d81964abcb1c9a6a9` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:29.886711 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b769a8-df30-4a3b-821d-6742960663d7 None admin] RBAC: Authorizing `identity:get_user(user_id=9b1372fd5346465d81964abcb1c9a6a9)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:29.888139 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b769a8-df30-4a3b-821d-6742960663d7 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:29.889740 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 580/1151] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:11:29 2022] GET /identity/v3/users/9b1372fd5346465d81964abcb1c9a6a9 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:29.895755 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fd2cf-daaf-49d0-b5b6-93e070008d90 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:29.992384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fd2cf-daaf-49d0-b5b6-93e070008d90 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:29.994664 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:30.025058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6a8e1-d3fc-4be1-b3a1-d9ffdf8f9f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:30.025913 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6a8e1-d3fc-4be1-b3a1-d9ffdf8f9f9d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:30.026426 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6a8e1-d3fc-4be1-b3a1-d9ffdf8f9f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:30.026917 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6a8e1-d3fc-4be1-b3a1-d9ffdf8f9f9d None admin] PATH_INFO: `/v3/projects/11925492b4934ef3a59ca59611b48959` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:30.029071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6a8e1-d3fc-4be1-b3a1-d9ffdf8f9f9d None admin] RBAC: Authorizing `identity:get_project(project_id=11925492b4934ef3a59ca59611b48959)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:30.030548 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6a8e1-d3fc-4be1-b3a1-d9ffdf8f9f9d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:30.032255 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 572/1152] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:11:29 2022] GET /identity/v3/projects/11925492b4934ef3a59ca59611b48959 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:30.039170 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b769a8-df30-4a3b-821d-6742960663d7 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:30.042003 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:30.136016 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b769a8-df30-4a3b-821d-6742960663d7 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:30.169046 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c70ca4-40c9-49bf-a0c0-9e92bb594130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:30.169913 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c70ca4-40c9-49bf-a0c0-9e92bb594130 None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:30.170225 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c70ca4-40c9-49bf-a0c0-9e92bb594130 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:30.170504 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c70ca4-40c9-49bf-a0c0-9e92bb594130 None admin] PATH_INFO: `/v3/projects/11925492b4934ef3a59ca59611b48959/users/9b1372fd5346465d81964abcb1c9a6a9/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:30.172442 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c70ca4-40c9-49bf-a0c0-9e92bb594130 None admin] RBAC: Authorizing `identity:create_grant(project_id=11925492b4934ef3a59ca59611b48959, user_id=9b1372fd5346465d81964abcb1c9a6a9, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:30.173867 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c70ca4-40c9-49bf-a0c0-9e92bb594130 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:30.254169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 581/1153] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 21:11:30 2022] PUT /identity/v3/projects/11925492b4934ef3a59ca59611b48959/users/9b1372fd5346465d81964abcb1c9a6a9/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:11:32.269047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec6f3c-d96e-488a-bfa5-c4767c31e983 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:32.269655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec6f3c-d96e-488a-bfa5-c4767c31e983 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:32.269655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec6f3c-d96e-488a-bfa5-c4767c31e983 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:32.271001 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 573/1154] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:11:32.276055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ccbe7-8eb2-4401-8fd2-c685892e4b67 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:32.276497 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ccbe7-8eb2-4401-8fd2-c685892e4b67 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:32.276605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ccbe7-8eb2-4401-8fd2-c685892e4b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:32.293066 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-c00ccbe7-8eb2-4401-8fd2-c685892e4b67 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:32.294806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c00ccbe7-8eb2-4401-8fd2-c685892e4b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:32.349454 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:32.360020 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 582/1155] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:11:32.383843 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec6f3c-d96e-488a-bfa5-c4767c31e983 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:32.484152 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec6f3c-d96e-488a-bfa5-c4767c31e983 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:32.516991 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa005849-bfeb-4b73-b1e5-f04c4f12fb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:32.517759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa005849-bfeb-4b73-b1e5-f04c4f12fb4f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:32.518036 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa005849-bfeb-4b73-b1e5-f04c4f12fb4f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:32.518597 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa005849-bfeb-4b73-b1e5-f04c4f12fb4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:32.528299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa005849-bfeb-4b73-b1e5-f04c4f12fb4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:11:32.536098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-aa005849-bfeb-4b73-b1e5-f04c4f12fb4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:11:32.536098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:32.536098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:32.536098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:32.536098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:32.536098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:32.536098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:32.536098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:32.536098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:32.536098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:32.536098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:32.536098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:32.536098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:11:32.536098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:11:32.536098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:11:32.536098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:11:32.537210 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:11:32.537210 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:11:32.537210 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:11:32.537210 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:11:32.537210 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:32.537210 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:32.537210 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:32.537210 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:32.537210 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:32.537210 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:32.537210 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:32.537210 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:32.537210 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:32.537210 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:32.537210 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:32.537210 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:32.538294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:32.538294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:32.538294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:32.538294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:32.538294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:11:32.538294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:11:32.538294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:11:32.538294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:11:32.538294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:11:32.538294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:11:32.538294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:11:32.538294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:11:32.538294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 574/1156] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:11:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:32.543258 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ccbe7-8eb2-4401-8fd2-c685892e4b67 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:32.640829 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ccbe7-8eb2-4401-8fd2-c685892e4b67 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:32.674682 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe39336-fd22-4173-ab1d-2fd5d8b6f1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:32.675462 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe39336-fd22-4173-ab1d-2fd5d8b6f1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:32.675631 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe39336-fd22-4173-ab1d-2fd5d8b6f1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:32.675914 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe39336-fd22-4173-ab1d-2fd5d8b6f1d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:32.676659 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe39336-fd22-4173-ab1d-2fd5d8b6f1d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:32.676972 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe39336-fd22-4173-ab1d-2fd5d8b6f1d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:32.678367 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe39336-fd22-4173-ab1d-2fd5d8b6f1d5 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:32.686264 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 583/1157] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:11:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:32.692054 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa005849-bfeb-4b73-b1e5-f04c4f12fb4f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:32.724013 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:32.792876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa005849-bfeb-4b73-b1e5-f04c4f12fb4f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:32.825761 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d02616-ba96-43b7-8e0c-5cb9fb50ea9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:32.826573 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d02616-ba96-43b7-8e0c-5cb9fb50ea9d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:32.826852 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d02616-ba96-43b7-8e0c-5cb9fb50ea9d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:32.827125 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d02616-ba96-43b7-8e0c-5cb9fb50ea9d None admin] PATH_INFO: `/v3/users/9b1372fd5346465d81964abcb1c9a6a9` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:32.828282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d02616-ba96-43b7-8e0c-5cb9fb50ea9d None admin] RBAC: Authorizing `identity:get_user(user_id=9b1372fd5346465d81964abcb1c9a6a9)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:32.829698 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d02616-ba96-43b7-8e0c-5cb9fb50ea9d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:32.831336 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 575/1158] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:11:32 2022] GET /identity/v3/users/9b1372fd5346465d81964abcb1c9a6a9 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:32.837027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe39336-fd22-4173-ab1d-2fd5d8b6f1d5 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:32.891321 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:32.936913 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe39336-fd22-4173-ab1d-2fd5d8b6f1d5 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:32.970064 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea041a-d52c-4b22-83c2-d941ab90d347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:32.970730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea041a-d52c-4b22-83c2-d941ab90d347 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:32.971019 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea041a-d52c-4b22-83c2-d941ab90d347 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:32.971301 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea041a-d52c-4b22-83c2-d941ab90d347 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:33.035967 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea041a-d52c-4b22-83c2-d941ab90d347 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:33.037405 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea041a-d52c-4b22-83c2-d941ab90d347 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:33.088326 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:33.132544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 584/1159] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:11:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:11:33.138364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d02616-ba96-43b7-8e0c-5cb9fb50ea9d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:33.233413 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:33.236258 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d02616-ba96-43b7-8e0c-5cb9fb50ea9d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:33.269102 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089275f-1044-4a00-a166-4f8896b74700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:33.270053 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089275f-1044-4a00-a166-4f8896b74700 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:33.270659 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089275f-1044-4a00-a166-4f8896b74700 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:33.270932 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089275f-1044-4a00-a166-4f8896b74700 None admin] PATH_INFO: `/v3/projects/11925492b4934ef3a59ca59611b48959` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:33.272087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089275f-1044-4a00-a166-4f8896b74700 None admin] RBAC: Authorizing `identity:get_project(project_id=11925492b4934ef3a59ca59611b48959)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:33.273502 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089275f-1044-4a00-a166-4f8896b74700 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:33.275188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 576/1160] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:11:33 2022] GET /identity/v3/projects/11925492b4934ef3a59ca59611b48959 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:33.281570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea041a-d52c-4b22-83c2-d941ab90d347 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:33.376653 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea041a-d52c-4b22-83c2-d941ab90d347 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:33.409844 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7141e-ecb1-43b2-bf15-d1345b64d547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:33.410504 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7141e-ecb1-43b2-bf15-d1345b64d547 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:33.410785 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7141e-ecb1-43b2-bf15-d1345b64d547 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:33.411055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7141e-ecb1-43b2-bf15-d1345b64d547 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:33.411873 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7141e-ecb1-43b2-bf15-d1345b64d547 None admin] RBAC: Adding query filter params (role.id=15cf04fec8c6477088a33bf286f1bbdb, scope.project.id=11925492b4934ef3a59ca59611b48959, user.id=9b1372fd5346465d81964abcb1c9a6a9) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:33.412179 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7141e-ecb1-43b2-bf15-d1345b64d547 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:33.413585 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7141e-ecb1-43b2-bf15-d1345b64d547 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:33.419311 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 585/1161] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:11:33 2022] GET /identity/v3/role_assignments?user.id=9b1372fd5346465d81964abcb1c9a6a9&scope.project.id=11925492b4934ef3a59ca59611b48959&role.id=15cf04fec8c6477088a33bf286f1bbdb => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:35.443366 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d7935-9959-4a68-9f28-49c010be396a None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:35.443901 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d7935-9959-4a68-9f28-49c010be396a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:35.443901 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d7935-9959-4a68-9f28-49c010be396a None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:35.445269 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 577/1162] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:11:35.450361 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de454b67-e412-4082-a1af-fc5cce6597ff None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:35.450749 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de454b67-e412-4082-a1af-fc5cce6597ff None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:35.450922 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de454b67-e412-4082-a1af-fc5cce6597ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:35.467389 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-de454b67-e412-4082-a1af-fc5cce6597ff None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:35.468715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-de454b67-e412-4082-a1af-fc5cce6597ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:35.481648 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:35.534307 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 586/1163] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:11:35.556495 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d7935-9959-4a68-9f28-49c010be396a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:35.656975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d7935-9959-4a68-9f28-49c010be396a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:35.690208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64094846-a780-40b7-8b39-bc1c8632be7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:35.690841 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64094846-a780-40b7-8b39-bc1c8632be7c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:35.691122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64094846-a780-40b7-8b39-bc1c8632be7c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:35.691399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64094846-a780-40b7-8b39-bc1c8632be7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:35.724969 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:35.756913 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64094846-a780-40b7-8b39-bc1c8632be7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:35.758387 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64094846-a780-40b7-8b39-bc1c8632be7c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:35.853497 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 578/1164] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:11:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:11:35.860007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de454b67-e412-4082-a1af-fc5cce6597ff None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:35.957521 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de454b67-e412-4082-a1af-fc5cce6597ff None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:35.991350 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe3c31-75b9-434e-a155-bf724f6a0a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:35.992074 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe3c31-75b9-434e-a155-bf724f6a0a86 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:35.992358 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe3c31-75b9-434e-a155-bf724f6a0a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:35.992634 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe3c31-75b9-434e-a155-bf724f6a0a86 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:35.999179 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe3c31-75b9-434e-a155-bf724f6a0a86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:36.000612 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe3c31-75b9-434e-a155-bf724f6a0a86 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:36.015061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-0fbe3c31-75b9-434e-a155-bf724f6a0a86 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 05 21:11:36.015061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:36.015061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 05 21:11:36.015061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 05 21:11:36.015061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:11:36.015061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:11:36.015061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:11:36.015061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:11:36.015061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 05 21:11:36.015061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:11:36.015061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:11:36.015061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:11:36.015061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:36.015061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:36.015061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:36.015061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:36.015061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:36.016286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:36.016286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:36.016286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:36.016286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:36.016286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:36.016286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:36.016286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:11:36.016286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:11:36.016286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:11:36.016286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:11:36.016286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:36.016286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:36.016286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:36.016286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:36.016286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:36.016286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:36.017394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:36.017394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:36.017394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:36.017394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:36.017394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:36.017394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:36.017394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:36.017394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:36.017394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:36.017394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:36.017394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 05 21:11:36.017394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:11:36.017394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 05 21:11:36.017394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:11:36.017394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 587/1165] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Jul 5 21:11:35 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:36.022331 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64094846-a780-40b7-8b39-bc1c8632be7c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:36.086917 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:36.118995 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64094846-a780-40b7-8b39-bc1c8632be7c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:36.156242 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07172c25-de91-4941-b1b4-e4eb177bbc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:36.156895 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07172c25-de91-4941-b1b4-e4eb177bbc17 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:36.157176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07172c25-de91-4941-b1b4-e4eb177bbc17 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:36.157457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07172c25-de91-4941-b1b4-e4eb177bbc17 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:36.158227 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07172c25-de91-4941-b1b4-e4eb177bbc17 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:36.158536 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07172c25-de91-4941-b1b4-e4eb177bbc17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:36.159903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07172c25-de91-4941-b1b4-e4eb177bbc17 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:36.166956 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 579/1166] 10.222.0.13 () {56 vars in 1115 bytes} [Tue Jul 5 21:11:36 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:38.152813 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73bbae-0400-4b41-8c70-fee3dbe11e63 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:38.153372 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73bbae-0400-4b41-8c70-fee3dbe11e63 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:38.153372 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73bbae-0400-4b41-8c70-fee3dbe11e63 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:38.154776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 588/1167] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:11:38.160827 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc2ebb-647f-4b09-ab0d-e49c634e746a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:38.161241 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc2ebb-647f-4b09-ab0d-e49c634e746a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:38.161379 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc2ebb-647f-4b09-ab0d-e49c634e746a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:38.178436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-0cbc2ebb-647f-4b09-ab0d-e49c634e746a None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:38.179605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0cbc2ebb-647f-4b09-ab0d-e49c634e746a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:38.244897 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 580/1168] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:11:38.268801 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73bbae-0400-4b41-8c70-fee3dbe11e63 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:38.280079 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:38.368576 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73bbae-0400-4b41-8c70-fee3dbe11e63 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:38.401353 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c66348-160b-49fa-b4ca-36db4b0d63a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:38.401992 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c66348-160b-49fa-b4ca-36db4b0d63a7 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:38.402305 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c66348-160b-49fa-b4ca-36db4b0d63a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:38.402585 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c66348-160b-49fa-b4ca-36db4b0d63a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:38.403374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c66348-160b-49fa-b4ca-36db4b0d63a7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:38.404685 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c66348-160b-49fa-b4ca-36db4b0d63a7 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:38.478722 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 589/1169] 10.222.0.13 () {60 vars in 1138 bytes} [Tue Jul 5 21:11:38 2022] POST /identity/v3/domains => generated 267 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:11:40.514813 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b43109-807e-4c02-8a42-42610df526fb None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:40.515422 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b43109-807e-4c02-8a42-42610df526fb None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:40.515422 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b43109-807e-4c02-8a42-42610df526fb None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:40.516729 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 581/1170] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:11:40.522196 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc9b04-fc95-4239-8322-d4a062b2e7d8 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:40.522602 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc9b04-fc95-4239-8322-d4a062b2e7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:40.522765 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc9b04-fc95-4239-8322-d4a062b2e7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:40.539179 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-eafc9b04-fc95-4239-8322-d4a062b2e7d8 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:40.540367 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-eafc9b04-fc95-4239-8322-d4a062b2e7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:40.601005 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:40.606443 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 590/1171] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:11:40.630996 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b43109-807e-4c02-8a42-42610df526fb None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:40.692632 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:40.730248 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b43109-807e-4c02-8a42-42610df526fb None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:40.763674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30a58f-b721-43bb-97b0-051c36cdf371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:40.764579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30a58f-b721-43bb-97b0-051c36cdf371 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:40.764982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30a58f-b721-43bb-97b0-051c36cdf371 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:40.765230 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30a58f-b721-43bb-97b0-051c36cdf371 None admin] PATH_INFO: `/v3/domains/7bff50932dba497ea8e5ce7ec3169f4d` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:40.775686 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30a58f-b721-43bb-97b0-051c36cdf371 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7bff50932dba497ea8e5ce7ec3169f4d)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:40.777120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30a58f-b721-43bb-97b0-051c36cdf371 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:40.778765 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 582/1172] 10.222.0.13 () {56 vars in 1183 bytes} [Tue Jul 5 21:11:40 2022] GET /identity/v3/domains/7bff50932dba497ea8e5ce7ec3169f4d => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:40.784765 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc9b04-fc95-4239-8322-d4a062b2e7d8 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:40.882091 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc9b04-fc95-4239-8322-d4a062b2e7d8 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:40.915302 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9089f-a678-4e6e-ae9d-856e91238ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:40.915948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9089f-a678-4e6e-ae9d-856e91238ae9 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:40.916232 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9089f-a678-4e6e-ae9d-856e91238ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:40.916508 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9089f-a678-4e6e-ae9d-856e91238ae9 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:40.917209 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e9089f-a678-4e6e-ae9d-856e91238ae9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:40.918667 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e9089f-a678-4e6e-ae9d-856e91238ae9 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:40.995580 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 591/1173] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Jul 5 21:11:40 2022] POST /identity/v3/projects => generated 361 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:11:43.036302 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b653e14-b3c5-4e7c-a143-64e182f4ac39 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:43.036836 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b653e14-b3c5-4e7c-a143-64e182f4ac39 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:43.036836 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b653e14-b3c5-4e7c-a143-64e182f4ac39 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:43.038234 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 583/1174] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:11:43.043365 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea2abc-9298-4998-9dad-2b8b6bcd337d None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:43.043796 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea2abc-9298-4998-9dad-2b8b6bcd337d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:43.043930 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea2abc-9298-4998-9dad-2b8b6bcd337d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:43.060527 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-deea2abc-9298-4998-9dad-2b8b6bcd337d None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:43.062336 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-deea2abc-9298-4998-9dad-2b8b6bcd337d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:43.112415 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:43.132376 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 592/1175] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:11:43.157920 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b653e14-b3c5-4e7c-a143-64e182f4ac39 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:43.257652 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b653e14-b3c5-4e7c-a143-64e182f4ac39 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:43.280224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:43.291273 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7587b-d745-4f7f-baf1-662d0a6fef73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:43.292067 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7587b-d745-4f7f-baf1-662d0a6fef73 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:43.292351 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7587b-d745-4f7f-baf1-662d0a6fef73 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:43.292708 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7587b-d745-4f7f-baf1-662d0a6fef73 None admin] PATH_INFO: `/v3/domains/7bff50932dba497ea8e5ce7ec3169f4d` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:43.293895 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7587b-d745-4f7f-baf1-662d0a6fef73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7bff50932dba497ea8e5ce7ec3169f4d)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:43.295357 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7587b-d745-4f7f-baf1-662d0a6fef73 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:43.296991 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 584/1176] 10.222.0.13 () {56 vars in 1183 bytes} [Tue Jul 5 21:11:43 2022] GET /identity/v3/domains/7bff50932dba497ea8e5ce7ec3169f4d => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:43.302758 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea2abc-9298-4998-9dad-2b8b6bcd337d None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:43.399953 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea2abc-9298-4998-9dad-2b8b6bcd337d None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:43.432465 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b928b0-a29a-4dbc-921c-3acadae41ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:43.433120 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b928b0-a29a-4dbc-921c-3acadae41ae3 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:43.433404 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b928b0-a29a-4dbc-921c-3acadae41ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:43.433683 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b928b0-a29a-4dbc-921c-3acadae41ae3 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:43.434411 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b928b0-a29a-4dbc-921c-3acadae41ae3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:43.435843 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b928b0-a29a-4dbc-921c-3acadae41ae3 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:43.514463 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 593/1177] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 21:11:43 2022] POST /identity/v3/users => generated 311 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:11:45.581586 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e05326-da95-4acb-95aa-ea11201ef16b None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:45.582259 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e05326-da95-4acb-95aa-ea11201ef16b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:45.582259 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e05326-da95-4acb-95aa-ea11201ef16b None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:45.583613 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 585/1178] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:11:45.588828 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d740a-5590-4471-bd2d-30c642ea1fdd None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:45.589244 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d740a-5590-4471-bd2d-30c642ea1fdd None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:45.589387 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d740a-5590-4471-bd2d-30c642ea1fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:45.605786 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-ae8d740a-5590-4471-bd2d-30c642ea1fdd None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:45.607004 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ae8d740a-5590-4471-bd2d-30c642ea1fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:45.635006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:45.674009 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 594/1179] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:11:45.697839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e05326-da95-4acb-95aa-ea11201ef16b None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:45.797686 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e05326-da95-4acb-95aa-ea11201ef16b None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:45.830703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f41de5-cff2-432a-96b1-8c775df49645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:45.831478 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f41de5-cff2-432a-96b1-8c775df49645 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:45.831812 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f41de5-cff2-432a-96b1-8c775df49645 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:45.832042 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f41de5-cff2-432a-96b1-8c775df49645 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:45.841786 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f41de5-cff2-432a-96b1-8c775df49645 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:11:45.849436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-f1f41de5-cff2-432a-96b1-8c775df49645 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:11:45.849436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:45.849436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:45.849436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:45.849436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:45.849436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:45.849436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:45.849436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:45.849436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:45.849436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:45.849436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:45.849436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:45.849436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:11:45.849436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:11:45.849436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:11:45.849436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:11:45.850645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:11:45.850645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:11:45.850645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:11:45.850645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:11:45.850645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:45.850645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:45.850645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:45.850645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:45.850645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:45.850645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:45.850645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:45.850645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:45.850645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:45.850645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:45.850645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:45.850645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:45.851771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:45.851771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:45.851771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:45.851771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:45.851771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:11:45.851771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:11:45.851771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:11:45.851771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:11:45.851771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:11:45.851771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:11:45.851771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:11:45.851771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:11:45.851771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 586/1180] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:11:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:45.856682 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d740a-5590-4471-bd2d-30c642ea1fdd None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:45.953229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d740a-5590-4471-bd2d-30c642ea1fdd None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:45.986582 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50fc32-35b1-4fcb-8fa7-01feaf57f358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:45.987233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50fc32-35b1-4fcb-8fa7-01feaf57f358 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:45.987514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50fc32-35b1-4fcb-8fa7-01feaf57f358 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:45.987793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50fc32-35b1-4fcb-8fa7-01feaf57f358 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:45.988535 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50fc32-35b1-4fcb-8fa7-01feaf57f358 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:45.988840 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50fc32-35b1-4fcb-8fa7-01feaf57f358 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:45.990223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50fc32-35b1-4fcb-8fa7-01feaf57f358 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:45.998035 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 595/1181] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:11:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:46.003657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f41de5-cff2-432a-96b1-8c775df49645 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:46.053489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:46.102324 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f41de5-cff2-432a-96b1-8c775df49645 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:46.135863 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6aa3e-0e19-4ab8-b163-e7985bedbf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:46.136711 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6aa3e-0e19-4ab8-b163-e7985bedbf40 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:46.136992 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6aa3e-0e19-4ab8-b163-e7985bedbf40 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:46.137267 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6aa3e-0e19-4ab8-b163-e7985bedbf40 None admin] PATH_INFO: `/v3/users/50c68d79ecbb4f8e9c22f7a0f8299f18` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:46.150790 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6aa3e-0e19-4ab8-b163-e7985bedbf40 None admin] RBAC: Authorizing `identity:get_user(user_id=50c68d79ecbb4f8e9c22f7a0f8299f18)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:46.152222 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6aa3e-0e19-4ab8-b163-e7985bedbf40 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:46.153836 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 587/1182] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:11:46 2022] GET /identity/v3/users/50c68d79ecbb4f8e9c22f7a0f8299f18 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:46.159579 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50fc32-35b1-4fcb-8fa7-01feaf57f358 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:46.187474 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:46.255592 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50fc32-35b1-4fcb-8fa7-01feaf57f358 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:46.288132 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b2447-342e-426d-bd61-0dc1144206f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:46.288760 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b2447-342e-426d-bd61-0dc1144206f4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:46.289042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b2447-342e-426d-bd61-0dc1144206f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:46.289319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b2447-342e-426d-bd61-0dc1144206f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:46.354171 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b2447-342e-426d-bd61-0dc1144206f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:46.355550 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b2447-342e-426d-bd61-0dc1144206f4 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:46.381907 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:46.453144 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 596/1183] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:11:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:11:46.459016 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6aa3e-0e19-4ab8-b163-e7985bedbf40 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:46.563300 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6aa3e-0e19-4ab8-b163-e7985bedbf40 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:46.572132 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:46.596364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740649ae-9b2c-4278-8c6d-0f1a6248f170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:46.597232 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740649ae-9b2c-4278-8c6d-0f1a6248f170 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:46.597515 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740649ae-9b2c-4278-8c6d-0f1a6248f170 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:46.597792 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740649ae-9b2c-4278-8c6d-0f1a6248f170 None admin] PATH_INFO: `/v3/projects/ff107cc0465141a690cc2949effff170` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:46.599004 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740649ae-9b2c-4278-8c6d-0f1a6248f170 None admin] RBAC: Authorizing `identity:get_project(project_id=ff107cc0465141a690cc2949effff170)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:46.600436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740649ae-9b2c-4278-8c6d-0f1a6248f170 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:46.602141 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 588/1184] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:11:46 2022] GET /identity/v3/projects/ff107cc0465141a690cc2949effff170 => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:46.608906 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b2447-342e-426d-bd61-0dc1144206f4 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:46.707830 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b2447-342e-426d-bd61-0dc1144206f4 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:46.734541 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:46.741953 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7484e2-1fb5-4129-8732-0e97a51c1ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:46.742616 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7484e2-1fb5-4129-8732-0e97a51c1ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:46.751264 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7484e2-1fb5-4129-8732-0e97a51c1ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:46.751264 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7484e2-1fb5-4129-8732-0e97a51c1ff6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:46.751264 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7484e2-1fb5-4129-8732-0e97a51c1ff6 None admin] RBAC: Adding query filter params (role.id=15cf04fec8c6477088a33bf286f1bbdb, scope.project.id=ff107cc0465141a690cc2949effff170, user.id=50c68d79ecbb4f8e9c22f7a0f8299f18) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:46.751264 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7484e2-1fb5-4129-8732-0e97a51c1ff6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:46.751264 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7484e2-1fb5-4129-8732-0e97a51c1ff6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:46.751691 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 597/1185] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:11:46 2022] GET /identity/v3/role_assignments?user.id=50c68d79ecbb4f8e9c22f7a0f8299f18&scope.project.id=ff107cc0465141a690cc2949effff170&role.id=15cf04fec8c6477088a33bf286f1bbdb => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:48.735317 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5fc81-8fc6-42cf-996f-808065f3b3b0 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:48.735863 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5fc81-8fc6-42cf-996f-808065f3b3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:48.735863 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5fc81-8fc6-42cf-996f-808065f3b3b0 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:48.737239 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 589/1186] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:11:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:11:48.742458 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376942a-4774-4246-af32-bfc70c7c27b4 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:48.742852 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376942a-4774-4246-af32-bfc70c7c27b4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:48.743010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376942a-4774-4246-af32-bfc70c7c27b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:48.759919 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-9376942a-4774-4246-af32-bfc70c7c27b4 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:48.761087 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-9376942a-4774-4246-af32-bfc70c7c27b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:48.825580 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 598/1187] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:11:48.847371 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5fc81-8fc6-42cf-996f-808065f3b3b0 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:48.946921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5fc81-8fc6-42cf-996f-808065f3b3b0 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:48.980989 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318e73b-331d-4644-aa3c-fd4925216e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:48.981765 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318e73b-331d-4644-aa3c-fd4925216e32 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:48.982049 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318e73b-331d-4644-aa3c-fd4925216e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:48.982355 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318e73b-331d-4644-aa3c-fd4925216e32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:48.992743 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318e73b-331d-4644-aa3c-fd4925216e32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:11:49.000978 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-0318e73b-331d-4644-aa3c-fd4925216e32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:11:49.000978 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:49.000978 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:49.000978 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:49.000978 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:49.000978 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:49.000978 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:49.000978 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:49.000978 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:49.000978 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:49.000978 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:49.000978 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:49.000978 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:11:49.000978 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:11:49.000978 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:11:49.000978 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:11:49.002095 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:11:49.002095 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:11:49.002095 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:11:49.002095 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:11:49.002095 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:49.002095 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:49.002095 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:49.002095 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:49.002095 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:49.002095 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:49.002095 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:49.002095 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:49.002095 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:49.002095 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:49.002095 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:49.002095 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:49.003070 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:49.003070 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:49.003070 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:49.003070 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:49.003070 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:11:49.003070 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:11:49.003070 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:11:49.003070 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:11:49.003070 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:11:49.003070 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:11:49.003070 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:11:49.003070 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:11:49.003070 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 590/1188] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:11:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:49.008218 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376942a-4774-4246-af32-bfc70c7c27b4 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:49.104782 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376942a-4774-4246-af32-bfc70c7c27b4 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:49.127003 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:49.137965 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb544ee3-d6c9-4c42-be45-b5aedcef8f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:49.146001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb544ee3-d6c9-4c42-be45-b5aedcef8f54 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:49.146001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb544ee3-d6c9-4c42-be45-b5aedcef8f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:49.146001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb544ee3-d6c9-4c42-be45-b5aedcef8f54 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:49.146001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb544ee3-d6c9-4c42-be45-b5aedcef8f54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:49.146001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb544ee3-d6c9-4c42-be45-b5aedcef8f54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:49.146001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb544ee3-d6c9-4c42-be45-b5aedcef8f54 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:49.149853 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 599/1189] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:11:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:49.156401 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318e73b-331d-4644-aa3c-fd4925216e32 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:49.191320 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:49.255054 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318e73b-331d-4644-aa3c-fd4925216e32 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:49.288465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2036de-9b2e-4caf-8da6-e5a7142ed3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:49.289316 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2036de-9b2e-4caf-8da6-e5a7142ed3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:49.289596 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2036de-9b2e-4caf-8da6-e5a7142ed3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:49.289870 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2036de-9b2e-4caf-8da6-e5a7142ed3a3 None admin] PATH_INFO: `/v3/users/50c68d79ecbb4f8e9c22f7a0f8299f18` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:49.291065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2036de-9b2e-4caf-8da6-e5a7142ed3a3 None admin] RBAC: Authorizing `identity:get_user(user_id=50c68d79ecbb4f8e9c22f7a0f8299f18)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:49.292486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2036de-9b2e-4caf-8da6-e5a7142ed3a3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:49.294083 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 591/1190] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:11:49 2022] GET /identity/v3/users/50c68d79ecbb4f8e9c22f7a0f8299f18 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:49.300502 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb544ee3-d6c9-4c42-be45-b5aedcef8f54 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:49.396621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb544ee3-d6c9-4c42-be45-b5aedcef8f54 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:49.429426 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b85e5-329c-4c98-9f31-093f7b52c372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:49.430299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b85e5-329c-4c98-9f31-093f7b52c372 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:49.430585 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b85e5-329c-4c98-9f31-093f7b52c372 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:49.430863 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b85e5-329c-4c98-9f31-093f7b52c372 None admin] PATH_INFO: `/v3/projects/ff107cc0465141a690cc2949effff170` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:49.432019 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b85e5-329c-4c98-9f31-093f7b52c372 None admin] RBAC: Authorizing `identity:get_project(project_id=ff107cc0465141a690cc2949effff170)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:49.433448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b85e5-329c-4c98-9f31-093f7b52c372 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:49.435135 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 600/1191] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:11:49 2022] GET /identity/v3/projects/ff107cc0465141a690cc2949effff170 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:49.441793 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2036de-9b2e-4caf-8da6-e5a7142ed3a3 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:49.539398 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2036de-9b2e-4caf-8da6-e5a7142ed3a3 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:49.541619 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:49.572536 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbc6cf-5cab-4ca0-a76b-420fa9bd4556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:49.573401 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbc6cf-5cab-4ca0-a76b-420fa9bd4556 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:49.573677 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbc6cf-5cab-4ca0-a76b-420fa9bd4556 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:49.573993 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbc6cf-5cab-4ca0-a76b-420fa9bd4556 None admin] PATH_INFO: `/v3/projects/ff107cc0465141a690cc2949effff170/users/50c68d79ecbb4f8e9c22f7a0f8299f18/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:49.576195 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fbc6cf-5cab-4ca0-a76b-420fa9bd4556 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff107cc0465141a690cc2949effff170, user_id=50c68d79ecbb4f8e9c22f7a0f8299f18, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:49.577863 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fbc6cf-5cab-4ca0-a76b-420fa9bd4556 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:49.646948 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 592/1192] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 21:11:49 2022] PUT /identity/v3/projects/ff107cc0465141a690cc2949effff170/users/50c68d79ecbb4f8e9c22f7a0f8299f18/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:11:51.653279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8f119-d2eb-47b5-a1e5-9c081e3e17f1 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:51.653764 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8f119-d2eb-47b5-a1e5-9c081e3e17f1 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:51.653873 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8f119-d2eb-47b5-a1e5-9c081e3e17f1 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:51.655750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 601/1193] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:11:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:11:51.660961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568000aa-fd33-4bd9-9d7e-64e26f786486 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:51.661343 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568000aa-fd33-4bd9-9d7e-64e26f786486 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:51.661509 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568000aa-fd33-4bd9-9d7e-64e26f786486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:51.678360 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-568000aa-fd33-4bd9-9d7e-64e26f786486 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:51.679623 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-568000aa-fd33-4bd9-9d7e-64e26f786486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:51.748812 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 593/1194] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:11:51.773634 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8f119-d2eb-47b5-a1e5-9c081e3e17f1 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:51.826235 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:51.872338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8f119-d2eb-47b5-a1e5-9c081e3e17f1 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:51.904301 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb12432-db5c-43c6-915c-fb7f7450816e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:51.905069 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb12432-db5c-43c6-915c-fb7f7450816e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:51.905884 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb12432-db5c-43c6-915c-fb7f7450816e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:51.906211 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb12432-db5c-43c6-915c-fb7f7450816e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:51.916014 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb12432-db5c-43c6-915c-fb7f7450816e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:11:51.923730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-aeb12432-db5c-43c6-915c-fb7f7450816e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:11:51.923730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:51.923730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:51.923730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:51.923730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:51.923730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:51.923730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:51.923730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:51.923730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:51.923730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:51.923730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:51.923730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:51.923730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:11:51.923730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:11:51.923730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:11:51.923730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:11:51.924848 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:11:51.924848 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:11:51.924848 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:11:51.924848 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:11:51.924848 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:51.924848 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:51.924848 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:51.924848 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:51.924848 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:51.924848 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:51.924848 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:51.924848 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:51.924848 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:51.924848 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:51.924848 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:51.924848 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:51.926002 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:51.926002 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:51.926002 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:51.926002 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:51.926002 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:11:51.926002 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:11:51.926002 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:11:51.926002 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:11:51.926002 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:11:51.926002 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:11:51.926002 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:11:51.926002 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:11:51.926002 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 602/1195] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:11:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:51.930835 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568000aa-fd33-4bd9-9d7e-64e26f786486 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:52.020286 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:52.026717 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568000aa-fd33-4bd9-9d7e-64e26f786486 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:52.060444 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381df05-b72d-4a43-a603-8136cbc7281f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:52.061093 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381df05-b72d-4a43-a603-8136cbc7281f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:52.061376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381df05-b72d-4a43-a603-8136cbc7281f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:52.062213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381df05-b72d-4a43-a603-8136cbc7281f None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:52.063080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5381df05-b72d-4a43-a603-8136cbc7281f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:52.063382 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5381df05-b72d-4a43-a603-8136cbc7281f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:52.064747 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5381df05-b72d-4a43-a603-8136cbc7281f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:52.072568 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 594/1196] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:11:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:52.078951 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb12432-db5c-43c6-915c-fb7f7450816e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:52.175513 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb12432-db5c-43c6-915c-fb7f7450816e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:52.188100 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:52.208799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de474556-5efe-453a-b281-e39df35ae05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:52.209654 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de474556-5efe-453a-b281-e39df35ae05d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:52.209938 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de474556-5efe-453a-b281-e39df35ae05d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:52.210251 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de474556-5efe-453a-b281-e39df35ae05d None admin] PATH_INFO: `/v3/users/50c68d79ecbb4f8e9c22f7a0f8299f18` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:52.211420 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de474556-5efe-453a-b281-e39df35ae05d None admin] RBAC: Authorizing `identity:get_user(user_id=50c68d79ecbb4f8e9c22f7a0f8299f18)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:52.212844 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de474556-5efe-453a-b281-e39df35ae05d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:52.214485 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 603/1197] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 21:11:52 2022] GET /identity/v3/users/50c68d79ecbb4f8e9c22f7a0f8299f18 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:11:52.220112 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381df05-b72d-4a43-a603-8136cbc7281f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:52.318027 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381df05-b72d-4a43-a603-8136cbc7281f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:52.351179 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cf3a9-8c83-4c8b-a6ea-175ef3d005aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:52.351823 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cf3a9-8c83-4c8b-a6ea-175ef3d005aa None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:52.352138 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cf3a9-8c83-4c8b-a6ea-175ef3d005aa None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:52.352418 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cf3a9-8c83-4c8b-a6ea-175ef3d005aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:52.377163 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:52.419917 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192cf3a9-8c83-4c8b-a6ea-175ef3d005aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:52.421870 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192cf3a9-8c83-4c8b-a6ea-175ef3d005aa None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:52.519004 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 595/1198] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:11:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:11:52.525080 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de474556-5efe-453a-b281-e39df35ae05d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:52.621031 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de474556-5efe-453a-b281-e39df35ae05d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:52.653487 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a7318-b7e4-4d1c-9037-160cfb6a88cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:52.654360 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a7318-b7e4-4d1c-9037-160cfb6a88cb None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:52.654642 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a7318-b7e4-4d1c-9037-160cfb6a88cb None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:52.654914 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a7318-b7e4-4d1c-9037-160cfb6a88cb None admin] PATH_INFO: `/v3/projects/ff107cc0465141a690cc2949effff170` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:52.656216 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a7318-b7e4-4d1c-9037-160cfb6a88cb None admin] RBAC: Authorizing `identity:get_project(project_id=ff107cc0465141a690cc2949effff170)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:52.657623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a7318-b7e4-4d1c-9037-160cfb6a88cb None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:52.659334 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 604/1199] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 21:11:52 2022] GET /identity/v3/projects/ff107cc0465141a690cc2949effff170 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:52.665326 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cf3a9-8c83-4c8b-a6ea-175ef3d005aa None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:52.720698 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:52.765688 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cf3a9-8c83-4c8b-a6ea-175ef3d005aa None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:52.800606 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0f746-b6cd-4416-8904-96844207c8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:52.801188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0f746-b6cd-4416-8904-96844207c8dc None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:52.801472 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0f746-b6cd-4416-8904-96844207c8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:52.801751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0f746-b6cd-4416-8904-96844207c8dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:52.802610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0f746-b6cd-4416-8904-96844207c8dc None admin] RBAC: Adding query filter params (role.id=15cf04fec8c6477088a33bf286f1bbdb, scope.project.id=ff107cc0465141a690cc2949effff170, user.id=50c68d79ecbb4f8e9c22f7a0f8299f18) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:52.803037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0f746-b6cd-4416-8904-96844207c8dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:52.804467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0f746-b6cd-4416-8904-96844207c8dc None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:52.810330 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 596/1200] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:11:52 2022] GET /identity/v3/role_assignments?user.id=50c68d79ecbb4f8e9c22f7a0f8299f18&scope.project.id=ff107cc0465141a690cc2949effff170&role.id=15cf04fec8c6477088a33bf286f1bbdb => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:12:02.649462 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=76 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:12:02.807604 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=40 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:04.448945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1faed2-797d-4b38-94d3-0b88ebc5a1b8 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:04.449607 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1faed2-797d-4b38-94d3-0b88ebc5a1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:04.449607 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1faed2-797d-4b38-94d3-0b88ebc5a1b8 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:04.450911 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 605/1201] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:13:04.455941 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb50141-47f9-49a8-a403-521acab30369 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:04.456394 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb50141-47f9-49a8-a403-521acab30369 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:04.456638 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb50141-47f9-49a8-a403-521acab30369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:04.473254 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-1fb50141-47f9-49a8-a403-521acab30369 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:13:04.474461 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1fb50141-47f9-49a8-a403-521acab30369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:13:04.540897 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 597/1202] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:13:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:13:04.565346 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1faed2-797d-4b38-94d3-0b88ebc5a1b8 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:04.668107 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1faed2-797d-4b38-94d3-0b88ebc5a1b8 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:04.701384 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfc6b8-6ce5-4f08-8e1c-480d56ef5cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:04.702226 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfc6b8-6ce5-4f08-8e1c-480d56ef5cdc None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:04.702495 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfc6b8-6ce5-4f08-8e1c-480d56ef5cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:04.702770 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfc6b8-6ce5-4f08-8e1c-480d56ef5cdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:04.718447 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dfc6b8-6ce5-4f08-8e1c-480d56ef5cdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:04.719890 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dfc6b8-6ce5-4f08-8e1c-480d56ef5cdc None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:04.745226 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-40dfc6b8-6ce5-4f08-8e1c-480d56ef5cdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:13:04.745226 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:04.745226 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:04.745226 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:04.745226 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:04.745226 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:04.745226 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:04.745226 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:04.745226 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:04.745226 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:04.745226 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:04.745226 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:04.745226 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:13:04.745226 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:13:04.745226 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:13:04.746491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:13:04.746491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:04.746491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:04.746491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:04.746491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:04.746491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:04.746491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:04.746491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:04.746491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:04.746491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:04.746491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:04.746491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:04.746491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:04.746491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:04.746491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:04.746491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:04.746491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:04.747880 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:13:04.747880 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:13:04.747880 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:13:04.747880 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:13:04.753685 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 606/1203] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:13:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:04.760014 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb50141-47f9-49a8-a403-521acab30369 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:04.860123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb50141-47f9-49a8-a403-521acab30369 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:04.890185 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:04.896441 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08416d-fef0-43ee-9a96-f5bd9d6087a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:04.897105 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08416d-fef0-43ee-9a96-f5bd9d6087a0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:04.897390 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08416d-fef0-43ee-9a96-f5bd9d6087a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:04.897669 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08416d-fef0-43ee-9a96-f5bd9d6087a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:04.898421 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08416d-fef0-43ee-9a96-f5bd9d6087a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:04.898729 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08416d-fef0-43ee-9a96-f5bd9d6087a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:04.900102 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08416d-fef0-43ee-9a96-f5bd9d6087a0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:04.911819 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 598/1204] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:04.917810 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfc6b8-6ce5-4f08-8e1c-480d56ef5cdc None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:04.973944 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:05.026877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfc6b8-6ce5-4f08-8e1c-480d56ef5cdc None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:05.064567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ae9ae-ddbb-45d2-bc59-cbacaacb0778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:05.065479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ae9ae-ddbb-45d2-bc59-cbacaacb0778 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:05.066023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ae9ae-ddbb-45d2-bc59-cbacaacb0778 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:05.066417 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ae9ae-ddbb-45d2-bc59-cbacaacb0778 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:05.067138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ae9ae-ddbb-45d2-bc59-cbacaacb0778 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:05.068637 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ae9ae-ddbb-45d2-bc59-cbacaacb0778 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:05.166743 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 607/1205] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 21:13:04 2022] POST /identity/v3/users => generated 251 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:13:07.243615 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffde70a-e5fb-4484-b150-23b04989b0c9 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:07.244174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffde70a-e5fb-4484-b150-23b04989b0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:07.244174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffde70a-e5fb-4484-b150-23b04989b0c9 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:07.245590 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 599/1206] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:13:07.250736 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cfe32-0694-4d08-99fe-7dfd91ac87d8 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:07.251125 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cfe32-0694-4d08-99fe-7dfd91ac87d8 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:07.251304 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cfe32-0694-4d08-99fe-7dfd91ac87d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:07.268277 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-185cfe32-0694-4d08-99fe-7dfd91ac87d8 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:13:07.274732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-185cfe32-0694-4d08-99fe-7dfd91ac87d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:13:07.334765 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 608/1207] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:13:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:13:07.357985 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffde70a-e5fb-4484-b150-23b04989b0c9 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:07.460330 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffde70a-e5fb-4484-b150-23b04989b0c9 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:07.493484 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2220d6-f59e-4ec7-b096-f8141c76bbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:07.494344 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2220d6-f59e-4ec7-b096-f8141c76bbe0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:07.494572 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2220d6-f59e-4ec7-b096-f8141c76bbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:07.494845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2220d6-f59e-4ec7-b096-f8141c76bbe0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:07.506469 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2220d6-f59e-4ec7-b096-f8141c76bbe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:13:07.514342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-5f2220d6-f59e-4ec7-b096-f8141c76bbe0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:13:07.514342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:07.514342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:07.514342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:07.514342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:07.514342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:07.514342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:07.514342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:07.514342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:07.514342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:07.514342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:07.514342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:07.514342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:13:07.514342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:13:07.514342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:13:07.514342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:13:07.520966 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:13:07.520966 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:13:07.520966 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:13:07.520966 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:13:07.520966 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:07.520966 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:07.520966 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:07.520966 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:07.520966 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:07.520966 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:07.520966 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:07.520966 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:07.520966 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:07.520966 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:07.520966 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:07.520966 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:07.522047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:07.522047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:07.522047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:07.522047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:07.522047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:13:07.522047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:13:07.522047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:13:07.522047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:13:07.522047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:13:07.522047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:13:07.522047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:13:07.522047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:13:07.522047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 600/1208] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 21:13:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:07.522987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cfe32-0694-4d08-99fe-7dfd91ac87d8 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:07.559941 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:07.619001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cfe32-0694-4d08-99fe-7dfd91ac87d8 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:07.651542 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e197b-825c-48eb-821c-bab50a8657f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:07.652197 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e197b-825c-48eb-821c-bab50a8657f5 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:07.652478 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e197b-825c-48eb-821c-bab50a8657f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:07.652752 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e197b-825c-48eb-821c-bab50a8657f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:07.653483 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e197b-825c-48eb-821c-bab50a8657f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:07.653785 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e197b-825c-48eb-821c-bab50a8657f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:07.655179 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e197b-825c-48eb-821c-bab50a8657f5 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:07.663604 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 609/1209] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 21:13:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:13:07.669293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2220d6-f59e-4ec7-b096-f8141c76bbe0 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:07.719402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:07.774137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2220d6-f59e-4ec7-b096-f8141c76bbe0 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:07.807810 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509f96d-de66-49b4-8730-536874493be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:07.811827 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509f96d-de66-49b4-8730-536874493be3 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:07.811827 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509f96d-de66-49b4-8730-536874493be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:07.811827 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509f96d-de66-49b4-8730-536874493be3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:07.820307 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509f96d-de66-49b4-8730-536874493be3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:07.822494 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509f96d-de66-49b4-8730-536874493be3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:07.841489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-0509f96d-de66-49b4-8730-536874493be3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:13:07.841489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:07.841489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:07.841489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:07.841489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:07.841489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:07.841489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:07.841489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:07.841489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:07.841489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:07.841489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:07.841489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:07.841489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:13:07.841489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:13:07.841489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:13:07.842877 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:13:07.842877 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:07.842877 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:07.842877 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:07.842877 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:07.842877 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:07.842877 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:07.842877 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:07.842877 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:07.842877 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:07.842877 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:07.842877 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:07.842877 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:07.842877 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:07.842877 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:07.842877 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:07.842877 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:07.843853 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:13:07.843853 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:13:07.843853 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:13:07.843853 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:13:07.843853 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 601/1210] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:13:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:07.849176 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e197b-825c-48eb-821c-bab50a8657f5 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:07.945993 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:07.948927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e197b-825c-48eb-821c-bab50a8657f5 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:07.981155 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f74071-39e9-4def-8905-efa905b4a96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:07.981809 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f74071-39e9-4def-8905-efa905b4a96c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:07.982096 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f74071-39e9-4def-8905-efa905b4a96c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:07.982401 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f74071-39e9-4def-8905-efa905b4a96c None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:07.983115 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f74071-39e9-4def-8905-efa905b4a96c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:07.983419 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f74071-39e9-4def-8905-efa905b4a96c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:07.984787 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f74071-39e9-4def-8905-efa905b4a96c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:07.996928 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 610/1211] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:08.002793 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509f96d-de66-49b4-8730-536874493be3 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:08.103056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509f96d-de66-49b4-8730-536874493be3 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:08.104486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:08.136050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd281629-faf5-4bc4-ba58-fbf528a93a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:08.136849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd281629-faf5-4bc4-ba58-fbf528a93a73 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:08.137133 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd281629-faf5-4bc4-ba58-fbf528a93a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:08.137410 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd281629-faf5-4bc4-ba58-fbf528a93a73 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:08.145856 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd281629-faf5-4bc4-ba58-fbf528a93a73 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:08.147329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd281629-faf5-4bc4-ba58-fbf528a93a73 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:08.161956 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-dd281629-faf5-4bc4-ba58-fbf528a93a73 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:13:08.161956 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:08.161956 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:08.161956 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:08.161956 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:08.161956 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:08.161956 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:08.161956 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:08.161956 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:08.161956 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:08.161956 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:08.161956 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:08.161956 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:13:08.161956 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:13:08.161956 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:13:08.161956 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:13:08.163122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:08.163122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:08.163122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:13:08.163122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:13:08.163122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:13:08.163122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:13:08.163122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:08.163122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:08.163122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:08.163122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:08.163122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:08.163122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:08.163122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:08.163122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:08.163122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:08.163122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:08.163122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:08.163122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:08.164499 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:08.164499 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:08.164499 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:13:08.164499 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:13:08.164499 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:13:08.164499 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:13:08.164499 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:13:08.164499 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:13:08.164499 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:13:08.164499 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:13:08.164499 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 602/1212] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:13:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:08.168986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f74071-39e9-4def-8905-efa905b4a96c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:08.268067 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f74071-39e9-4def-8905-efa905b4a96c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:08.302825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b972b06-4d14-4253-8c68-093a4a283296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:08.303483 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b972b06-4d14-4253-8c68-093a4a283296 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:08.303770 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b972b06-4d14-4253-8c68-093a4a283296 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:08.304040 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b972b06-4d14-4253-8c68-093a4a283296 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:08.304862 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b972b06-4d14-4253-8c68-093a4a283296 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:08.305168 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b972b06-4d14-4253-8c68-093a4a283296 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:08.306623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b972b06-4d14-4253-8c68-093a4a283296 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:08.323736 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 611/1213] 10.222.0.13 () {56 vars in 1143 bytes} [Tue Jul 5 21:13:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:08.329553 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd281629-faf5-4bc4-ba58-fbf528a93a73 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:08.428263 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd281629-faf5-4bc4-ba58-fbf528a93a73 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:08.461911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c589746-0025-47ac-a070-cacde26b280b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:08.462575 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c589746-0025-47ac-a070-cacde26b280b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:08.462858 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c589746-0025-47ac-a070-cacde26b280b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:08.463131 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c589746-0025-47ac-a070-cacde26b280b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:08.491975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:08.529787 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c589746-0025-47ac-a070-cacde26b280b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:08.531254 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c589746-0025-47ac-a070-cacde26b280b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:08.628548 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 603/1214] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:13:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:13:08.634528 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b972b06-4d14-4253-8c68-093a4a283296 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:08.654223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:08.732002 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b972b06-4d14-4253-8c68-093a4a283296 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:08.766454 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70f228-b867-4d8a-8e50-5379ce81b5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:08.767237 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70f228-b867-4d8a-8e50-5379ce81b5be None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:08.767519 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70f228-b867-4d8a-8e50-5379ce81b5be None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:08.767796 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70f228-b867-4d8a-8e50-5379ce81b5be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:08.778431 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70f228-b867-4d8a-8e50-5379ce81b5be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:08.779984 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70f228-b867-4d8a-8e50-5379ce81b5be None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:08.800800 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-0b70f228-b867-4d8a-8e50-5379ce81b5be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:13:08.800800 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:08.800800 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:08.800800 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:08.800800 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:08.800800 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:08.800800 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:08.800800 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:08.800800 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:08.800800 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:08.800800 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:08.800800 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:08.800800 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:13:08.800800 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:13:08.800800 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:13:08.805108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:13:08.805108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:08.805108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:08.805108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:08.805108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:08.805108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:08.805108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:08.805108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:08.805108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:08.805108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:08.805108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:08.805108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:08.805108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:08.805108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:08.805108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:08.805108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:08.805108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:08.806269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:13:08.806269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:13:08.806269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:13:08.806269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:13:08.806269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 612/1215] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:13:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:13:08.808179 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c589746-0025-47ac-a070-cacde26b280b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:08.870399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:08.908611 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c589746-0025-47ac-a070-cacde26b280b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:08.942747 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de89b10-8ecd-4217-b40a-d6fe03f8fafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:08.943403 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de89b10-8ecd-4217-b40a-d6fe03f8fafb None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:08.943686 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de89b10-8ecd-4217-b40a-d6fe03f8fafb None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:08.943963 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de89b10-8ecd-4217-b40a-d6fe03f8fafb None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:08.944684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de89b10-8ecd-4217-b40a-d6fe03f8fafb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:08.944993 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de89b10-8ecd-4217-b40a-d6fe03f8fafb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:08.946386 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de89b10-8ecd-4217-b40a-d6fe03f8fafb None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:08.958509 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 604/1216] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:08.964191 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70f228-b867-4d8a-8e50-5379ce81b5be None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:09.037452 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:09.069003 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70f228-b867-4d8a-8e50-5379ce81b5be None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:09.103515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b61877-7b7c-4cf4-b4c5-6f8bb6f5b001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:09.104344 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b61877-7b7c-4cf4-b4c5-6f8bb6f5b001 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:09.104671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b61877-7b7c-4cf4-b4c5-6f8bb6f5b001 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:09.104945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b61877-7b7c-4cf4-b4c5-6f8bb6f5b001 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:09.111519 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b61877-7b7c-4cf4-b4c5-6f8bb6f5b001 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:09.113970 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b61877-7b7c-4cf4-b4c5-6f8bb6f5b001 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:09.127687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-80b61877-7b7c-4cf4-b4c5-6f8bb6f5b001 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:13:09.127687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:09.127687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:09.127687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:09.127687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:09.127687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:09.127687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:09.127687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:09.127687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:09.127687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:09.127687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:09.127687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:09.127687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:13:09.127687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:13:09.127687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:13:09.129636 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:13:09.129636 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:09.129636 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:09.129636 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:09.129636 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:09.129636 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:09.129636 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:09.129636 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:09.129636 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:09.129636 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:09.129636 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:09.129636 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:09.129636 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:09.129636 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:09.129636 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:09.129636 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:09.129636 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:09.135616 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:13:09.135616 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:13:09.135616 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:13:09.135616 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:13:09.135616 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:13:09.135616 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:13:09.135616 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:13:09.135616 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:13:09.135616 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 613/1217] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:13:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:09.136261 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de89b10-8ecd-4217-b40a-d6fe03f8fafb None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:09.234380 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de89b10-8ecd-4217-b40a-d6fe03f8fafb None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:09.257103 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:09.268276 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3560be-82fc-4aa3-970f-230632ed56a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:09.268995 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3560be-82fc-4aa3-970f-230632ed56a4 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:09.269281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3560be-82fc-4aa3-970f-230632ed56a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:09.269559 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3560be-82fc-4aa3-970f-230632ed56a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:09.270381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3560be-82fc-4aa3-970f-230632ed56a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:09.270952 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3560be-82fc-4aa3-970f-230632ed56a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:09.272439 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3560be-82fc-4aa3-970f-230632ed56a4 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:09.284057 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 605/1218] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:13:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:09.290871 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b61877-7b7c-4cf4-b4c5-6f8bb6f5b001 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:09.390067 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b61877-7b7c-4cf4-b4c5-6f8bb6f5b001 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:09.418191 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:09.423864 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f33687-c747-4296-a2d1-15ae484cdc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:09.424556 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f33687-c747-4296-a2d1-15ae484cdc79 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:09.425525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f33687-c747-4296-a2d1-15ae484cdc79 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:09.425815 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f33687-c747-4296-a2d1-15ae484cdc79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:09.426680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f33687-c747-4296-a2d1-15ae484cdc79 None admin] RBAC: Adding query filter params (role.id=c641ed689379413190e5e4ff94eb90ba, scope.project.id=1076c94b43b2483eb4fc06173f9204c3, user.id=992db9dab5944769b192a868d6637a02) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:09.426990 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f33687-c747-4296-a2d1-15ae484cdc79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:09.428411 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f33687-c747-4296-a2d1-15ae484cdc79 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:09.433799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 614/1219] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:13:09 2022] GET /identity/v3/role_assignments?user.id=992db9dab5944769b192a868d6637a02&scope.project.id=1076c94b43b2483eb4fc06173f9204c3&role.id=c641ed689379413190e5e4ff94eb90ba => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:11.456992 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029375fa-3b6c-4ad3-825a-67d8c917b7e8 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:11.457521 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029375fa-3b6c-4ad3-825a-67d8c917b7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:11.457636 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029375fa-3b6c-4ad3-825a-67d8c917b7e8 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:11.458988 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 606/1220] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:13:11.464219 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc5666-d8e7-47a5-a92a-4879bb608a20 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:11.464619 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc5666-d8e7-47a5-a92a-4879bb608a20 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:11.464812 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc5666-d8e7-47a5-a92a-4879bb608a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:11.482051 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-5dcc5666-d8e7-47a5-a92a-4879bb608a20 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:13:11.483287 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5dcc5666-d8e7-47a5-a92a-4879bb608a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:13:11.550867 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 615/1221] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:13:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:13:11.572954 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029375fa-3b6c-4ad3-825a-67d8c917b7e8 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:11.674599 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029375fa-3b6c-4ad3-825a-67d8c917b7e8 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:11.707611 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260e5b6-ec9e-4cf2-90cf-a0e75fe63b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:11.708339 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260e5b6-ec9e-4cf2-90cf-a0e75fe63b73 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:11.708621 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260e5b6-ec9e-4cf2-90cf-a0e75fe63b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:11.708897 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260e5b6-ec9e-4cf2-90cf-a0e75fe63b73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:11.720034 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260e5b6-ec9e-4cf2-90cf-a0e75fe63b73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:13:11.728308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-7260e5b6-ec9e-4cf2-90cf-a0e75fe63b73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:13:11.728308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:11.728308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:11.728308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:11.728308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:11.728308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:11.728308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:11.728308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:11.728308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:11.728308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:11.728308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:11.728308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:11.728308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:13:11.728308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:13:11.728308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:13:11.728308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:13:11.729435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:13:11.729435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:13:11.729435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:13:11.729435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:13:11.729435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:11.729435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:11.729435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:11.729435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:11.729435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:11.729435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:11.729435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:11.729435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:11.729435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:11.729435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:11.729435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:11.729435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:11.735287 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:11.735287 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:11.735287 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:11.735287 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:11.735287 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:13:11.735287 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:13:11.735287 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:13:11.735287 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:13:11.735287 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:13:11.735287 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:13:11.735287 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:13:11.735287 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:13:11.735287 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 607/1222] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 21:13:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:11.736181 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc5666-d8e7-47a5-a92a-4879bb608a20 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:11.832231 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc5666-d8e7-47a5-a92a-4879bb608a20 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:11.855087 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:11.865378 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a04199-cc59-44d7-ab69-4367f723d9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:11.866028 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a04199-cc59-44d7-ab69-4367f723d9fe None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:11.866339 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a04199-cc59-44d7-ab69-4367f723d9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:11.866614 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a04199-cc59-44d7-ab69-4367f723d9fe None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:11.867349 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a04199-cc59-44d7-ab69-4367f723d9fe None admin] RBAC: Adding query filter params (name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:11.867650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a04199-cc59-44d7-ab69-4367f723d9fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:11.869006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a04199-cc59-44d7-ab69-4367f723d9fe None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:11.876786 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 616/1223] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 21:13:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:11.882613 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260e5b6-ec9e-4cf2-90cf-a0e75fe63b73 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:11.926754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:11.981274 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260e5b6-ec9e-4cf2-90cf-a0e75fe63b73 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:12.016188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de945b-89d6-4736-a901-20983038d308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:12.016974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de945b-89d6-4736-a901-20983038d308 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:12.017259 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de945b-89d6-4736-a901-20983038d308 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:12.017537 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de945b-89d6-4736-a901-20983038d308 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:12.028008 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de945b-89d6-4736-a901-20983038d308 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:12.029449 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de945b-89d6-4736-a901-20983038d308 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:12.046965 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-58de945b-89d6-4736-a901-20983038d308 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:13:12.046965 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:12.046965 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:12.046965 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:12.046965 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:12.046965 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:12.046965 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:12.046965 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:12.046965 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:12.046965 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:12.046965 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:12.046965 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:12.046965 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:13:12.046965 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:13:12.046965 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:13:12.048053 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:13:12.048053 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:12.048053 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:12.048053 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:12.048053 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:12.048053 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:12.048053 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:12.048053 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:12.048053 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:12.048053 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:12.048053 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:12.048053 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:12.048053 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:12.048053 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:12.048053 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:12.048053 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:12.048053 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:12.049079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:13:12.049079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:13:12.049079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:13:12.049079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:13:12.049079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 608/1224] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:12.054535 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a04199-cc59-44d7-ab69-4367f723d9fe None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:12.152886 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a04199-cc59-44d7-ab69-4367f723d9fe None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:12.185930 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2806ab-d08d-43fb-b52f-5181b59777c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:12.186579 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2806ab-d08d-43fb-b52f-5181b59777c4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:12.186856 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2806ab-d08d-43fb-b52f-5181b59777c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:12.187128 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2806ab-d08d-43fb-b52f-5181b59777c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:12.187839 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2806ab-d08d-43fb-b52f-5181b59777c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:12.188139 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2806ab-d08d-43fb-b52f-5181b59777c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:12.189506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2806ab-d08d-43fb-b52f-5181b59777c4 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:12.201354 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 617/1225] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:12.207252 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de945b-89d6-4736-a901-20983038d308 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:12.300374 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:12.306924 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de945b-89d6-4736-a901-20983038d308 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:12.339510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b187ea-27c2-477c-8b4b-f0a18bb76b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:12.340302 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b187ea-27c2-477c-8b4b-f0a18bb76b2a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:12.340587 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b187ea-27c2-477c-8b4b-f0a18bb76b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:12.340862 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b187ea-27c2-477c-8b4b-f0a18bb76b2a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:12.348786 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b187ea-27c2-477c-8b4b-f0a18bb76b2a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:12.350244 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b187ea-27c2-477c-8b4b-f0a18bb76b2a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:12.365246 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-43b187ea-27c2-477c-8b4b-f0a18bb76b2a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:13:12.365246 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:12.365246 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:12.365246 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:12.365246 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:12.365246 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:12.365246 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:12.365246 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:12.365246 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:12.365246 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:12.365246 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:12.365246 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:12.365246 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:13:12.365246 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:13:12.365246 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:13:12.365246 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:13:12.366399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:12.366399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:12.366399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:13:12.366399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:13:12.366399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:13:12.366399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:13:12.366399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:12.366399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:12.366399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:12.366399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:12.366399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:12.366399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:12.366399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:12.366399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:12.366399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:12.366399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:12.366399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:12.366399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:12.367771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:12.367771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:12.367771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:13:12.367771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:13:12.367771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:13:12.367771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:13:12.367771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:13:12.367771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:13:12.367771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:13:12.367771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:13:12.367771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 609/1226] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:13:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:13:12.372649 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2806ab-d08d-43fb-b52f-5181b59777c4 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:12.419092 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:12.470171 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2806ab-d08d-43fb-b52f-5181b59777c4 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:12.504784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029d2f9-d6d3-4b12-909b-dffa03d19219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:12.505448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029d2f9-d6d3-4b12-909b-dffa03d19219 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:12.505730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029d2f9-d6d3-4b12-909b-dffa03d19219 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:12.506006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029d2f9-d6d3-4b12-909b-dffa03d19219 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:12.506890 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029d2f9-d6d3-4b12-909b-dffa03d19219 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:12.507300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029d2f9-d6d3-4b12-909b-dffa03d19219 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:12.508722 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029d2f9-d6d3-4b12-909b-dffa03d19219 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:12.527084 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 618/1227] 10.222.0.13 () {56 vars in 1143 bytes} [Tue Jul 5 21:13:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:13:12.532804 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b187ea-27c2-477c-8b4b-f0a18bb76b2a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:12.632771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b187ea-27c2-477c-8b4b-f0a18bb76b2a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:12.667629 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f8d0d-43d8-42b1-bbd0-c46c74bc01e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:12.668412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f8d0d-43d8-42b1-bbd0-c46c74bc01e8 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:12.668693 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f8d0d-43d8-42b1-bbd0-c46c74bc01e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:12.668967 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f8d0d-43d8-42b1-bbd0-c46c74bc01e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:12.679067 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f8d0d-43d8-42b1-bbd0-c46c74bc01e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:12.680500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f8d0d-43d8-42b1-bbd0-c46c74bc01e8 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:12.699087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-c55f8d0d-43d8-42b1-bbd0-c46c74bc01e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:13:12.699087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:12.699087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:12.699087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:12.699087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:12.699087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:12.699087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:12.699087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:12.699087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:12.699087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:12.699087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:12.699087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:12.699087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:13:12.699087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:13:12.699087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:13:12.700157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:13:12.700157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:12.700157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:12.700157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:12.700157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:12.700157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:12.700157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:12.700157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:12.700157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:12.700157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:12.700157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:12.700157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:12.700157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:12.700157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:12.700157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:12.700157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:12.700157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:12.701281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:13:12.701281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:13:12.701281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:13:12.701281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:13:12.701281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 610/1228] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:13:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:12.706608 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029d2f9-d6d3-4b12-909b-dffa03d19219 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:12.805446 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029d2f9-d6d3-4b12-909b-dffa03d19219 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:12.807783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:12.839419 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31275ef2-7255-4c6f-9cf9-65effe58155a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:12.840083 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31275ef2-7255-4c6f-9cf9-65effe58155a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:12.840365 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31275ef2-7255-4c6f-9cf9-65effe58155a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:12.840658 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31275ef2-7255-4c6f-9cf9-65effe58155a None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:12.841375 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31275ef2-7255-4c6f-9cf9-65effe58155a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:12.841686 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31275ef2-7255-4c6f-9cf9-65effe58155a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:12.843089 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31275ef2-7255-4c6f-9cf9-65effe58155a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:12.854452 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 619/1229] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:12.860237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f8d0d-43d8-42b1-bbd0-c46c74bc01e8 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:12.869744 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:12.959826 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f8d0d-43d8-42b1-bbd0-c46c74bc01e8 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:12.994661 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa5105-7a9a-47e6-a077-125446499fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:12.995672 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa5105-7a9a-47e6-a077-125446499fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:12.996615 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa5105-7a9a-47e6-a077-125446499fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:12.996879 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa5105-7a9a-47e6-a077-125446499fc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:13.003693 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa5105-7a9a-47e6-a077-125446499fc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:13.005157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa5105-7a9a-47e6-a077-125446499fc3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:13.018757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-84aa5105-7a9a-47e6-a077-125446499fc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:13:13.018757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:13.018757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:13.018757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:13.018757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:13.018757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:13.018757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:13.018757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:13.018757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:13.018757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:13.018757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:13.018757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:13.018757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:13:13.018757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:13:13.018757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:13:13.019658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:13:13.019658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:13.019658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:13.019658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:13.019658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:13.019658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:13.019658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:13.019658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:13.019658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:13.019658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:13.019658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:13.019658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:13.019658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:13.019658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:13.019658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:13.019658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:13.019658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:13.021026 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:13:13.021026 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:13:13.021026 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:13:13.021026 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:13:13.021026 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:13:13.021026 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:13:13.021026 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:13:13.021026 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:13:13.021026 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 611/1230] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:13:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:13.026038 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31275ef2-7255-4c6f-9cf9-65effe58155a None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:13.124846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31275ef2-7255-4c6f-9cf9-65effe58155a None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:13.157192 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21af1c-c119-465f-b67a-c5188e4c0124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:13.157837 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21af1c-c119-465f-b67a-c5188e4c0124 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:13.158141 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21af1c-c119-465f-b67a-c5188e4c0124 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:13.158423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21af1c-c119-465f-b67a-c5188e4c0124 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:13.159900 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21af1c-c119-465f-b67a-c5188e4c0124 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:13.160422 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21af1c-c119-465f-b67a-c5188e4c0124 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:13.163030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21af1c-c119-465f-b67a-c5188e4c0124 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:13.176325 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 620/1231] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:13:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:13.182369 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa5105-7a9a-47e6-a077-125446499fc3 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:13.247950 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:13.282497 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa5105-7a9a-47e6-a077-125446499fc3 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:13.315315 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9ae29-8cf1-4838-a443-13fe73f10886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:13.316213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9ae29-8cf1-4838-a443-13fe73f10886 None admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:13.316500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9ae29-8cf1-4838-a443-13fe73f10886 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:13.316772 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9ae29-8cf1-4838-a443-13fe73f10886 None admin] PATH_INFO: `/v3/projects/1076c94b43b2483eb4fc06173f9204c3/users/992db9dab5944769b192a868d6637a02/roles/c641ed689379413190e5e4ff94eb90ba` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:13.331529 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9ae29-8cf1-4838-a443-13fe73f10886 None admin] RBAC: Authorizing `identity:create_grant(project_id=1076c94b43b2483eb4fc06173f9204c3, user_id=992db9dab5944769b192a868d6637a02, role_id=c641ed689379413190e5e4ff94eb90ba)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:13.333350 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9ae29-8cf1-4838-a443-13fe73f10886 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:13.432275 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 612/1232] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 21:13:13 2022] PUT /identity/v3/projects/1076c94b43b2483eb4fc06173f9204c3/users/992db9dab5944769b192a868d6637a02/roles/c641ed689379413190e5e4ff94eb90ba => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:13:15.440730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f1a59-ce26-4ce5-b66f-fdbe2e5708ac None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:15.441288 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f1a59-ce26-4ce5-b66f-fdbe2e5708ac None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:15.441561 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f1a59-ce26-4ce5-b66f-fdbe2e5708ac None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:15.442977 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 621/1233] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:13:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:13:15.448454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0c840-e296-470d-8279-7403d782f550 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:15.448871 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0c840-e296-470d-8279-7403d782f550 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:15.449011 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0c840-e296-470d-8279-7403d782f550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:15.466184 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-a4b0c840-e296-470d-8279-7403d782f550 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:13:15.467370 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a4b0c840-e296-470d-8279-7403d782f550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:13:15.533094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 613/1234] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:13:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:13:15.557111 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f1a59-ce26-4ce5-b66f-fdbe2e5708ac None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:15.582558 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:15.657461 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f1a59-ce26-4ce5-b66f-fdbe2e5708ac None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:15.693266 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc3022-ae43-406b-bfc8-54cea3beb44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:15.693996 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc3022-ae43-406b-bfc8-54cea3beb44f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:15.694312 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc3022-ae43-406b-bfc8-54cea3beb44f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:15.694593 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc3022-ae43-406b-bfc8-54cea3beb44f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:15.704452 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc3022-ae43-406b-bfc8-54cea3beb44f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:13:15.712335 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-57dc3022-ae43-406b-bfc8-54cea3beb44f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:13:15.712335 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:15.712335 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:15.712335 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:15.712335 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:15.712335 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:15.712335 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:15.712335 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:15.712335 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:15.712335 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:15.712335 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:15.712335 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:15.712335 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:13:15.712335 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:13:15.712335 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:13:15.712335 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:13:15.713343 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:13:15.713343 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:13:15.713343 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:13:15.713343 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:13:15.713343 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:15.713343 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:15.713343 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:15.713343 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:15.713343 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:15.713343 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:15.713343 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:15.713343 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:15.713343 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:15.713343 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:15.713343 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:15.713343 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:15.714279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:15.714279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:15.714279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:15.714279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:15.714279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:13:15.714279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:13:15.714279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:13:15.714279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:13:15.714279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:13:15.714279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:13:15.714279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:13:15.714279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:13:15.714279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 622/1235] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 21:13:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:15.719681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0c840-e296-470d-8279-7403d782f550 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:15.769253 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:15.821147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0c840-e296-470d-8279-7403d782f550 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:15.855556 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2455f-0be0-4168-8e7b-7c0edce5a663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:15.856241 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2455f-0be0-4168-8e7b-7c0edce5a663 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:15.856520 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2455f-0be0-4168-8e7b-7c0edce5a663 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:15.856794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2455f-0be0-4168-8e7b-7c0edce5a663 None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:15.857540 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2455f-0be0-4168-8e7b-7c0edce5a663 None admin] RBAC: Adding query filter params (name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:15.857841 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2455f-0be0-4168-8e7b-7c0edce5a663 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:15.859237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2455f-0be0-4168-8e7b-7c0edce5a663 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:15.867619 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 614/1236] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 21:13:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:15.873211 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc3022-ae43-406b-bfc8-54cea3beb44f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:15.958848 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:15.973944 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc3022-ae43-406b-bfc8-54cea3beb44f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:16.005832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0662b0b1-ee8a-4b93-9285-2772a29c176f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:16.006639 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662b0b1-ee8a-4b93-9285-2772a29c176f None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:16.006920 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662b0b1-ee8a-4b93-9285-2772a29c176f None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:16.007192 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662b0b1-ee8a-4b93-9285-2772a29c176f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:16.017211 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0662b0b1-ee8a-4b93-9285-2772a29c176f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:16.019454 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0662b0b1-ee8a-4b93-9285-2772a29c176f None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:16.036779 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-0662b0b1-ee8a-4b93-9285-2772a29c176f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:13:16.036779 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:16.036779 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:16.036779 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:16.036779 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:16.036779 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:16.036779 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:16.036779 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:16.036779 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:16.036779 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:16.036779 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:16.036779 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:16.036779 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:13:16.036779 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:13:16.036779 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:13:16.037875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:13:16.037875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:16.037875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:16.037875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:16.037875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:16.037875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:16.037875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:16.037875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:16.037875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:16.037875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:16.037875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:16.037875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:16.037875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:16.037875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:16.037875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:16.037875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:16.037875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:16.041768 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:13:16.041768 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:13:16.041768 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:13:16.041768 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:13:16.041768 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 623/1237] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:13:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:16.043742 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2455f-0be0-4168-8e7b-7c0edce5a663 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:16.147152 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2455f-0be0-4168-8e7b-7c0edce5a663 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:16.159641 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:16.183814 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd4e77-1d37-418e-aaf2-485ab58e5b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:16.184473 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd4e77-1d37-418e-aaf2-485ab58e5b00 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:16.184757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd4e77-1d37-418e-aaf2-485ab58e5b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:16.185059 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd4e77-1d37-418e-aaf2-485ab58e5b00 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:16.185775 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd4e77-1d37-418e-aaf2-485ab58e5b00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:16.186083 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd4e77-1d37-418e-aaf2-485ab58e5b00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:16.187489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd4e77-1d37-418e-aaf2-485ab58e5b00 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:16.200416 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 615/1238] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:16.207046 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0662b0b1-ee8a-4b93-9285-2772a29c176f None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:16.305519 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0662b0b1-ee8a-4b93-9285-2772a29c176f None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:16.339345 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff76b1-20c3-468d-89d0-e8b8541b0673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:16.340142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff76b1-20c3-468d-89d0-e8b8541b0673 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:16.340424 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff76b1-20c3-468d-89d0-e8b8541b0673 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:16.340697 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff76b1-20c3-468d-89d0-e8b8541b0673 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:16.343401 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:16.348926 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff76b1-20c3-468d-89d0-e8b8541b0673 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:16.350432 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff76b1-20c3-468d-89d0-e8b8541b0673 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:16.365544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-53ff76b1-20c3-468d-89d0-e8b8541b0673 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:13:16.365544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:16.365544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:16.365544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:16.365544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:16.365544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:16.365544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:16.365544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:16.365544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:16.365544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:16.365544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:16.365544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:16.365544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:13:16.365544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:13:16.365544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:13:16.365544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:13:16.366693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:16.366693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:16.366693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:13:16.366693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:13:16.366693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:13:16.366693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:13:16.366693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:16.366693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:16.366693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:16.366693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:16.366693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:16.366693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:16.366693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:16.366693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:16.366693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:16.366693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:16.366693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:16.366693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:16.367851 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:16.367851 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:16.367851 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:13:16.367851 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:13:16.367851 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:13:16.367851 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:13:16.367851 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:13:16.367851 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:13:16.367851 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:13:16.367851 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:13:16.367851 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 624/1239] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:13:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:16.372564 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd4e77-1d37-418e-aaf2-485ab58e5b00 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:16.473348 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd4e77-1d37-418e-aaf2-485ab58e5b00 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:16.509219 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749c568-7c0f-4425-9595-c27316c5c69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:16.509885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749c568-7c0f-4425-9595-c27316c5c69a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:16.510192 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749c568-7c0f-4425-9595-c27316c5c69a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:16.510487 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749c568-7c0f-4425-9595-c27316c5c69a None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:16.511400 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749c568-7c0f-4425-9595-c27316c5c69a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:16.511708 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749c568-7c0f-4425-9595-c27316c5c69a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:16.513134 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749c568-7c0f-4425-9595-c27316c5c69a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:16.530896 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 616/1240] 10.222.0.13 () {56 vars in 1143 bytes} [Tue Jul 5 21:13:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:16.537072 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff76b1-20c3-468d-89d0-e8b8541b0673 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:16.638375 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff76b1-20c3-468d-89d0-e8b8541b0673 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:16.672400 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e9039-ea75-4173-8b0a-45f837369c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:16.673091 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e9039-ea75-4173-8b0a-45f837369c24 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:16.673380 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e9039-ea75-4173-8b0a-45f837369c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:16.673662 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e9039-ea75-4173-8b0a-45f837369c24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:16.735996 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:16.743067 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e9039-ea75-4173-8b0a-45f837369c24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:16.744522 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e9039-ea75-4173-8b0a-45f837369c24 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:16.842953 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 625/1241] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:13:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:13:16.849583 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749c568-7c0f-4425-9595-c27316c5c69a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:16.877161 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:16.948452 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749c568-7c0f-4425-9595-c27316c5c69a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:16.983150 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9694688-9bce-4308-af08-1cb61151ac8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:16.983929 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9694688-9bce-4308-af08-1cb61151ac8e None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:16.984213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9694688-9bce-4308-af08-1cb61151ac8e None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:16.984489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9694688-9bce-4308-af08-1cb61151ac8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:16.995555 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9694688-9bce-4308-af08-1cb61151ac8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:16.997031 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9694688-9bce-4308-af08-1cb61151ac8e None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:17.014584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-b9694688-9bce-4308-af08-1cb61151ac8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:13:17.014584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:17.014584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:17.014584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:17.014584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:17.014584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:17.014584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:17.014584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:17.014584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:17.014584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:17.014584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:17.014584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:17.014584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:13:17.014584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:13:17.014584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:13:17.021056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:13:17.021056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:17.021056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:17.021056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:17.021056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:17.021056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:17.021056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:17.021056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:17.021056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:17.021056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:17.021056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:17.021056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:17.021056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:17.021056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:17.021056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:17.021056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:17.021056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:17.022170 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:13:17.022170 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:13:17.022170 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:13:17.022170 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:13:17.022170 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 617/1242] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:13:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:17.022563 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e9039-ea75-4173-8b0a-45f837369c24 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:17.116454 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:17.122005 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e9039-ea75-4173-8b0a-45f837369c24 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:17.156815 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe00d7-3c9e-4c20-b0c0-659b72fcadce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:17.157478 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe00d7-3c9e-4c20-b0c0-659b72fcadce None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:17.157763 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe00d7-3c9e-4c20-b0c0-659b72fcadce None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:17.158042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe00d7-3c9e-4c20-b0c0-659b72fcadce None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:17.159418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe00d7-3c9e-4c20-b0c0-659b72fcadce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:17.159748 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe00d7-3c9e-4c20-b0c0-659b72fcadce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:17.161173 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe00d7-3c9e-4c20-b0c0-659b72fcadce None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:17.172226 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 626/1243] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:17.178190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9694688-9bce-4308-af08-1cb61151ac8e None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:17.254746 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:17.276408 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9694688-9bce-4308-af08-1cb61151ac8e None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:17.310548 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a57e05-d860-446d-9dcd-39f77e23be44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:17.311320 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a57e05-d860-446d-9dcd-39f77e23be44 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:17.311599 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a57e05-d860-446d-9dcd-39f77e23be44 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:17.311870 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a57e05-d860-446d-9dcd-39f77e23be44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:17.319008 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a57e05-d860-446d-9dcd-39f77e23be44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:17.320492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a57e05-d860-446d-9dcd-39f77e23be44 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:17.334883 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-24a57e05-d860-446d-9dcd-39f77e23be44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:13:17.334883 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:17.334883 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:17.334883 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:17.334883 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:17.334883 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:17.334883 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:17.334883 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:17.334883 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:17.334883 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:17.334883 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:17.334883 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:17.334883 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:13:17.334883 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:13:17.334883 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:13:17.337605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:13:17.337605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:17.337605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:17.337605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:17.337605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:17.337605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:17.337605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:17.337605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:17.337605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:17.337605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:17.337605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:17.337605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:17.337605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:17.337605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:17.337605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:17.337605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:17.337605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:17.338700 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:13:17.338700 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:13:17.338700 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:13:17.338700 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:13:17.338700 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:13:17.338700 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:13:17.338700 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:13:17.338700 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:13:17.338700 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 618/1244] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:13:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:17.342153 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe00d7-3c9e-4c20-b0c0-659b72fcadce None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:17.444719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe00d7-3c9e-4c20-b0c0-659b72fcadce None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:17.479937 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e41d7-67aa-4271-a2c9-04a09524b8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:17.480585 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e41d7-67aa-4271-a2c9-04a09524b8d7 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:17.480870 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e41d7-67aa-4271-a2c9-04a09524b8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:17.481149 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e41d7-67aa-4271-a2c9-04a09524b8d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:17.481927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e41d7-67aa-4271-a2c9-04a09524b8d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:17.482266 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e41d7-67aa-4271-a2c9-04a09524b8d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:17.483687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e41d7-67aa-4271-a2c9-04a09524b8d7 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:17.495778 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 627/1245] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:13:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:17.502140 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a57e05-d860-446d-9dcd-39f77e23be44 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:17.606015 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a57e05-d860-446d-9dcd-39f77e23be44 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:17.639446 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faaa1c8-ffb5-4be9-9bde-6d1af2e08876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:17.640090 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faaa1c8-ffb5-4be9-9bde-6d1af2e08876 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:17.640371 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faaa1c8-ffb5-4be9-9bde-6d1af2e08876 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:17.640646 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faaa1c8-ffb5-4be9-9bde-6d1af2e08876 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:17.641473 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faaa1c8-ffb5-4be9-9bde-6d1af2e08876 None admin] RBAC: Adding query filter params (role.id=c641ed689379413190e5e4ff94eb90ba, scope.project.id=1076c94b43b2483eb4fc06173f9204c3, user.id=992db9dab5944769b192a868d6637a02) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:17.641784 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faaa1c8-ffb5-4be9-9bde-6d1af2e08876 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:17.643231 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faaa1c8-ffb5-4be9-9bde-6d1af2e08876 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:17.650132 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 619/1246] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:13:17 2022] GET /identity/v3/role_assignments?user.id=992db9dab5944769b192a868d6637a02&scope.project.id=1076c94b43b2483eb4fc06173f9204c3&role.id=c641ed689379413190e5e4ff94eb90ba => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:19.711373 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbe26f-8fe8-46c4-9299-efa773261926 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:19.711938 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbe26f-8fe8-46c4-9299-efa773261926 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:19.711938 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbe26f-8fe8-46c4-9299-efa773261926 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:19.713379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 628/1247] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:13:19.718566 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99f2b8-34c6-4ac6-860e-1cebdad76050 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:19.718990 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99f2b8-34c6-4ac6-860e-1cebdad76050 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:19.719127 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99f2b8-34c6-4ac6-860e-1cebdad76050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:19.724787 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:19.736766 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-5c99f2b8-34c6-4ac6-860e-1cebdad76050 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:13:19.737959 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5c99f2b8-34c6-4ac6-860e-1cebdad76050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:13:19.804961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 620/1248] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:13:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:13:19.827904 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbe26f-8fe8-46c4-9299-efa773261926 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:19.846254 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:19.925570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbe26f-8fe8-46c4-9299-efa773261926 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:19.959244 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11f41d-1f17-46aa-89a7-42cc66f0ad1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:19.960018 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11f41d-1f17-46aa-89a7-42cc66f0ad1d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:19.960298 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11f41d-1f17-46aa-89a7-42cc66f0ad1d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:19.960571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11f41d-1f17-46aa-89a7-42cc66f0ad1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:19.970425 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11f41d-1f17-46aa-89a7-42cc66f0ad1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:13:19.978537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-db11f41d-1f17-46aa-89a7-42cc66f0ad1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:13:19.978537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:19.978537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:19.978537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:19.978537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:19.978537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:19.978537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:19.978537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:19.978537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:19.978537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:19.978537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:19.978537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:19.978537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:13:19.978537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:13:19.978537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:13:19.978537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:13:19.979732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:13:19.979732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:13:19.979732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:13:19.979732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:13:19.979732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:19.979732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:19.979732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:19.979732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:19.979732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:19.979732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:19.979732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:19.979732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:19.979732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:19.979732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:19.979732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:19.979732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:19.980841 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:19.980841 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:19.980841 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:19.980841 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:19.980841 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:13:19.980841 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:13:19.980841 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:13:19.980841 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:13:19.980841 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:13:19.980841 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:13:19.980841 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:13:19.980841 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:13:19.980841 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 629/1249] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:13:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:19.985604 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99f2b8-34c6-4ac6-860e-1cebdad76050 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:20.084962 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99f2b8-34c6-4ac6-860e-1cebdad76050 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:20.114829 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:20.119704 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836225b4-a6b9-4ce2-b2e3-60204e1ad15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:20.120368 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836225b4-a6b9-4ce2-b2e3-60204e1ad15a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:20.120654 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836225b4-a6b9-4ce2-b2e3-60204e1ad15a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:20.120935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836225b4-a6b9-4ce2-b2e3-60204e1ad15a None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:20.121680 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836225b4-a6b9-4ce2-b2e3-60204e1ad15a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:20.121990 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836225b4-a6b9-4ce2-b2e3-60204e1ad15a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:20.123395 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836225b4-a6b9-4ce2-b2e3-60204e1ad15a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:20.131722 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 621/1250] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:13:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:20.137385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11f41d-1f17-46aa-89a7-42cc66f0ad1d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:20.214552 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:20.237251 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11f41d-1f17-46aa-89a7-42cc66f0ad1d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:20.269166 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e78799-d4da-4337-a59c-5f11ab8c3c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:20.270807 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e78799-d4da-4337-a59c-5f11ab8c3c7c None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:20.271099 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e78799-d4da-4337-a59c-5f11ab8c3c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:20.271377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e78799-d4da-4337-a59c-5f11ab8c3c7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:20.281509 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e78799-d4da-4337-a59c-5f11ab8c3c7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:20.282987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e78799-d4da-4337-a59c-5f11ab8c3c7c None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:20.300238 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-e9e78799-d4da-4337-a59c-5f11ab8c3c7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:13:20.300238 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:20.300238 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:20.300238 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:20.300238 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:20.300238 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:20.300238 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:20.300238 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:20.300238 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:20.300238 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:20.300238 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:20.300238 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:20.300238 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:13:20.300238 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:13:20.300238 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:13:20.301385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:13:20.301385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:20.301385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:20.301385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:20.301385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:20.301385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:20.301385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:20.301385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:20.301385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:20.301385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:20.301385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:20.301385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:20.301385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:20.301385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:20.301385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:20.301385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:20.301385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:20.302393 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:13:20.302393 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:13:20.302393 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:13:20.302393 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:13:20.302393 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 630/1251] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:13:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:20.307159 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836225b4-a6b9-4ce2-b2e3-60204e1ad15a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:20.409081 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836225b4-a6b9-4ce2-b2e3-60204e1ad15a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:20.442045 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24fed2-280c-4d14-a4c5-303e1590e3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:20.442715 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24fed2-280c-4d14-a4c5-303e1590e3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:20.442995 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24fed2-280c-4d14-a4c5-303e1590e3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:20.443267 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24fed2-280c-4d14-a4c5-303e1590e3b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:20.443971 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24fed2-280c-4d14-a4c5-303e1590e3b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:20.444275 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24fed2-280c-4d14-a4c5-303e1590e3b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:20.445623 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24fed2-280c-4d14-a4c5-303e1590e3b5 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:20.457010 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 622/1252] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:20.463206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e78799-d4da-4337-a59c-5f11ab8c3c7c None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:20.562213 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e78799-d4da-4337-a59c-5f11ab8c3c7c None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:20.588865 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:20.596610 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927784b-05cc-450a-a399-51d0e81eed99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:20.597406 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927784b-05cc-450a-a399-51d0e81eed99 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:20.598360 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927784b-05cc-450a-a399-51d0e81eed99 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:20.598647 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927784b-05cc-450a-a399-51d0e81eed99 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:20.606933 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927784b-05cc-450a-a399-51d0e81eed99 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:20.608374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927784b-05cc-450a-a399-51d0e81eed99 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:20.623094 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-0927784b-05cc-450a-a399-51d0e81eed99 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:13:20.623094 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:20.623094 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:20.623094 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:20.623094 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:20.623094 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:20.623094 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:20.623094 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:20.623094 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:20.623094 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:20.623094 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:20.623094 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:20.623094 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:13:20.623094 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:13:20.623094 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:13:20.623094 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:13:20.624274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:20.624274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:20.624274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:13:20.624274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:13:20.624274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:13:20.624274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:13:20.624274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:20.624274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:20.624274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:20.624274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:20.624274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:20.624274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:20.624274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:20.624274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:20.624274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:20.624274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:20.624274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:20.624274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:20.625491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:20.625491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:20.625491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:13:20.625491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:13:20.625491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:13:20.625491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:13:20.625491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:13:20.625491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:13:20.625491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:13:20.625491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:13:20.625491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 631/1253] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:13:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:20.630323 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24fed2-280c-4d14-a4c5-303e1590e3b5 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:20.685106 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:20.728684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24fed2-280c-4d14-a4c5-303e1590e3b5 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:20.763212 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af836976-d508-468d-97b7-61a40c2fab0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:20.763873 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af836976-d508-468d-97b7-61a40c2fab0c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:20.764157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af836976-d508-468d-97b7-61a40c2fab0c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:20.764437 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af836976-d508-468d-97b7-61a40c2fab0c None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:20.765314 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af836976-d508-468d-97b7-61a40c2fab0c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:20.765624 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af836976-d508-468d-97b7-61a40c2fab0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:20.767092 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af836976-d508-468d-97b7-61a40c2fab0c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:20.784891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 623/1254] 10.222.0.13 () {56 vars in 1143 bytes} [Tue Jul 5 21:13:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:20.791126 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927784b-05cc-450a-a399-51d0e81eed99 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:20.889987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927784b-05cc-450a-a399-51d0e81eed99 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:20.923578 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e72a67-a1d4-475a-a9de-ce56a2472ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:20.924322 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e72a67-a1d4-475a-a9de-ce56a2472ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:20.924725 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e72a67-a1d4-475a-a9de-ce56a2472ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:20.925007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e72a67-a1d4-475a-a9de-ce56a2472ad6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:20.979548 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:20.991305 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e72a67-a1d4-475a-a9de-ce56a2472ad6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:20.992748 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e72a67-a1d4-475a-a9de-ce56a2472ad6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:21.090090 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 632/1255] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:13:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 21:13:21.095999 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af836976-d508-468d-97b7-61a40c2fab0c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:21.196065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af836976-d508-468d-97b7-61a40c2fab0c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:21.209819 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:21.229821 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773ec97-af56-4ccd-84b7-9bb81b18235b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:21.230581 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773ec97-af56-4ccd-84b7-9bb81b18235b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:21.230872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773ec97-af56-4ccd-84b7-9bb81b18235b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:21.231145 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773ec97-af56-4ccd-84b7-9bb81b18235b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:21.240972 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773ec97-af56-4ccd-84b7-9bb81b18235b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:21.242454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773ec97-af56-4ccd-84b7-9bb81b18235b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:21.260120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-e773ec97-af56-4ccd-84b7-9bb81b18235b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:13:21.260120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:21.260120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:21.260120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:21.260120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:21.260120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:21.260120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:21.260120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:21.260120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:21.260120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:21.260120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:21.260120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:21.260120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:13:21.260120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:13:21.260120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:13:21.261174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:13:21.261174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:21.261174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:21.261174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:21.261174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:21.261174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:21.261174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:21.261174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:21.261174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:21.261174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:21.261174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:21.261174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:21.261174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:21.261174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:21.261174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:21.261174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:21.261174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:21.262577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:13:21.262577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:13:21.262577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:13:21.262577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:13:21.262577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 624/1256] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:13:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:21.267106 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e72a67-a1d4-475a-a9de-ce56a2472ad6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:21.355884 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:21.368686 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e72a67-a1d4-475a-a9de-ce56a2472ad6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:21.401985 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f23f9-f0f8-433e-8042-2fbd4dc91588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:21.402688 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f23f9-f0f8-433e-8042-2fbd4dc91588 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:21.402974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f23f9-f0f8-433e-8042-2fbd4dc91588 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:21.403252 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f23f9-f0f8-433e-8042-2fbd4dc91588 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:21.403974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f23f9-f0f8-433e-8042-2fbd4dc91588 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:21.404284 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f23f9-f0f8-433e-8042-2fbd4dc91588 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:21.406292 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f23f9-f0f8-433e-8042-2fbd4dc91588 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:21.417993 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 633/1257] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:21.423782 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773ec97-af56-4ccd-84b7-9bb81b18235b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:21.523565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773ec97-af56-4ccd-84b7-9bb81b18235b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:21.557727 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c74da-e8e6-40d5-99f7-3c3ce363d7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:21.558571 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c74da-e8e6-40d5-99f7-3c3ce363d7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:21.558850 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c74da-e8e6-40d5-99f7-3c3ce363d7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:21.559118 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c74da-e8e6-40d5-99f7-3c3ce363d7c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:21.565657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c74da-e8e6-40d5-99f7-3c3ce363d7c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:21.567521 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c74da-e8e6-40d5-99f7-3c3ce363d7c1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:21.581050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-a07c74da-e8e6-40d5-99f7-3c3ce363d7c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:13:21.581050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:21.581050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:21.581050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:21.581050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:21.581050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:21.581050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:21.581050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:21.581050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:21.581050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:21.581050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:21.581050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:21.581050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:13:21.581050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:13:21.581050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:13:21.582666 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:13:21.582666 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:21.582666 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:21.582666 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:21.582666 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:21.582666 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:21.582666 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:21.582666 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:21.582666 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:21.582666 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:21.582666 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:21.582666 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:21.582666 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:21.582666 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:21.582666 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:21.582666 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:21.582666 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:21.583832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:13:21.583832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:13:21.583832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:13:21.583832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:13:21.583832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:13:21.583832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:13:21.583832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:13:21.583832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:13:21.583832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 625/1258] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:13:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:21.588872 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f23f9-f0f8-433e-8042-2fbd4dc91588 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:21.689166 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f23f9-f0f8-433e-8042-2fbd4dc91588 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:21.723409 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7f628-61bb-4751-86a7-8ffc7f40b8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:21.724063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7f628-61bb-4751-86a7-8ffc7f40b8df None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:21.724425 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7f628-61bb-4751-86a7-8ffc7f40b8df None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:21.724709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7f628-61bb-4751-86a7-8ffc7f40b8df None admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:21.725488 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7f628-61bb-4751-86a7-8ffc7f40b8df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:21.725797 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7f628-61bb-4751-86a7-8ffc7f40b8df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:21.727260 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7f628-61bb-4751-86a7-8ffc7f40b8df None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:21.739153 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 634/1259] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:13:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:21.745388 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c74da-e8e6-40d5-99f7-3c3ce363d7c1 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:21.773223 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:21.851938 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c74da-e8e6-40d5-99f7-3c3ce363d7c1 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:21.885418 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac29d32-ec73-4a26-9e56-457c40425a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:21.886069 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac29d32-ec73-4a26-9e56-457c40425a21 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:21.886378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac29d32-ec73-4a26-9e56-457c40425a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:21.886653 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac29d32-ec73-4a26-9e56-457c40425a21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:21.887478 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac29d32-ec73-4a26-9e56-457c40425a21 None admin] RBAC: Adding query filter params (role.id=15cf04fec8c6477088a33bf286f1bbdb, scope.project.id=1076c94b43b2483eb4fc06173f9204c3, user.id=992db9dab5944769b192a868d6637a02) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:21.887784 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac29d32-ec73-4a26-9e56-457c40425a21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:21.889200 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac29d32-ec73-4a26-9e56-457c40425a21 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:21.895179 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 626/1260] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:13:21 2022] GET /identity/v3/role_assignments?user.id=992db9dab5944769b192a868d6637a02&scope.project.id=1076c94b43b2483eb4fc06173f9204c3&role.id=15cf04fec8c6477088a33bf286f1bbdb => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:23.919698 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f733370-62c8-43c4-99c4-364a113521fb None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:23.920229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f733370-62c8-43c4-99c4-364a113521fb None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:23.920229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f733370-62c8-43c4-99c4-364a113521fb None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:23.921531 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 635/1261] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:13:23.926711 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5563e7d-bdcb-46e1-aa39-2bbd39c87fe5 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:23.927118 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5563e7d-bdcb-46e1-aa39-2bbd39c87fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:23.927255 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5563e7d-bdcb-46e1-aa39-2bbd39c87fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:23.943805 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-c5563e7d-bdcb-46e1-aa39-2bbd39c87fe5 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:13:23.944978 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c5563e7d-bdcb-46e1-aa39-2bbd39c87fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:13:24.011292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 627/1262] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:13:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:13:24.034714 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f733370-62c8-43c4-99c4-364a113521fb None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:24.046312 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:24.135783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f733370-62c8-43c4-99c4-364a113521fb None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:24.171310 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f03d9-03e0-4a92-aa22-05e5827d122d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:24.172018 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f03d9-03e0-4a92-aa22-05e5827d122d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:24.172295 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f03d9-03e0-4a92-aa22-05e5827d122d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:24.172568 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f03d9-03e0-4a92-aa22-05e5827d122d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:24.183254 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f03d9-03e0-4a92-aa22-05e5827d122d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:13:24.190894 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-8d7f03d9-03e0-4a92-aa22-05e5827d122d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:13:24.190894 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:24.190894 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:24.190894 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:24.190894 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:24.190894 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:24.190894 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:24.190894 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:24.190894 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:24.190894 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:24.190894 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:24.190894 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:24.190894 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:13:24.190894 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:13:24.190894 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:13:24.190894 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:13:24.192033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:13:24.192033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:13:24.192033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:13:24.192033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:13:24.192033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:24.192033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:24.192033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:24.192033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:24.192033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:24.192033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:24.192033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:24.192033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:24.192033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:24.192033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:24.192033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:24.192033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:24.193758 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:24.193758 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:24.193758 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:24.193758 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:24.193758 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:13:24.193758 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:13:24.193758 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:13:24.193758 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:13:24.193758 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:13:24.193758 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:13:24.193758 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:13:24.193758 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:13:24.193758 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 636/1263] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:13:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:24.198753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5563e7d-bdcb-46e1-aa39-2bbd39c87fe5 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:24.217480 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:24.295634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5563e7d-bdcb-46e1-aa39-2bbd39c87fe5 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:24.331046 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63648e-2dfb-43c2-b3d0-1b780b22975d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:24.333647 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63648e-2dfb-43c2-b3d0-1b780b22975d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:24.333647 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63648e-2dfb-43c2-b3d0-1b780b22975d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:24.333647 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63648e-2dfb-43c2-b3d0-1b780b22975d None admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:24.333647 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63648e-2dfb-43c2-b3d0-1b780b22975d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:24.334080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63648e-2dfb-43c2-b3d0-1b780b22975d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:24.335243 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63648e-2dfb-43c2-b3d0-1b780b22975d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:24.343329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 628/1264] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:13:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:24.349163 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f03d9-03e0-4a92-aa22-05e5827d122d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:24.415971 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:24.448630 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f03d9-03e0-4a92-aa22-05e5827d122d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:24.483761 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de0dc9-3caa-48ea-b661-19226062925d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:24.484547 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de0dc9-3caa-48ea-b661-19226062925d None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:24.484826 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de0dc9-3caa-48ea-b661-19226062925d None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:24.485101 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de0dc9-3caa-48ea-b661-19226062925d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:24.496684 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de0dc9-3caa-48ea-b661-19226062925d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:24.498143 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de0dc9-3caa-48ea-b661-19226062925d None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:24.515484 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-c2de0dc9-3caa-48ea-b661-19226062925d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:13:24.515484 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:24.515484 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:24.515484 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:24.515484 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:24.515484 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:24.515484 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:24.515484 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:24.515484 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:24.515484 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:24.515484 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:24.515484 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:24.515484 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:13:24.515484 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:13:24.515484 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:13:24.516571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:13:24.516571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:24.516571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:24.516571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:24.516571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:24.516571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:24.516571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:24.516571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:24.516571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:24.516571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:24.516571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:24.516571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:24.516571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:24.516571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:24.516571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:24.516571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:24.516571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:24.517644 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:13:24.517644 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:13:24.517644 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:13:24.517644 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:13:24.517644 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 637/1265] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:13:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:24.522652 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63648e-2dfb-43c2-b3d0-1b780b22975d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:24.603923 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:24.622814 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63648e-2dfb-43c2-b3d0-1b780b22975d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:24.655980 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd24c79-a074-45f4-bac5-7abc49319a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:24.656637 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd24c79-a074-45f4-bac5-7abc49319a2c None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:24.656922 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd24c79-a074-45f4-bac5-7abc49319a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:24.657199 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd24c79-a074-45f4-bac5-7abc49319a2c None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:24.657917 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd24c79-a074-45f4-bac5-7abc49319a2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:24.658262 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd24c79-a074-45f4-bac5-7abc49319a2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:24.659630 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd24c79-a074-45f4-bac5-7abc49319a2c None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:24.675719 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 629/1266] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:24.677406 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de0dc9-3caa-48ea-b661-19226062925d None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:24.776138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de0dc9-3caa-48ea-b661-19226062925d None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:24.795057 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:24.809282 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3509582-c749-42e6-9e46-3f7545ed47a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:24.810075 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3509582-c749-42e6-9e46-3f7545ed47a5 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:24.810388 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3509582-c749-42e6-9e46-3f7545ed47a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:24.810668 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3509582-c749-42e6-9e46-3f7545ed47a5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:24.818808 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3509582-c749-42e6-9e46-3f7545ed47a5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:24.820253 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3509582-c749-42e6-9e46-3f7545ed47a5 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:24.834505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-c3509582-c749-42e6-9e46-3f7545ed47a5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:13:24.834505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:24.834505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:24.834505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:24.834505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:24.834505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:24.834505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:24.834505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:24.834505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:24.834505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:24.834505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:24.834505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:24.834505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:13:24.834505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:13:24.834505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:13:24.834505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:13:24.835483 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:24.835483 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:24.835483 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:13:24.835483 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:13:24.835483 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:13:24.835483 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:13:24.835483 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:24.835483 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:24.835483 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:24.835483 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:24.835483 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:24.835483 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:24.835483 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:24.835483 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:24.835483 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:24.835483 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:24.835483 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:24.835483 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:24.836599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:24.836599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:24.836599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:13:24.836599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:13:24.836599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:13:24.836599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:13:24.836599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:13:24.836599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:13:24.836599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:13:24.836599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:13:24.836599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 638/1267] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:13:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:13:24.841696 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd24c79-a074-45f4-bac5-7abc49319a2c None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:24.941042 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd24c79-a074-45f4-bac5-7abc49319a2c None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:24.974840 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd7f8a-fddb-45c7-ac5f-3e36ed4b29d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:24.975505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd7f8a-fddb-45c7-ac5f-3e36ed4b29d9 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:24.975788 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd7f8a-fddb-45c7-ac5f-3e36ed4b29d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:24.976061 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd7f8a-fddb-45c7-ac5f-3e36ed4b29d9 None admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:24.976895 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd7f8a-fddb-45c7-ac5f-3e36ed4b29d9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:24.977209 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd7f8a-fddb-45c7-ac5f-3e36ed4b29d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:24.978672 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd7f8a-fddb-45c7-ac5f-3e36ed4b29d9 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:24.987797 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:24.996665 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 630/1268] 10.222.0.13 () {56 vars in 1143 bytes} [Tue Jul 5 21:13:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:25.002555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3509582-c749-42e6-9e46-3f7545ed47a5 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:25.103056 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3509582-c749-42e6-9e46-3f7545ed47a5 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:25.136311 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d20a91-71a0-471d-a902-2b0bc299dbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:25.137095 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d20a91-71a0-471d-a902-2b0bc299dbd2 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:25.137379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d20a91-71a0-471d-a902-2b0bc299dbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:25.137660 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d20a91-71a0-471d-a902-2b0bc299dbd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:25.148771 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d20a91-71a0-471d-a902-2b0bc299dbd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:25.156449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d20a91-71a0-471d-a902-2b0bc299dbd2 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:25.167850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-61d20a91-71a0-471d-a902-2b0bc299dbd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:13:25.167850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:25.167850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:25.167850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:25.167850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:25.167850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:25.167850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:25.167850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:25.167850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:25.167850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:25.167850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:25.167850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:25.167850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:13:25.167850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:13:25.167850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:13:25.168905 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:13:25.168905 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:25.168905 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:25.168905 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:25.168905 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:25.168905 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:25.168905 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:25.168905 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:25.168905 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:25.168905 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:25.168905 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:25.168905 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:25.168905 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:25.168905 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:25.168905 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:25.168905 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:25.168905 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:25.170227 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:13:25.170227 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:13:25.170227 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:13:25.170227 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:13:25.170227 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 639/1269] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:13:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:25.174814 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd7f8a-fddb-45c7-ac5f-3e36ed4b29d9 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:25.274728 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd7f8a-fddb-45c7-ac5f-3e36ed4b29d9 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:25.308841 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69823d0-3299-4346-95d9-e0208884da52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:25.309500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69823d0-3299-4346-95d9-e0208884da52 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:25.309787 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69823d0-3299-4346-95d9-e0208884da52 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:25.310065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69823d0-3299-4346-95d9-e0208884da52 None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:25.310833 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69823d0-3299-4346-95d9-e0208884da52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:25.311140 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69823d0-3299-4346-95d9-e0208884da52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:25.312500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69823d0-3299-4346-95d9-e0208884da52 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:25.323936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 631/1270] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:25.329681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d20a91-71a0-471d-a902-2b0bc299dbd2 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:25.361728 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:25.428668 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d20a91-71a0-471d-a902-2b0bc299dbd2 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:25.461514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0360a84-bcee-4aaf-a876-72ec820b3f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:25.462429 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0360a84-bcee-4aaf-a876-72ec820b3f4e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:25.462716 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0360a84-bcee-4aaf-a876-72ec820b3f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:25.462994 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0360a84-bcee-4aaf-a876-72ec820b3f4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:25.469663 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0360a84-bcee-4aaf-a876-72ec820b3f4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:25.471155 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0360a84-bcee-4aaf-a876-72ec820b3f4e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:25.486526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-e0360a84-bcee-4aaf-a876-72ec820b3f4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:13:25.486526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:25.486526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:25.486526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:25.486526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:25.486526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:25.486526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:25.486526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:25.486526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:25.486526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:25.486526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:25.486526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:25.486526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:13:25.486526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:13:25.486526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:13:25.487583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:13:25.487583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:25.487583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:25.487583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:25.487583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:25.487583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:25.487583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:25.487583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:25.487583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:25.487583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:25.487583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:25.487583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:25.487583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:25.487583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:25.487583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:25.487583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:25.487583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:25.488727 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:13:25.488727 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:13:25.488727 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:13:25.488727 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:13:25.488727 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:13:25.488727 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:13:25.488727 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:13:25.488727 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:13:25.488727 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 640/1271] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:13:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:25.493625 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69823d0-3299-4346-95d9-e0208884da52 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:25.554794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:25.595307 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69823d0-3299-4346-95d9-e0208884da52 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:25.629288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad015a5-29fa-46b6-82a4-6c778d830ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:25.630401 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad015a5-29fa-46b6-82a4-6c778d830ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:25.630771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad015a5-29fa-46b6-82a4-6c778d830ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:25.631053 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad015a5-29fa-46b6-82a4-6c778d830ee3 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:25.631889 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad015a5-29fa-46b6-82a4-6c778d830ee3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:25.632193 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad015a5-29fa-46b6-82a4-6c778d830ee3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:25.633607 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad015a5-29fa-46b6-82a4-6c778d830ee3 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:25.646661 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 632/1272] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:13:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:25.652662 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0360a84-bcee-4aaf-a876-72ec820b3f4e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:25.744666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:25.753140 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0360a84-bcee-4aaf-a876-72ec820b3f4e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:25.789244 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d35f4-88ca-4786-a2c1-70df0cbf2226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:25.790148 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d35f4-88ca-4786-a2c1-70df0cbf2226 None admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:25.790421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d35f4-88ca-4786-a2c1-70df0cbf2226 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:25.790691 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d35f4-88ca-4786-a2c1-70df0cbf2226 None admin] PATH_INFO: `/v3/projects/1076c94b43b2483eb4fc06173f9204c3/users/992db9dab5944769b192a868d6637a02/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:25.792602 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d35f4-88ca-4786-a2c1-70df0cbf2226 None admin] RBAC: Authorizing `identity:create_grant(project_id=1076c94b43b2483eb4fc06173f9204c3, user_id=992db9dab5944769b192a868d6637a02, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:25.794171 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d35f4-88ca-4786-a2c1-70df0cbf2226 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:25.890974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 641/1273] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 21:13:25 2022] PUT /identity/v3/projects/1076c94b43b2483eb4fc06173f9204c3/users/992db9dab5944769b192a868d6637a02/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:13:27.909416 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00450c-ab33-44dd-8401-a573ac84b2ca None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:27.909937 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00450c-ab33-44dd-8401-a573ac84b2ca None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:27.909937 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00450c-ab33-44dd-8401-a573ac84b2ca None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:27.911987 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 633/1274] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:13:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:13:27.917077 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5d950-bf14-4e29-afac-ceec99185b05 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:27.922035 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5d950-bf14-4e29-afac-ceec99185b05 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:27.922035 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5d950-bf14-4e29-afac-ceec99185b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:27.933704 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f1b5d950-bf14-4e29-afac-ceec99185b05 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:13:27.934924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f1b5d950-bf14-4e29-afac-ceec99185b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:13:28.000678 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 642/1275] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:13:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:13:28.025530 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00450c-ab33-44dd-8401-a573ac84b2ca None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:28.124776 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00450c-ab33-44dd-8401-a573ac84b2ca None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:28.141872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:28.169991 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1182602-7303-47f5-b470-e3a75809b5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:28.169991 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1182602-7303-47f5-b470-e3a75809b5ae None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:28.169991 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1182602-7303-47f5-b470-e3a75809b5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:28.169991 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1182602-7303-47f5-b470-e3a75809b5ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:28.171738 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1182602-7303-47f5-b470-e3a75809b5ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:13:28.179660 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-b1182602-7303-47f5-b470-e3a75809b5ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:13:28.179660 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:28.179660 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:28.179660 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:28.179660 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:28.179660 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:28.179660 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:28.179660 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:28.179660 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:28.179660 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:28.179660 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:28.179660 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:28.179660 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:13:28.179660 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:13:28.179660 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:13:28.179660 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:13:28.180903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:13:28.180903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:13:28.180903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:13:28.180903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:13:28.180903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:28.180903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:28.180903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:28.180903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:28.180903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:28.180903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:28.180903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:28.180903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:28.180903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:28.180903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:28.180903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:28.180903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:28.181873 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:28.181873 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:28.181873 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:28.181873 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:28.181873 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:13:28.181873 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:13:28.181873 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:13:28.181873 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:13:28.181873 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:13:28.181873 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:13:28.181873 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:13:28.181873 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:13:28.181873 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 634/1276] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 21:13:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:28.186988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5d950-bf14-4e29-afac-ceec99185b05 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:28.268485 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:28.286204 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5d950-bf14-4e29-afac-ceec99185b05 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:28.320085 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e89686-8b00-4cee-86c0-d03837b68b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:28.320744 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e89686-8b00-4cee-86c0-d03837b68b5e None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:28.321033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e89686-8b00-4cee-86c0-d03837b68b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:28.321319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e89686-8b00-4cee-86c0-d03837b68b5e None admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:28.322082 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e89686-8b00-4cee-86c0-d03837b68b5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:28.322428 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e89686-8b00-4cee-86c0-d03837b68b5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:28.323811 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e89686-8b00-4cee-86c0-d03837b68b5e None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:28.331699 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 643/1277] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 21:13:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:28.338081 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1182602-7303-47f5-b470-e3a75809b5ae None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:28.439950 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1182602-7303-47f5-b470-e3a75809b5ae None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:28.473132 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7667c-35b6-47da-92ed-567556dc9984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:28.475426 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7667c-35b6-47da-92ed-567556dc9984 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:28.475426 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7667c-35b6-47da-92ed-567556dc9984 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:28.475426 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7667c-35b6-47da-92ed-567556dc9984 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:28.485442 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c7667c-35b6-47da-92ed-567556dc9984 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:28.486898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c7667c-35b6-47da-92ed-567556dc9984 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:28.504370 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-22c7667c-35b6-47da-92ed-567556dc9984 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:13:28.504370 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:28.504370 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:28.504370 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:28.504370 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:28.504370 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:28.504370 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:28.504370 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:28.504370 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:28.504370 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:28.504370 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:28.504370 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:28.504370 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:13:28.504370 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:13:28.504370 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:13:28.506411 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:13:28.506411 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:28.506411 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:28.506411 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:28.506411 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:28.506411 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:28.506411 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:28.506411 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:28.506411 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:28.506411 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:28.506411 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:28.506411 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:28.506411 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:28.506411 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:28.506411 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:28.506411 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:28.506411 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:28.507572 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:13:28.507572 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:13:28.507572 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:13:28.507572 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:13:28.507572 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 635/1278] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:13:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:28.512346 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e89686-8b00-4cee-86c0-d03837b68b5e None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:28.612512 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e89686-8b00-4cee-86c0-d03837b68b5e None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:28.646022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d95064-4246-4fdf-a5a1-6213dac14969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:28.646789 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d95064-4246-4fdf-a5a1-6213dac14969 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:28.647071 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d95064-4246-4fdf-a5a1-6213dac14969 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:28.647348 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d95064-4246-4fdf-a5a1-6213dac14969 None admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:28.648065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d95064-4246-4fdf-a5a1-6213dac14969 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:28.648366 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d95064-4246-4fdf-a5a1-6213dac14969 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:28.649757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d95064-4246-4fdf-a5a1-6213dac14969 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:28.669788 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 644/1279] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:28.675640 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7667c-35b6-47da-92ed-567556dc9984 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:28.706497 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:28.773612 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7667c-35b6-47da-92ed-567556dc9984 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:28.806628 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225ccc1-a39c-4f92-80ca-1a8e79473657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:28.807417 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225ccc1-a39c-4f92-80ca-1a8e79473657 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:28.807700 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225ccc1-a39c-4f92-80ca-1a8e79473657 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:28.807977 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225ccc1-a39c-4f92-80ca-1a8e79473657 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:28.815360 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225ccc1-a39c-4f92-80ca-1a8e79473657 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:28.816796 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225ccc1-a39c-4f92-80ca-1a8e79473657 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:28.831396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-6225ccc1-a39c-4f92-80ca-1a8e79473657 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:13:28.831396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:28.831396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:28.831396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:28.831396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:28.831396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:28.831396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:28.831396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:28.831396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:28.831396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:28.831396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:28.831396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:28.831396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:13:28.831396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:13:28.831396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:13:28.831396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:13:28.832573 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:28.832573 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:28.832573 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:13:28.832573 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:13:28.832573 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:13:28.832573 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:13:28.832573 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:28.832573 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:28.832573 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:28.832573 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:28.832573 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:28.832573 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:28.832573 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:28.832573 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:28.832573 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:28.832573 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:28.832573 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:28.832573 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:28.834017 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:28.834017 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:28.834017 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:13:28.834017 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:13:28.834017 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:13:28.834017 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:13:28.834017 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:13:28.834017 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:13:28.834017 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:13:28.834017 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:13:28.834017 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 636/1280] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:13:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:28.838624 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d95064-4246-4fdf-a5a1-6213dac14969 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:28.842445 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:28.938600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d95064-4246-4fdf-a5a1-6213dac14969 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:28.972336 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d130dd-2ab2-44a5-94f5-2268f7f22cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:28.972942 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d130dd-2ab2-44a5-94f5-2268f7f22cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:28.973230 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d130dd-2ab2-44a5-94f5-2268f7f22cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:28.974068 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d130dd-2ab2-44a5-94f5-2268f7f22cb6 None admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:28.974929 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d130dd-2ab2-44a5-94f5-2268f7f22cb6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:28.975275 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d130dd-2ab2-44a5-94f5-2268f7f22cb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:28.976707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d130dd-2ab2-44a5-94f5-2268f7f22cb6 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:28.994316 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 645/1281] 10.222.0.13 () {56 vars in 1143 bytes} [Tue Jul 5 21:13:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:29.000200 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225ccc1-a39c-4f92-80ca-1a8e79473657 None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:29.089993 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:29.099151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225ccc1-a39c-4f92-80ca-1a8e79473657 None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:29.132122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781dcb9-f0ca-403f-8ed7-3cd498def14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:29.132754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781dcb9-f0ca-403f-8ed7-3cd498def14f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:29.133037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781dcb9-f0ca-403f-8ed7-3cd498def14f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:29.133311 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781dcb9-f0ca-403f-8ed7-3cd498def14f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:29.200367 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781dcb9-f0ca-403f-8ed7-3cd498def14f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:29.201812 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781dcb9-f0ca-403f-8ed7-3cd498def14f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:29.290054 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:29.300011 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 637/1282] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 21:13:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:13:29.305810 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d130dd-2ab2-44a5-94f5-2268f7f22cb6 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:29.368081 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:29.405295 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d130dd-2ab2-44a5-94f5-2268f7f22cb6 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:29.439507 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d43dc-ab2c-49cd-bb57-99b548b7f445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:29.440275 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d43dc-ab2c-49cd-bb57-99b548b7f445 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:29.440557 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d43dc-ab2c-49cd-bb57-99b548b7f445 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:29.440831 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d43dc-ab2c-49cd-bb57-99b548b7f445 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:29.451199 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d43dc-ab2c-49cd-bb57-99b548b7f445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:29.452638 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d43dc-ab2c-49cd-bb57-99b548b7f445 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:29.470518 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-e57d43dc-ab2c-49cd-bb57-99b548b7f445 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:13:29.470518 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:29.470518 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:29.470518 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:29.470518 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:29.470518 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:29.470518 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:29.470518 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:29.470518 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:29.470518 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:29.470518 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:29.470518 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:29.470518 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:13:29.470518 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:13:29.470518 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:13:29.471627 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:13:29.471627 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:29.471627 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:29.471627 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:29.471627 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:29.471627 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:29.471627 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:29.471627 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:29.471627 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:29.471627 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:29.471627 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:29.471627 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:29.471627 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:29.471627 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:29.471627 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:29.471627 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:29.471627 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:29.472716 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:13:29.472716 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:13:29.472716 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:13:29.472716 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:13:29.472716 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 646/1283] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:13:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:29.477379 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781dcb9-f0ca-403f-8ed7-3cd498def14f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:29.575717 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781dcb9-f0ca-403f-8ed7-3cd498def14f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:29.609628 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da59af-873c-48fd-b4d5-17f43b4da62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:29.610316 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da59af-873c-48fd-b4d5-17f43b4da62d None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:29.610596 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da59af-873c-48fd-b4d5-17f43b4da62d None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:29.610868 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da59af-873c-48fd-b4d5-17f43b4da62d None admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:29.611578 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da59af-873c-48fd-b4d5-17f43b4da62d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:29.611880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da59af-873c-48fd-b4d5-17f43b4da62d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:29.613228 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da59af-873c-48fd-b4d5-17f43b4da62d None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:29.624270 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 638/1284] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 21:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:29.629991 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d43dc-ab2c-49cd-bb57-99b548b7f445 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:29.731213 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d43dc-ab2c-49cd-bb57-99b548b7f445 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:29.745550 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:29.765872 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4649ce-d5ed-4fee-8c34-f591ec484358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:29.766719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4649ce-d5ed-4fee-8c34-f591ec484358 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:29.766997 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4649ce-d5ed-4fee-8c34-f591ec484358 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:29.767272 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4649ce-d5ed-4fee-8c34-f591ec484358 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:29.774325 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4649ce-d5ed-4fee-8c34-f591ec484358 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:29.775762 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4649ce-d5ed-4fee-8c34-f591ec484358 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:29.790024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application [None req-0c4649ce-d5ed-4fee-8c34-f591ec484358 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:13:29.790024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:29.790024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:29.790024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:29.790024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:29.790024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:29.790024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:29.790024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:29.790024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:29.790024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:29.790024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:29.790024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:29.790024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:13:29.790024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:13:29.790024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:13:29.791119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:13:29.791119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:29.791119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:29.791119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:29.791119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:29.791119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:29.791119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:29.791119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:29.791119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:29.791119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:29.791119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:29.791119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:29.791119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:29.791119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:29.791119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:29.791119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:29.791119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:29.792271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:13:29.792271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:13:29.792271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:13:29.792271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:13:29.792271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:13:29.792271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:13:29.792271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:13:29.792271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: ERROR keystone.server.flask.application Jul 05 21:13:29.792271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 647/1285] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 21:13:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:29.797061 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da59af-873c-48fd-b4d5-17f43b4da62d None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:29.847962 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:29.897018 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da59af-873c-48fd-b4d5-17f43b4da62d None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:29.929544 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623d5c0-223f-4fcb-bc81-340ec518f0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:29.930302 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623d5c0-223f-4fcb-bc81-340ec518f0d0 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:29.930666 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623d5c0-223f-4fcb-bc81-340ec518f0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:29.930950 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623d5c0-223f-4fcb-bc81-340ec518f0d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:29.931737 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623d5c0-223f-4fcb-bc81-340ec518f0d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:29.932045 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623d5c0-223f-4fcb-bc81-340ec518f0d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:29.933494 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623d5c0-223f-4fcb-bc81-340ec518f0d0 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:29.946864 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 639/1286] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 21:13:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:29.952674 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4649ce-d5ed-4fee-8c34-f591ec484358 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:30.050820 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4649ce-d5ed-4fee-8c34-f591ec484358 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:30.084338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d08b60-3036-4b05-8ae9-51afa48c71a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:30.084980 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d08b60-3036-4b05-8ae9-51afa48c71a7 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:30.085297 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d08b60-3036-4b05-8ae9-51afa48c71a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:30.085583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d08b60-3036-4b05-8ae9-51afa48c71a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:30.086386 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d08b60-3036-4b05-8ae9-51afa48c71a7 None admin] RBAC: Adding query filter params (role.id=15cf04fec8c6477088a33bf286f1bbdb, scope.project.id=1076c94b43b2483eb4fc06173f9204c3, user.id=992db9dab5944769b192a868d6637a02) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:30.086702 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d08b60-3036-4b05-8ae9-51afa48c71a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:30.088136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d08b60-3036-4b05-8ae9-51afa48c71a7 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:30.093938 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 648/1287] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 21:13:29 2022] GET /identity/v3/role_assignments?user.id=992db9dab5944769b192a868d6637a02&scope.project.id=1076c94b43b2483eb4fc06173f9204c3&role.id=15cf04fec8c6477088a33bf286f1bbdb => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:32.168413 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9b746-607f-48c3-8160-75937835fe43 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:32.168950 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9b746-607f-48c3-8160-75937835fe43 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:32.168950 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9b746-607f-48c3-8160-75937835fe43 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:32.170513 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 640/1288] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:13:32.175640 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efe91d-495d-4623-a41e-ce32f51b5c45 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:32.176038 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efe91d-495d-4623-a41e-ce32f51b5c45 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:32.176192 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efe91d-495d-4623-a41e-ce32f51b5c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:32.193054 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-25efe91d-495d-4623-a41e-ce32f51b5c45 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:13:32.195038 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-25efe91d-495d-4623-a41e-ce32f51b5c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:13:32.223815 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:32.261031 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 649/1289] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:13:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:13:32.283452 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9b746-607f-48c3-8160-75937835fe43 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:32.386382 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9b746-607f-48c3-8160-75937835fe43 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:32.397280 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:32.420503 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca874df-48b3-4ae2-93d8-2276e2283a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:32.421227 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca874df-48b3-4ae2-93d8-2276e2283a9a None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:32.421511 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca874df-48b3-4ae2-93d8-2276e2283a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:32.421790 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca874df-48b3-4ae2-93d8-2276e2283a9a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:32.422467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca874df-48b3-4ae2-93d8-2276e2283a9a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:32.423857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca874df-48b3-4ae2-93d8-2276e2283a9a None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:32.436066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-5ca874df-48b3-4ae2-93d8-2276e2283a9a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:13:32.436066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:32.436066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:13:32.436066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:13:32.436066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:13:32.436066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:13:32.436066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:13:32.436066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:13:32.436066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:13:32.436066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:13:32.436066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:13:32.436066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:13:32.436066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:32.436066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:32.436066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:32.436066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:32.436066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:32.437291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:32.437291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:32.437291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:32.437291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:32.437291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:32.437291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:32.437291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:13:32.437291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:13:32.437291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:13:32.437291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:13:32.437291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:32.437291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:32.437291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:32.437291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:32.437291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:32.437291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:32.438514 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:32.438514 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:32.438514 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:32.438514 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:32.438514 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:32.438514 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:32.438514 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:32.438514 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:32.438514 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:32.438514 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:32.438514 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:13:32.438514 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:13:32.438514 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:13:32.438514 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:13:32.442093 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 641/1290] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Jul 5 21:13:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:32.443362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efe91d-495d-4623-a41e-ce32f51b5c45 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:32.539632 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efe91d-495d-4623-a41e-ce32f51b5c45 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:32.574335 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68d307-4680-4962-b6eb-7ddbba9ffc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:32.575057 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68d307-4680-4962-b6eb-7ddbba9ffc4a None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:32.575337 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68d307-4680-4962-b6eb-7ddbba9ffc4a None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:32.575612 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68d307-4680-4962-b6eb-7ddbba9ffc4a None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:32.576310 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68d307-4680-4962-b6eb-7ddbba9ffc4a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:32.576618 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68d307-4680-4962-b6eb-7ddbba9ffc4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:32.577989 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68d307-4680-4962-b6eb-7ddbba9ffc4a None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:32.582809 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 650/1291] 10.222.0.13 () {56 vars in 1116 bytes} [Tue Jul 5 21:13:32 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:32.588808 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca874df-48b3-4ae2-93d8-2276e2283a9a None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:32.689154 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca874df-48b3-4ae2-93d8-2276e2283a9a None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:32.722583 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3c3bb-181b-490f-a3cb-bfa65d8f5e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:32.723873 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3c3bb-181b-490f-a3cb-bfa65d8f5e90 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:32.723873 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3c3bb-181b-490f-a3cb-bfa65d8f5e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:32.723873 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3c3bb-181b-490f-a3cb-bfa65d8f5e90 None admin] PATH_INFO: `/v3/services` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:32.724560 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3c3bb-181b-490f-a3cb-bfa65d8f5e90 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:32.725541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3c3bb-181b-490f-a3cb-bfa65d8f5e90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:32.727034 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3c3bb-181b-490f-a3cb-bfa65d8f5e90 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:32.731529 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 642/1292] 10.222.0.13 () {56 vars in 1116 bytes} [Tue Jul 5 21:13:32 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:34.754890 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82e8a4-926f-4481-9958-27391dd5f066 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:34.755420 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82e8a4-926f-4481-9958-27391dd5f066 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:34.755542 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82e8a4-926f-4481-9958-27391dd5f066 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:34.757452 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 651/1293] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:13:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:13:34.762742 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad83132-3997-4ecd-9407-6ccd3bec4117 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:34.763170 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad83132-3997-4ecd-9407-6ccd3bec4117 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:34.763295 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad83132-3997-4ecd-9407-6ccd3bec4117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:34.780841 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-2ad83132-3997-4ecd-9407-6ccd3bec4117 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:13:34.782023 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2ad83132-3997-4ecd-9407-6ccd3bec4117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:13:34.815634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:34.851620 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 643/1294] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:13:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:13:34.874971 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82e8a4-926f-4481-9958-27391dd5f066 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:34.906256 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:34.978057 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82e8a4-926f-4481-9958-27391dd5f066 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:35.010723 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d50628-5835-43d8-8854-1e7a25c38e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:35.011380 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d50628-5835-43d8-8854-1e7a25c38e08 None admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:35.011665 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d50628-5835-43d8-8854-1e7a25c38e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:35.011941 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d50628-5835-43d8-8854-1e7a25c38e08 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:35.012648 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d50628-5835-43d8-8854-1e7a25c38e08 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:35.014050 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d50628-5835-43d8-8854-1e7a25c38e08 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:35.077700 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 652/1295] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Jul 5 21:13:34 2022] POST /identity/v3/services => generated 246 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:13:37.122469 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2bd63-9f0f-4c4e-9232-2357730411f5 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:37.123057 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2bd63-9f0f-4c4e-9232-2357730411f5 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:37.123057 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2bd63-9f0f-4c4e-9232-2357730411f5 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:37.124495 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 644/1296] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:13:37.129676 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec633d-708e-4d8b-8a14-a8c645ca3df4 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:37.130219 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec633d-708e-4d8b-8a14-a8c645ca3df4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:37.130343 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec633d-708e-4d8b-8a14-a8c645ca3df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:37.147980 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f4ec633d-708e-4d8b-8a14-a8c645ca3df4 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:13:37.149292 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f4ec633d-708e-4d8b-8a14-a8c645ca3df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:13:37.226691 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 653/1297] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:13:37 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:13:37.249872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2bd63-9f0f-4c4e-9232-2357730411f5 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:37.353652 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2bd63-9f0f-4c4e-9232-2357730411f5 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:37.386621 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6486d-f407-4a41-9443-cd7cc56b185f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:37.387341 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6486d-f407-4a41-9443-cd7cc56b185f None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:37.387624 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6486d-f407-4a41-9443-cd7cc56b185f None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:37.387901 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6486d-f407-4a41-9443-cd7cc56b185f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:37.388546 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d6486d-f407-4a41-9443-cd7cc56b185f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:37.389909 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d6486d-f407-4a41-9443-cd7cc56b185f None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:37.404558 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-97d6486d-f407-4a41-9443-cd7cc56b185f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:13:37.404558 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:37.404558 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:13:37.404558 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:13:37.404558 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:13:37.404558 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:13:37.404558 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:13:37.404558 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:13:37.404558 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:13:37.404558 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:13:37.404558 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:13:37.404558 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:13:37.404558 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:37.404558 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:37.404558 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:37.404558 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:37.404558 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:37.405791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:37.405791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:37.405791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:37.405791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:37.405791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:37.405791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:37.405791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:13:37.405791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:13:37.405791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:13:37.405791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:13:37.405791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:37.405791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:37.405791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:37.405791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:37.405791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:37.405791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:37.407047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:37.407047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:37.407047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:37.407047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:37.407047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:37.407047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:37.407047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:37.407047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:37.407047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:37.407047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:37.407047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:13:37.407047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:13:37.407047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:13:37.407047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:13:37.407047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 645/1298] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Jul 5 21:13:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:37.412388 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec633d-708e-4d8b-8a14-a8c645ca3df4 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:37.430400 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:37.508542 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec633d-708e-4d8b-8a14-a8c645ca3df4 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:37.543520 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26106bd2-b944-4ca2-9f39-b358fce9e2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:37.544180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26106bd2-b944-4ca2-9f39-b358fce9e2e4 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:37.544463 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26106bd2-b944-4ca2-9f39-b358fce9e2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:37.544738 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26106bd2-b944-4ca2-9f39-b358fce9e2e4 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:37.545432 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26106bd2-b944-4ca2-9f39-b358fce9e2e4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:37.545744 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26106bd2-b944-4ca2-9f39-b358fce9e2e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:37.547149 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26106bd2-b944-4ca2-9f39-b358fce9e2e4 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:37.552143 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 654/1299] 10.222.0.13 () {56 vars in 1116 bytes} [Tue Jul 5 21:13:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:37.558181 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6486d-f407-4a41-9443-cd7cc56b185f None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:37.590598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:37.659832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6486d-f407-4a41-9443-cd7cc56b185f None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:37.692591 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9e42a-bccd-4091-8358-911fa103b7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:37.693882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9e42a-bccd-4091-8358-911fa103b7c2 None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:37.694182 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9e42a-bccd-4091-8358-911fa103b7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:37.694458 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9e42a-bccd-4091-8358-911fa103b7c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:37.695239 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9e42a-bccd-4091-8358-911fa103b7c2 None admin] RBAC: Adding query filter params (interface=public, service_id=891eeb7c6b8a4d67a2fecfb940744de4, region_id=RegionOne) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:37.695546 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9e42a-bccd-4091-8358-911fa103b7c2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:37.696948 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9e42a-bccd-4091-8358-911fa103b7c2 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:37.702135 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 646/1300] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Jul 5 21:13:37 2022] GET /identity/v3/endpoints?service_id=891eeb7c6b8a4d67a2fecfb940744de4&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:37.707865 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26106bd2-b944-4ca2-9f39-b358fce9e2e4 None admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:37.790213 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:37.807632 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26106bd2-b944-4ca2-9f39-b358fce9e2e4 None admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:37.840755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba6e70-7124-4146-ae7f-e92104721b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:37.841436 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba6e70-7124-4146-ae7f-e92104721b70 None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:37.841718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba6e70-7124-4146-ae7f-e92104721b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:37.841991 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba6e70-7124-4146-ae7f-e92104721b70 None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:37.842696 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba6e70-7124-4146-ae7f-e92104721b70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:37.844072 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba6e70-7124-4146-ae7f-e92104721b70 None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:37.853278 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 655/1301] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Jul 5 21:13:37 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:13:39.902665 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c26c45-6a15-4c34-84fd-46664bc3bc24 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:39.903184 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c26c45-6a15-4c34-84fd-46664bc3bc24 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:39.903184 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c26c45-6a15-4c34-84fd-46664bc3bc24 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:39.904900 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 647/1302] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:13:39.910249 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ff353-d10b-47e4-a0e7-61852a5e5e29 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:39.910689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ff353-d10b-47e4-a0e7-61852a5e5e29 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:39.910796 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ff353-d10b-47e4-a0e7-61852a5e5e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:39.928147 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-bb1ff353-d10b-47e4-a0e7-61852a5e5e29 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:13:39.929339 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-bb1ff353-d10b-47e4-a0e7-61852a5e5e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:13:39.995643 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 656/1303] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:13:39 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:13:40.018386 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c26c45-6a15-4c34-84fd-46664bc3bc24 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:40.112312 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:40.119617 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c26c45-6a15-4c34-84fd-46664bc3bc24 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:40.156328 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e2a00-f355-48da-bd87-fa9c68772b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:40.157059 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e2a00-f355-48da-bd87-fa9c68772b5b None admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:40.157348 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e2a00-f355-48da-bd87-fa9c68772b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:40.157625 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e2a00-f355-48da-bd87-fa9c68772b5b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:40.158304 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e2a00-f355-48da-bd87-fa9c68772b5b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:40.159664 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e2a00-f355-48da-bd87-fa9c68772b5b None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:40.171825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application [None req-c63e2a00-f355-48da-bd87-fa9c68772b5b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:13:40.171825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:40.171825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:13:40.171825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:13:40.171825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:13:40.171825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:13:40.171825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:13:40.171825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:13:40.171825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:13:40.171825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:13:40.171825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:13:40.171825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:13:40.171825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:13:40.171825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:13:40.171825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:13:40.171825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:13:40.171825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:13:40.173598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:13:40.173598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:13:40.173598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:13:40.173598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:13:40.173598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:13:40.173598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:13:40.173598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:13:40.173598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:13:40.173598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:13:40.173598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:13:40.173598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:13:40.173598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:13:40.173598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:13:40.173598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:13:40.173598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:13:40.173598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:13:40.174754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:13:40.174754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application with Lock( Jul 05 21:13:40.174754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:13:40.174754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:13:40.174754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:13:40.174754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:13:40.174754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:13:40.174754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:13:40.174754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:13:40.174754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:13:40.174754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:13:40.174754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:13:40.174754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:13:40.174754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: ERROR keystone.server.flask.application Jul 05 21:13:40.174754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 648/1304] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Jul 5 21:13:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:13:40.179736 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ff353-d10b-47e4-a0e7-61852a5e5e29 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:40.254109 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:40.276712 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ff353-d10b-47e4-a0e7-61852a5e5e29 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:40.309459 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abaf575-fb1f-4d8c-af6e-0ac1ae52b5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:40.310141 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaf575-fb1f-4d8c-af6e-0ac1ae52b5fa None admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:40.310428 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaf575-fb1f-4d8c-af6e-0ac1ae52b5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:40.310709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaf575-fb1f-4d8c-af6e-0ac1ae52b5fa None admin] PATH_INFO: `/v3/services` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:40.311407 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abaf575-fb1f-4d8c-af6e-0ac1ae52b5fa None admin] RBAC: Adding query filter params (name=placement) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:13:40.311719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abaf575-fb1f-4d8c-af6e-0ac1ae52b5fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:40.313085 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abaf575-fb1f-4d8c-af6e-0ac1ae52b5fa None admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:40.318197 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 657/1305] 10.222.0.13 () {56 vars in 1116 bytes} [Tue Jul 5 21:13:40 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:13:40.324076 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e2a00-f355-48da-bd87-fa9c68772b5b None admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:40.422487 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e2a00-f355-48da-bd87-fa9c68772b5b None admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:40.456725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bd34e-d1d4-4529-83c8-00e4ae881eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:40.457371 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bd34e-d1d4-4529-83c8-00e4ae881eb1 None admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:40.457655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bd34e-d1d4-4529-83c8-00e4ae881eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:40.457938 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bd34e-d1d4-4529-83c8-00e4ae881eb1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:40.458810 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bd34e-d1d4-4529-83c8-00e4ae881eb1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:40.460311 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bd34e-d1d4-4529-83c8-00e4ae881eb1 None admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:40.551359 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 649/1306] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Jul 5 21:13:40 2022] POST /identity/v3/endpoints => generated 331 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:13:50.315164 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=30 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:50.546918 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:19:38.548186 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca18e4-1088-4554-9a64-b3140bedcaa1 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:38.548780 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca18e4-1088-4554-9a64-b3140bedcaa1 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:38.549793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca18e4-1088-4554-9a64-b3140bedcaa1 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:38.558993 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e0944-9cc6-4b16-abc9-a81f83ffdfea None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:38.559450 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e0944-9cc6-4b16-abc9-a81f83ffdfea None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:38.559671 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e0944-9cc6-4b16-abc9-a81f83ffdfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:38.562456 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 658/1307] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:19:38 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:19:38.666228 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-7f9e0944-9cc6-4b16-abc9-a81f83ffdfea None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:19:38.667458 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7f9e0944-9cc6-4b16-abc9-a81f83ffdfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:38.850336 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 650/1308] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:19:38.903996 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe59fff-111f-49e9-a8fc-5b2431877065 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:38.904348 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe59fff-111f-49e9-a8fc-5b2431877065 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:38.904554 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe59fff-111f-49e9-a8fc-5b2431877065 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:38.906515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 659/1309] 10.222.0.13 () {54 vars in 964 bytes} [Tue Jul 5 21:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:19:38.916253 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b9196-952d-4d09-8136-1c35de391965 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:38.916253 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b9196-952d-4d09-8136-1c35de391965 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:38.916253 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b9196-952d-4d09-8136-1c35de391965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:39.049733 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-b79b9196-952d-4d09-8136-1c35de391965 None None] MFA Rules not processed for user `97b6b7c15770400cad4e2b52b13ad354`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:19:39.051794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b79b9196-952d-4d09-8136-1c35de391965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:39.092880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:19:39.194395 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 651/1310] 10.222.0.13 () {58 vars in 1061 bytes} [Tue Jul 5 21:19:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:19:39.203730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe59fff-111f-49e9-a8fc-5b2431877065 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:19:39.205913 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4fe59fff-111f-49e9-a8fc-5b2431877065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:39.324049 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe59fff-111f-49e9-a8fc-5b2431877065 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:19:39.400955 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f664eb5-21f8-4621-a92a-5db47eb6d806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:19:39.401520 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f664eb5-21f8-4621-a92a-5db47eb6d806 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:39.401803 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f664eb5-21f8-4621-a92a-5db47eb6d806 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:39.402082 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f664eb5-21f8-4621-a92a-5db47eb6d806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:39.403756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4f664eb5-21f8-4621-a92a-5db47eb6d806 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:39.460796 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:19:39.517581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f664eb5-21f8-4621-a92a-5db47eb6d806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:19:39.519046 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f664eb5-21f8-4621-a92a-5db47eb6d806 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:19:39.538432 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 660/1311] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:19:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:19:41.889522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570980b-35fe-49fa-9baa-193ebdf2b0d0 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:41.890074 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570980b-35fe-49fa-9baa-193ebdf2b0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:41.890074 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570980b-35fe-49fa-9baa-193ebdf2b0d0 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:41.891801 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 652/1312] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:19:41.897650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c64a5-0ac8-493b-9159-29a10c103dfc None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:41.898235 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c64a5-0ac8-493b-9159-29a10c103dfc None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:41.898235 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c64a5-0ac8-493b-9159-29a10c103dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:41.982160 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-387c64a5-0ac8-493b-9159-29a10c103dfc None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:19:41.983703 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-387c64a5-0ac8-493b-9159-29a10c103dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:42.095727 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 661/1313] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:19:42.149945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26666155-f9b0-44ef-be7d-acb6dbc16710 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:42.150236 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26666155-f9b0-44ef-be7d-acb6dbc16710 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:42.150750 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26666155-f9b0-44ef-be7d-acb6dbc16710 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:42.152291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 653/1314] 10.222.0.13 () {54 vars in 964 bytes} [Tue Jul 5 21:19:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:19:42.159003 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c51fe9-81e9-4b26-9e45-e1adb119c32d None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:42.159326 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c51fe9-81e9-4b26-9e45-e1adb119c32d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:42.159578 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c51fe9-81e9-4b26-9e45-e1adb119c32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:42.172573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:19:42.248062 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b8c51fe9-81e9-4b26-9e45-e1adb119c32d None None] MFA Rules not processed for user `97b6b7c15770400cad4e2b52b13ad354`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:19:42.249297 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b8c51fe9-81e9-4b26-9e45-e1adb119c32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:42.341939 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 662/1315] 10.222.0.13 () {58 vars in 1061 bytes} [Tue Jul 5 21:19:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:19:42.350927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26666155-f9b0-44ef-be7d-acb6dbc16710 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:19:42.352807 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-26666155-f9b0-44ef-be7d-acb6dbc16710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:42.464823 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26666155-f9b0-44ef-be7d-acb6dbc16710 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:19:42.541320 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:19:42.546892 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f01bd4-72ba-493a-b7ec-403a591c1893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:19:42.547564 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f01bd4-72ba-493a-b7ec-403a591c1893 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:42.547846 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f01bd4-72ba-493a-b7ec-403a591c1893 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:42.548120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f01bd4-72ba-493a-b7ec-403a591c1893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:42.549826 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-11f01bd4-72ba-493a-b7ec-403a591c1893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:42.666818 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f01bd4-72ba-493a-b7ec-403a591c1893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:19:42.668262 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f01bd4-72ba-493a-b7ec-403a591c1893 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:19:42.687146 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 654/1316] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:19:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:19:45.450750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6f62a-b727-493b-ba5a-c84cb38a7618 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:45.451310 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6f62a-b727-493b-ba5a-c84cb38a7618 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:45.451310 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6f62a-b727-493b-ba5a-c84cb38a7618 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:45.452728 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 663/1317] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:19:45.458163 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b66fb-135f-460b-adae-a41b9bc17b2c None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:45.458540 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b66fb-135f-460b-adae-a41b9bc17b2c None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:45.458726 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b66fb-135f-460b-adae-a41b9bc17b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:45.524691 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-4c3b66fb-135f-460b-adae-a41b9bc17b2c None None] MFA Rules not processed for user `67b27485a57e48ea95c2f4ae108b5024`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:19:45.525912 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4c3b66fb-135f-460b-adae-a41b9bc17b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:45.577115 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:19:45.623335 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 655/1318] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:19:45 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:19:45.663741 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6f62a-b727-493b-ba5a-c84cb38a7618 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:19:45.665612 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-99b6f62a-b727-493b-ba5a-c84cb38a7618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:45.769611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6f62a-b727-493b-ba5a-c84cb38a7618 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:19:45.772406 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:19:45.843520 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fd02b-fda0-450b-8d4d-ab727c9f624c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:19:45.844163 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fd02b-fda0-450b-8d4d-ab727c9f624c service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:45.844448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fd02b-fda0-450b-8d4d-ab727c9f624c service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:45.844726 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fd02b-fda0-450b-8d4d-ab727c9f624c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:45.846488 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-052fd02b-fda0-450b-8d4d-ab727c9f624c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:45.953911 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052fd02b-fda0-450b-8d4d-ab727c9f624c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:19:45.955644 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052fd02b-fda0-450b-8d4d-ab727c9f624c service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:19:45.974038 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 664/1319] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:19:45 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:19:48.807312 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8501da-4524-4ce9-aa02-67d79977adf3 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:48.807836 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8501da-4524-4ce9-aa02-67d79977adf3 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:48.807836 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8501da-4524-4ce9-aa02-67d79977adf3 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:48.809147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 656/1320] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:19:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:19:48.814372 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a571e-69a4-4ddf-9479-debf3b4cf71a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:48.814776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a571e-69a4-4ddf-9479-debf3b4cf71a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:48.814923 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a571e-69a4-4ddf-9479-debf3b4cf71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:48.853558 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:19:48.878959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-5c7a571e-69a4-4ddf-9479-debf3b4cf71a None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:19:48.880161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5c7a571e-69a4-4ddf-9479-debf3b4cf71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:48.975951 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 665/1321] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:19:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:19:49.017341 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8501da-4524-4ce9-aa02-67d79977adf3 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:19:49.018970 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-bb8501da-4524-4ce9-aa02-67d79977adf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:49.121707 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8501da-4524-4ce9-aa02-67d79977adf3 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:19:49.197642 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f228860-5d6e-4816-9042-ddeccd1aeb23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:19:49.198310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f228860-5d6e-4816-9042-ddeccd1aeb23 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:49.198596 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f228860-5d6e-4816-9042-ddeccd1aeb23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:49.198868 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f228860-5d6e-4816-9042-ddeccd1aeb23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:49.200530 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7f228860-5d6e-4816-9042-ddeccd1aeb23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:49.208092 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:19:49.310724 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f228860-5d6e-4816-9042-ddeccd1aeb23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:19:49.312144 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f228860-5d6e-4816-9042-ddeccd1aeb23 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:19:49.329724 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 657/1322] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:19:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:19:52.382602 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51212231-a036-4e05-93f4-f61f6477d75b None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:52.383163 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51212231-a036-4e05-93f4-f61f6477d75b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:52.383163 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51212231-a036-4e05-93f4-f61f6477d75b None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:52.384821 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 666/1323] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:19:52.389971 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abb82e-2d75-4b8b-8174-663639931eaf None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:52.390396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abb82e-2d75-4b8b-8174-663639931eaf None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:52.390570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abb82e-2d75-4b8b-8174-663639931eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:52.456240 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-78abb82e-2d75-4b8b-8174-663639931eaf None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:19:52.457485 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-78abb82e-2d75-4b8b-8174-663639931eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:52.517918 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:19:52.565971 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 658/1324] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:19:52.594690 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51212231-a036-4e05-93f4-f61f6477d75b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:19:52.596414 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-51212231-a036-4e05-93f4-f61f6477d75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:52.713758 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51212231-a036-4e05-93f4-f61f6477d75b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:19:52.726162 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:19:52.791535 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f5401-8e12-4a9e-be2e-1e664621d388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:19:52.792180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f5401-8e12-4a9e-be2e-1e664621d388 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:52.792463 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f5401-8e12-4a9e-be2e-1e664621d388 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:52.792739 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f5401-8e12-4a9e-be2e-1e664621d388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:52.794416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-064f5401-8e12-4a9e-be2e-1e664621d388 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:52.903433 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f5401-8e12-4a9e-be2e-1e664621d388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:19:52.904882 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f5401-8e12-4a9e-be2e-1e664621d388 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:19:52.923744 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 667/1325] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:19:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:19:55.028759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114b1c0-0855-4871-b595-994feb32b760 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:55.029303 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114b1c0-0855-4871-b595-994feb32b760 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:55.029303 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114b1c0-0855-4871-b595-994feb32b760 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:55.030742 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 659/1326] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:19:55.035868 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9619e9e-be21-4796-af2e-74b7537a2c34 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:55.036283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9619e9e-be21-4796-af2e-74b7537a2c34 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:55.036430 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9619e9e-be21-4796-af2e-74b7537a2c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:55.085219 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:19:55.103993 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-c9619e9e-be21-4796-af2e-74b7537a2c34 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:19:55.105257 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c9619e9e-be21-4796-af2e-74b7537a2c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:55.205349 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 668/1327] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:19:55.241333 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114b1c0-0855-4871-b595-994feb32b760 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:19:55.243647 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7114b1c0-0855-4871-b595-994feb32b760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:55.346357 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114b1c0-0855-4871-b595-994feb32b760 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:19:55.420213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edaa81a-7371-4f80-bd22-505971727651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:19:55.420862 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaa81a-7371-4f80-bd22-505971727651 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:55.421148 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaa81a-7371-4f80-bd22-505971727651 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:55.421421 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaa81a-7371-4f80-bd22-505971727651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:55.423101 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6edaa81a-7371-4f80-bd22-505971727651 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:55.440838 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:19:55.536885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edaa81a-7371-4f80-bd22-505971727651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:19:55.538356 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edaa81a-7371-4f80-bd22-505971727651 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:19:55.557429 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 660/1328] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:19:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:19:57.665516 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa1840-9cdc-47e7-b082-6b5dbed6d402 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:57.666175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa1840-9cdc-47e7-b082-6b5dbed6d402 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:57.666175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa1840-9cdc-47e7-b082-6b5dbed6d402 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:57.667534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 669/1329] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:19:57.672655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890ab4f-956c-4034-af5b-f8f51b8ff3d0 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:57.673103 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890ab4f-956c-4034-af5b-f8f51b8ff3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:57.673287 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890ab4f-956c-4034-af5b-f8f51b8ff3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:57.739300 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-b890ab4f-956c-4034-af5b-f8f51b8ff3d0 None None] MFA Rules not processed for user `67b27485a57e48ea95c2f4ae108b5024`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:19:57.740499 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b890ab4f-956c-4034-af5b-f8f51b8ff3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:57.808360 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:19:57.841143 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 661/1330] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:19:57 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:19:57.878781 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa1840-9cdc-47e7-b082-6b5dbed6d402 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:19:57.880360 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-74fa1840-9cdc-47e7-b082-6b5dbed6d402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:57.985592 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa1840-9cdc-47e7-b082-6b5dbed6d402 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:19:58.005838 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:19:58.060212 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f44880-2bd1-4c8f-a35b-a3639434b619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:19:58.060789 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f44880-2bd1-4c8f-a35b-a3639434b619 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:58.061076 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f44880-2bd1-4c8f-a35b-a3639434b619 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:58.061353 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f44880-2bd1-4c8f-a35b-a3639434b619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:58.063041 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-45f44880-2bd1-4c8f-a35b-a3639434b619 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:58.173856 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f44880-2bd1-4c8f-a35b-a3639434b619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:19:58.175328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f44880-2bd1-4c8f-a35b-a3639434b619 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:19:58.194627 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 670/1331] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:19:57 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:20:00.720420 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173a0c6-8838-4cdb-b0e0-42c60f1322cc None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:00.720936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173a0c6-8838-4cdb-b0e0-42c60f1322cc None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:00.721031 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173a0c6-8838-4cdb-b0e0-42c60f1322cc None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:00.722401 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 662/1332] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:20:00.728341 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d2b5b-7cb3-4308-bf90-a9f83cdbd6ee None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:00.728809 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d2b5b-7cb3-4308-bf90-a9f83cdbd6ee None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:00.728931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d2b5b-7cb3-4308-bf90-a9f83cdbd6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:00.792532 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:20:00.795300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-966d2b5b-7cb3-4308-bf90-a9f83cdbd6ee None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:20:00.796528 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-966d2b5b-7cb3-4308-bf90-a9f83cdbd6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:00.894036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 671/1333] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:20:00.931312 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173a0c6-8838-4cdb-b0e0-42c60f1322cc None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:20:00.932893 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f173a0c6-8838-4cdb-b0e0-42c60f1322cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:01.038864 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173a0c6-8838-4cdb-b0e0-42c60f1322cc None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:20:01.113004 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58957867-2914-41f1-9700-f50cbc84b24c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:20:01.113660 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58957867-2914-41f1-9700-f50cbc84b24c service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:01.113940 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58957867-2914-41f1-9700-f50cbc84b24c service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:01.114244 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58957867-2914-41f1-9700-f50cbc84b24c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:01.115896 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-58957867-2914-41f1-9700-f50cbc84b24c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:01.143104 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:20:01.225688 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58957867-2914-41f1-9700-f50cbc84b24c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:20:01.227150 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58957867-2914-41f1-9700-f50cbc84b24c service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:20:01.245403 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 663/1334] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:20:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:20:03.349216 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c2c6e-d412-46d4-9eb0-50fa50c0789e None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:03.349783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c2c6e-d412-46d4-9eb0-50fa50c0789e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:03.349783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c2c6e-d412-46d4-9eb0-50fa50c0789e None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:03.351214 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 672/1335] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:20:03.357280 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384af666-3da3-4aac-88da-929ddc0a47ca None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:03.357683 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384af666-3da3-4aac-88da-929ddc0a47ca None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:03.357847 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384af666-3da3-4aac-88da-929ddc0a47ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:03.422350 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-384af666-3da3-4aac-88da-929ddc0a47ca None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:20:03.423571 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-384af666-3da3-4aac-88da-929ddc0a47ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:03.495325 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:20:03.517150 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 664/1336] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:20:03.557301 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c2c6e-d412-46d4-9eb0-50fa50c0789e None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:20:03.558879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c20c2c6e-d412-46d4-9eb0-50fa50c0789e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:03.664977 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c2c6e-d412-46d4-9eb0-50fa50c0789e None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:20:03.692171 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:20:03.737555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f1dea-c25d-4ae9-818f-3e90d574a4df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:20:03.738217 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f1dea-c25d-4ae9-818f-3e90d574a4df service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:03.738497 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f1dea-c25d-4ae9-818f-3e90d574a4df service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:03.738767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f1dea-c25d-4ae9-818f-3e90d574a4df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:03.740391 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-794f1dea-c25d-4ae9-818f-3e90d574a4df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:03.847321 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f1dea-c25d-4ae9-818f-3e90d574a4df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:20:03.848734 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f1dea-c25d-4ae9-818f-3e90d574a4df service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:20:03.867028 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 673/1337] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:20:06.467929 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143d1cd-69bf-430b-b14c-0166cfc8eb3d None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:06.468767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143d1cd-69bf-430b-b14c-0166cfc8eb3d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:06.468940 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143d1cd-69bf-430b-b14c-0166cfc8eb3d None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:06.470360 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 665/1338] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:20:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:20:06.475562 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629902c-edc0-4d95-b202-a06a8076a8e0 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:06.475997 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629902c-edc0-4d95-b202-a06a8076a8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:06.476127 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629902c-edc0-4d95-b202-a06a8076a8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:06.539514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-5629902c-edc0-4d95-b202-a06a8076a8e0 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:20:06.540842 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5629902c-edc0-4d95-b202-a06a8076a8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:06.548866 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:20:06.636391 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 674/1339] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:20:06 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:20:06.671529 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143d1cd-69bf-430b-b14c-0166cfc8eb3d None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:20:06.673104 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8143d1cd-69bf-430b-b14c-0166cfc8eb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:06.776506 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143d1cd-69bf-430b-b14c-0166cfc8eb3d None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:20:06.850036 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e49b7b-c758-4ed1-901a-1affeb998cb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:20:06.850696 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e49b7b-c758-4ed1-901a-1affeb998cb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:06.850975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e49b7b-c758-4ed1-901a-1affeb998cb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:06.851246 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e49b7b-c758-4ed1-901a-1affeb998cb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:06.853219 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-54e49b7b-c758-4ed1-901a-1affeb998cb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:06.888849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:20:06.962406 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e49b7b-c758-4ed1-901a-1affeb998cb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:20:06.963829 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e49b7b-c758-4ed1-901a-1affeb998cb5 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:20:06.982355 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 666/1340] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:20:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:20:11.262892 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196b9b6-6e1d-4cb2-883a-586489c7cf61 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:11.263449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196b9b6-6e1d-4cb2-883a-586489c7cf61 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:11.263557 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196b9b6-6e1d-4cb2-883a-586489c7cf61 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:11.265049 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 675/1341] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:20:11.270566 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38750d-b12f-441d-bf26-e13a953b2c11 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:11.270969 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38750d-b12f-441d-bf26-e13a953b2c11 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:11.271135 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38750d-b12f-441d-bf26-e13a953b2c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:11.356229 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-fb38750d-b12f-441d-bf26-e13a953b2c11 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:20:11.357497 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-fb38750d-b12f-441d-bf26-e13a953b2c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:11.451637 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:20:11.465711 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 667/1342] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:20:11.504764 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196b9b6-6e1d-4cb2-883a-586489c7cf61 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:20:11.507014 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8196b9b6-6e1d-4cb2-883a-586489c7cf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:11.607582 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196b9b6-6e1d-4cb2-883a-586489c7cf61 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:20:11.611147 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac72d2-9291-4999-859e-7d2d62e42328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:20:11.611785 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac72d2-9291-4999-859e-7d2d62e42328 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:11.612064 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac72d2-9291-4999-859e-7d2d62e42328 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:11.612337 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac72d2-9291-4999-859e-7d2d62e42328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:11.622054 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac72d2-9291-4999-859e-7d2d62e42328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:20:11.623505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac72d2-9291-4999-859e-7d2d62e42328 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:20:11.632845 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 676/1343] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:20:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:20:14.879024 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855140c-b776-4845-a667-d529c317c359 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:14.879563 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855140c-b776-4845-a667-d529c317c359 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:14.879563 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855140c-b776-4845-a667-d529c317c359 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:14.880925 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 668/1344] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:20:14.887374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5287a06-1303-4b4d-8cac-e9b1144ac512 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:14.887803 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5287a06-1303-4b4d-8cac-e9b1144ac512 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:14.888000 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5287a06-1303-4b4d-8cac-e9b1144ac512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:14.917625 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e5287a06-1303-4b4d-8cac-e9b1144ac512 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:20:14.918846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e5287a06-1303-4b4d-8cac-e9b1144ac512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:14.947635 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:20:14.998224 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 677/1345] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:20:14 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:20:15.035562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855140c-b776-4845-a667-d529c317c359 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:20:15.046229 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855140c-b776-4845-a667-d529c317c359 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:20:15.049682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa59fe-32c0-43be-91e4-91fab9c2d0fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:20:15.050388 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa59fe-32c0-43be-91e4-91fab9c2d0fc service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:15.050667 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa59fe-32c0-43be-91e4-91fab9c2d0fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:15.050939 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa59fe-32c0-43be-91e4-91fab9c2d0fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:15.060549 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa59fe-32c0-43be-91e4-91fab9c2d0fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:20:15.062005 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa59fe-32c0-43be-91e4-91fab9c2d0fc service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:20:15.071991 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 669/1346] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:20:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:20:19.335395 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7be46-8bfa-4005-b77a-05aa478e342a None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:19.336086 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7be46-8bfa-4005-b77a-05aa478e342a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:19.336086 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7be46-8bfa-4005-b77a-05aa478e342a None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:19.337909 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 678/1347] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:20:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:20:19.343246 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d209b-15e7-4c1a-b995-739b3077f733 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:19.343683 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d209b-15e7-4c1a-b995-739b3077f733 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:19.343845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d209b-15e7-4c1a-b995-739b3077f733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:19.361448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-910d209b-15e7-4c1a-b995-739b3077f733 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:20:19.362695 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-910d209b-15e7-4c1a-b995-739b3077f733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:19.370845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 670/1348] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:20:19.409146 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7be46-8bfa-4005-b77a-05aa478e342a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:20:19.419884 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7be46-8bfa-4005-b77a-05aa478e342a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:20:19.423621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab210884-141e-4904-aa65-25df8d504fc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:20:19.424665 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab210884-141e-4904-aa65-25df8d504fc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:19.425018 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab210884-141e-4904-aa65-25df8d504fc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:19.425366 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab210884-141e-4904-aa65-25df8d504fc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:19.435694 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab210884-141e-4904-aa65-25df8d504fc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:20:19.437135 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab210884-141e-4904-aa65-25df8d504fc8 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:20:19.448269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 679/1349] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:20:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:20:24.484252 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de714-6fbc-4d4d-87bf-2bdfe4ac676e None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:24.485288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de714-6fbc-4d4d-87bf-2bdfe4ac676e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:24.485725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de714-6fbc-4d4d-87bf-2bdfe4ac676e None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:24.487600 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 671/1350] 10.222.0.13 () {54 vars in 921 bytes} [Tue Jul 5 21:20:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:20:24.492987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7589a6-7f7e-4360-8b7b-f4a38d8fb135 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:24.493520 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7589a6-7f7e-4360-8b7b-f4a38d8fb135 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:24.493520 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7589a6-7f7e-4360-8b7b-f4a38d8fb135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:24.568948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-ac7589a6-7f7e-4360-8b7b-f4a38d8fb135 None None] MFA Rules not processed for user `992db9dab5944769b192a868d6637a02`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:20:24.575884 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ac7589a6-7f7e-4360-8b7b-f4a38d8fb135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:24.663321 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 680/1351] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Jul 5 21:20:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:20:28.774299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8c9fa-9e6d-44fa-86f7-32c7ae823a48 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:28.774880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8c9fa-9e6d-44fa-86f7-32c7ae823a48 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:28.774880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8c9fa-9e6d-44fa-86f7-32c7ae823a48 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:28.776390 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 672/1352] 10.222.0.13 () {54 vars in 921 bytes} [Tue Jul 5 21:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:20:28.781522 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2336a73-5011-4652-b61d-54fe95d6a988 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:28.782423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2336a73-5011-4652-b61d-54fe95d6a988 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:28.782776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2336a73-5011-4652-b61d-54fe95d6a988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:28.801915 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f2336a73-5011-4652-b61d-54fe95d6a988 None None] MFA Rules not processed for user `992db9dab5944769b192a868d6637a02`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:20:28.803237 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f2336a73-5011-4652-b61d-54fe95d6a988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:28.812835 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 681/1353] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Jul 5 21:20:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:20:29.356447 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=13 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:20:30.313609 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514c05b-0519-4f83-82b4-f6926927fc90 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:30.314278 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514c05b-0519-4f83-82b4-f6926927fc90 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:30.314278 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514c05b-0519-4f83-82b4-f6926927fc90 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:30.315604 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 673/1354] 10.222.0.13 () {54 vars in 921 bytes} [Tue Jul 5 21:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:20:30.321435 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b30ceb-fc12-4238-803e-ad190944e09a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:30.321965 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b30ceb-fc12-4238-803e-ad190944e09a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:30.322050 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b30ceb-fc12-4238-803e-ad190944e09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:30.342635 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-10b30ceb-fc12-4238-803e-ad190944e09a None None] MFA Rules not processed for user `992db9dab5944769b192a868d6637a02`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:20:30.343948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-10b30ceb-fc12-4238-803e-ad190944e09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:30.353363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 682/1355] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Jul 5 21:20:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:20:34.003007 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6b996-9033-4949-9159-624ee113da44 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:34.003949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6b996-9033-4949-9159-624ee113da44 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:34.004438 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6b996-9033-4949-9159-624ee113da44 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:34.007338 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 674/1356] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:20:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:20:34.012094 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4b71b-5a99-4c7f-96c0-5380fe9d38cb None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:34.012544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4b71b-5a99-4c7f-96c0-5380fe9d38cb None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:34.012544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4b71b-5a99-4c7f-96c0-5380fe9d38cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:34.037052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-40e4b71b-5a99-4c7f-96c0-5380fe9d38cb None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:20:34.038645 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-40e4b71b-5a99-4c7f-96c0-5380fe9d38cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:34.049194 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 683/1357] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:20:34.110235 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456b19d-06d6-443d-abc9-33c0e85de309 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:34.111013 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456b19d-06d6-443d-abc9-33c0e85de309 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:34.111527 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456b19d-06d6-443d-abc9-33c0e85de309 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:34.113636 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 675/1358] 10.222.0.13 () {54 vars in 961 bytes} [Tue Jul 5 21:20:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:20:34.123947 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b391e2-6889-43cb-8c39-0c9b72b0df2c None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:34.124235 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b391e2-6889-43cb-8c39-0c9b72b0df2c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:34.124780 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b391e2-6889-43cb-8c39-0c9b72b0df2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:34.169601 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:20:34.177691 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-30b391e2-6889-43cb-8c39-0c9b72b0df2c None None] MFA Rules not processed for user `910cd341df8943f18af2765e2a30b238`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:20:34.178969 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-30b391e2-6889-43cb-8c39-0c9b72b0df2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:34.265389 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 684/1359] 10.222.0.13 () {58 vars in 1058 bytes} [Tue Jul 5 21:20:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:20:34.274741 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456b19d-06d6-443d-abc9-33c0e85de309 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:20:34.290146 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456b19d-06d6-443d-abc9-33c0e85de309 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:20:34.295729 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4ff8b-df69-43ce-a68c-0608dad18fed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:20:34.296376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4ff8b-df69-43ce-a68c-0608dad18fed service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:34.296665 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4ff8b-df69-43ce-a68c-0608dad18fed service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:34.296943 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4ff8b-df69-43ce-a68c-0608dad18fed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:34.306002 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4ff8b-df69-43ce-a68c-0608dad18fed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:20:34.307643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4ff8b-df69-43ce-a68c-0608dad18fed service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:20:34.318764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 676/1360] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:20:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:20:36.568742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d08070-3cc3-4033-ad6a-c33d7969d0dc None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:36.569301 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d08070-3cc3-4033-ad6a-c33d7969d0dc None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:36.569301 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d08070-3cc3-4033-ad6a-c33d7969d0dc None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:36.571266 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 685/1361] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:20:36.576332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609f731-8e27-473f-918b-ec3cf6cea25b None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:36.576789 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609f731-8e27-473f-918b-ec3cf6cea25b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:36.576873 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609f731-8e27-473f-918b-ec3cf6cea25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:36.606591 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-e609f731-8e27-473f-918b-ec3cf6cea25b None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:20:36.607787 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e609f731-8e27-473f-918b-ec3cf6cea25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:36.616106 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 677/1362] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:20:36.661252 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d08070-3cc3-4033-ad6a-c33d7969d0dc None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:20:36.677317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d08070-3cc3-4033-ad6a-c33d7969d0dc None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:20:36.686040 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a1197-a39e-4ebf-a4a3-0e836adb18a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:20:36.687344 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a1197-a39e-4ebf-a4a3-0e836adb18a1 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:36.687831 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a1197-a39e-4ebf-a4a3-0e836adb18a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:36.688325 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a1197-a39e-4ebf-a4a3-0e836adb18a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:36.699009 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a1197-a39e-4ebf-a4a3-0e836adb18a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:20:36.700598 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a1197-a39e-4ebf-a4a3-0e836adb18a1 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:20:36.710536 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 686/1363] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:20:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:20:39.230162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00356c-b6af-43be-a437-97c7338ce69d None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:39.230636 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00356c-b6af-43be-a437-97c7338ce69d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:39.230636 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00356c-b6af-43be-a437-97c7338ce69d None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:39.232616 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 678/1364] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:20:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:20:39.239091 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69942df0-e9e7-4916-baef-3302c4ef7480 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:39.239091 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69942df0-e9e7-4916-baef-3302c4ef7480 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:39.239091 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69942df0-e9e7-4916-baef-3302c4ef7480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:39.261858 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-69942df0-e9e7-4916-baef-3302c4ef7480 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:20:39.263411 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-69942df0-e9e7-4916-baef-3302c4ef7480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:39.272106 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 687/1365] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:20:39.322467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5866409-e4d2-4734-9072-b0f5ec161440 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:39.322992 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5866409-e4d2-4734-9072-b0f5ec161440 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:39.323271 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5866409-e4d2-4734-9072-b0f5ec161440 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:39.324640 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 679/1366] 10.222.0.13 () {54 vars in 961 bytes} [Tue Jul 5 21:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:20:39.330301 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7786e4-3e6c-4e85-8253-599d04d8fc8f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:39.330667 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7786e4-3e6c-4e85-8253-599d04d8fc8f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:39.331070 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7786e4-3e6c-4e85-8253-599d04d8fc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:39.350797 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-ac7786e4-3e6c-4e85-8253-599d04d8fc8f None None] MFA Rules not processed for user `910cd341df8943f18af2765e2a30b238`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:20:39.352032 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ac7786e4-3e6c-4e85-8253-599d04d8fc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:39.361251 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 688/1367] 10.222.0.13 () {58 vars in 1058 bytes} [Tue Jul 5 21:20:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:20:39.369551 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5866409-e4d2-4734-9072-b0f5ec161440 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:20:39.384607 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5866409-e4d2-4734-9072-b0f5ec161440 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:20:39.390378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa74f7-9348-4672-8065-b4acdf6595d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:20:39.391011 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa74f7-9348-4672-8065-b4acdf6595d7 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:39.391298 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa74f7-9348-4672-8065-b4acdf6595d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:39.391579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa74f7-9348-4672-8065-b4acdf6595d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:39.400063 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa74f7-9348-4672-8065-b4acdf6595d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:20:39.401634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa74f7-9348-4672-8065-b4acdf6595d7 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:20:39.411042 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 680/1368] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:20:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:20:41.695419 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54aa408-ac51-4c6e-a8b1-65b56957282c None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:41.695968 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54aa408-ac51-4c6e-a8b1-65b56957282c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:41.695968 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54aa408-ac51-4c6e-a8b1-65b56957282c None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:41.697647 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 689/1369] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:20:41.702731 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cde427-39d6-4e67-8bfa-dde55b2a0ee8 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:41.703145 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cde427-39d6-4e67-8bfa-dde55b2a0ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:41.703286 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cde427-39d6-4e67-8bfa-dde55b2a0ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:41.722410 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-97cde427-39d6-4e67-8bfa-dde55b2a0ee8 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:20:41.723616 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-97cde427-39d6-4e67-8bfa-dde55b2a0ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:41.733561 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 681/1370] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:20:41.778924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54aa408-ac51-4c6e-a8b1-65b56957282c None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:20:41.793915 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54aa408-ac51-4c6e-a8b1-65b56957282c None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:20:41.799371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d9e43-f4dd-491c-8450-2ea683a72be8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:20:41.800013 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d9e43-f4dd-491c-8450-2ea683a72be8 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:41.800296 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d9e43-f4dd-491c-8450-2ea683a72be8 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:41.800572 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d9e43-f4dd-491c-8450-2ea683a72be8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:41.809928 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d9e43-f4dd-491c-8450-2ea683a72be8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:20:41.811559 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d9e43-f4dd-491c-8450-2ea683a72be8 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:20:41.821772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 690/1371] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:20:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:20:42.301944 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02a5bc-ab47-47b8-83d1-a644c2b6a65b None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:42.302269 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02a5bc-ab47-47b8-83d1-a644c2b6a65b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:42.302841 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02a5bc-ab47-47b8-83d1-a644c2b6a65b None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:42.304345 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 682/1372] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:20:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:20:42.309896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ceb03-a74d-45c9-9e5d-af71eb6622ed None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:42.310217 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ceb03-a74d-45c9-9e5d-af71eb6622ed None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:42.310499 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ceb03-a74d-45c9-9e5d-af71eb6622ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:42.328789 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-668ceb03-a74d-45c9-9e5d-af71eb6622ed None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:20:42.330001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-668ceb03-a74d-45c9-9e5d-af71eb6622ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:42.338924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 691/1373] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:20:42.682472 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18d69d-ec3f-4e2e-ac1f-4fe2c9bef634 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:42.682472 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18d69d-ec3f-4e2e-ac1f-4fe2c9bef634 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:42.682472 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18d69d-ec3f-4e2e-ac1f-4fe2c9bef634 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:42.685568 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 683/1374] 10.222.0.13 () {54 vars in 963 bytes} [Tue Jul 5 21:20:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:20:42.690960 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7883643-144c-408c-9ab8-6c7e67616503 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:42.691618 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7883643-144c-408c-9ab8-6c7e67616503 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:42.692100 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7883643-144c-408c-9ab8-6c7e67616503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:42.748357 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-a7883643-144c-408c-9ab8-6c7e67616503 None None] MFA Rules not processed for user `6d59037633db47efa1ed340055bf520a`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:20:42.749584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a7883643-144c-408c-9ab8-6c7e67616503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:42.815524 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 692/1375] 10.222.0.13 () {58 vars in 1060 bytes} [Tue Jul 5 21:20:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:20:42.823241 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18d69d-ec3f-4e2e-ac1f-4fe2c9bef634 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:20:42.833859 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18d69d-ec3f-4e2e-ac1f-4fe2c9bef634 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:20:42.838091 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee98c1-c4b4-425a-9442-fa0ba53fd215 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:20:42.838781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee98c1-c4b4-425a-9442-fa0ba53fd215 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:42.839064 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee98c1-c4b4-425a-9442-fa0ba53fd215 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:42.839338 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee98c1-c4b4-425a-9442-fa0ba53fd215 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:42.849201 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee98c1-c4b4-425a-9442-fa0ba53fd215 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:20:42.850682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee98c1-c4b4-425a-9442-fa0ba53fd215 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:20:42.862075 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 684/1376] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:20:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:20:44.089364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21f0e4-e614-4c09-9c02-d49457e57f70 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:44.089913 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21f0e4-e614-4c09-9c02-d49457e57f70 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:44.089913 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21f0e4-e614-4c09-9c02-d49457e57f70 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:44.091327 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 693/1377] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:20:44.096396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd74ecd-65fa-40ef-9641-5fc913624d9f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:44.096825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd74ecd-65fa-40ef-9641-5fc913624d9f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:44.096955 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd74ecd-65fa-40ef-9641-5fc913624d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:44.115440 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-7fd74ecd-65fa-40ef-9641-5fc913624d9f None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:20:44.116637 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7fd74ecd-65fa-40ef-9641-5fc913624d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:44.124780 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 685/1378] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:20:44.168718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21f0e4-e614-4c09-9c02-d49457e57f70 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:20:44.183016 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21f0e4-e614-4c09-9c02-d49457e57f70 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:20:44.188417 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744af21-fec5-46fa-855f-feb243a13c82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:20:44.189038 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744af21-fec5-46fa-855f-feb243a13c82 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:44.189319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744af21-fec5-46fa-855f-feb243a13c82 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:44.189596 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744af21-fec5-46fa-855f-feb243a13c82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:44.198837 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744af21-fec5-46fa-855f-feb243a13c82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:20:44.200455 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744af21-fec5-46fa-855f-feb243a13c82 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:20:44.204381 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:20:44.210430 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 694/1379] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:20:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:20:46.474177 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8ca6d-1c76-4f96-bd32-17b9590a40a4 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:46.474697 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8ca6d-1c76-4f96-bd32-17b9590a40a4 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:46.474697 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8ca6d-1c76-4f96-bd32-17b9590a40a4 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:46.476119 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 686/1380] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:20:46.481450 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6629b-9660-44a7-8835-5c76ac9d984c None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:46.481900 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6629b-9660-44a7-8835-5c76ac9d984c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:46.481999 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6629b-9660-44a7-8835-5c76ac9d984c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:46.499588 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-60c6629b-9660-44a7-8835-5c76ac9d984c None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:20:46.500776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-60c6629b-9660-44a7-8835-5c76ac9d984c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:46.512287 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 695/1381] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:20:46.555364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8ca6d-1c76-4f96-bd32-17b9590a40a4 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:20:46.573416 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8ca6d-1c76-4f96-bd32-17b9590a40a4 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:20:46.582267 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63c5f0-c2fa-46e5-8d31-7643c1a04db7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:20:46.583379 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63c5f0-c2fa-46e5-8d31-7643c1a04db7 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:46.583927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63c5f0-c2fa-46e5-8d31-7643c1a04db7 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:46.584366 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63c5f0-c2fa-46e5-8d31-7643c1a04db7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:46.597739 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c63c5f0-c2fa-46e5-8d31-7643c1a04db7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:20:46.602065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c63c5f0-c2fa-46e5-8d31-7643c1a04db7 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:20:46.619914 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 687/1382] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:20:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:20:48.800462 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdcf0f-d4b6-424e-8a0b-4a96a11c2ae9 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:48.801009 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdcf0f-d4b6-424e-8a0b-4a96a11c2ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:48.801009 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdcf0f-d4b6-424e-8a0b-4a96a11c2ae9 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:48.802420 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 696/1383] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:20:48.808194 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ac9fc-35cc-44a3-9b6c-d3bd8fb27985 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:48.808649 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ac9fc-35cc-44a3-9b6c-d3bd8fb27985 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:48.808732 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ac9fc-35cc-44a3-9b6c-d3bd8fb27985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:48.827064 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-c52ac9fc-35cc-44a3-9b6c-d3bd8fb27985 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:20:48.828260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c52ac9fc-35cc-44a3-9b6c-d3bd8fb27985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:48.836392 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 688/1384] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:20:48.877049 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdcf0f-d4b6-424e-8a0b-4a96a11c2ae9 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:20:48.893548 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdcf0f-d4b6-424e-8a0b-4a96a11c2ae9 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:20:48.899802 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa49005-4815-4eb4-8522-8ec5fab97500 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:20:48.900507 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa49005-4815-4eb4-8522-8ec5fab97500 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:48.900794 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa49005-4815-4eb4-8522-8ec5fab97500 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:48.905773 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa49005-4815-4eb4-8522-8ec5fab97500 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:48.909907 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa49005-4815-4eb4-8522-8ec5fab97500 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:20:48.911595 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa49005-4815-4eb4-8522-8ec5fab97500 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:20:48.921757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 697/1385] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:20:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:20:51.014637 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb96a9-8ede-41f1-b09c-edc8cbf0b5bc None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:51.015192 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb96a9-8ede-41f1-b09c-edc8cbf0b5bc None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:51.015337 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb96a9-8ede-41f1-b09c-edc8cbf0b5bc None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:51.017178 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 689/1386] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:20:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:20:51.023952 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa13dc4-203e-408f-8910-ee8449e0c392 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:51.024407 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa13dc4-203e-408f-8910-ee8449e0c392 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:51.024523 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa13dc4-203e-408f-8910-ee8449e0c392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:51.043386 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-ffa13dc4-203e-408f-8910-ee8449e0c392 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:20:51.044607 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ffa13dc4-203e-408f-8910-ee8449e0c392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:51.052729 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 698/1387] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:20:51.109948 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb96a9-8ede-41f1-b09c-edc8cbf0b5bc None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:20:51.128566 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb96a9-8ede-41f1-b09c-edc8cbf0b5bc None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:20:51.136216 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57d4b4-cf98-41ea-b9c2-c9f74b4b36ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:20:51.137067 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57d4b4-cf98-41ea-b9c2-c9f74b4b36ad service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:51.137437 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57d4b4-cf98-41ea-b9c2-c9f74b4b36ad service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:51.137789 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57d4b4-cf98-41ea-b9c2-c9f74b4b36ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:51.150111 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57d4b4-cf98-41ea-b9c2-c9f74b4b36ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:20:51.152109 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57d4b4-cf98-41ea-b9c2-c9f74b4b36ad service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:20:51.165489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 690/1388] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:20:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:20:53.342351 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e85011-8cf5-4073-96a8-97d1071ea346 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:53.343022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e85011-8cf5-4073-96a8-97d1071ea346 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:53.343022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e85011-8cf5-4073-96a8-97d1071ea346 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:53.344271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 699/1389] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:20:53.350018 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2cf33-36d4-43d3-b730-b061e1b0dc9e None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:53.350669 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2cf33-36d4-43d3-b730-b061e1b0dc9e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:53.351866 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2cf33-36d4-43d3-b730-b061e1b0dc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:53.374407 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-dfc2cf33-36d4-43d3-b730-b061e1b0dc9e None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:20:53.375980 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-dfc2cf33-36d4-43d3-b730-b061e1b0dc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:53.386418 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 691/1390] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:20:53.432637 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e85011-8cf5-4073-96a8-97d1071ea346 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:20:53.451466 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e85011-8cf5-4073-96a8-97d1071ea346 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:20:53.458252 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224103ae-608b-4785-afe2-77754e36ec2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:20:53.459252 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224103ae-608b-4785-afe2-77754e36ec2a service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:53.459617 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224103ae-608b-4785-afe2-77754e36ec2a service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:53.459969 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224103ae-608b-4785-afe2-77754e36ec2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:53.470736 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224103ae-608b-4785-afe2-77754e36ec2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:20:53.472792 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224103ae-608b-4785-afe2-77754e36ec2a service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:20:53.485453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 700/1391] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:20:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:20:56.231724 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca135cd-e52d-4cb4-ad40-0ffd6a15a9c8 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:56.232325 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca135cd-e52d-4cb4-ad40-0ffd6a15a9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:56.232421 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca135cd-e52d-4cb4-ad40-0ffd6a15a9c8 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:56.234203 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 692/1392] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:20:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:20:56.240799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b52fad-a77b-499d-9191-581223fea7e2 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:56.241237 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b52fad-a77b-499d-9191-581223fea7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:56.241529 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b52fad-a77b-499d-9191-581223fea7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:56.264413 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-c3b52fad-a77b-499d-9191-581223fea7e2 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:20:56.265905 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c3b52fad-a77b-499d-9191-581223fea7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:56.274824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 701/1393] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:20:56.321840 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca135cd-e52d-4cb4-ad40-0ffd6a15a9c8 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:20:56.337051 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca135cd-e52d-4cb4-ad40-0ffd6a15a9c8 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:20:56.342356 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696fa2a9-d06f-4a36-9911-915ec0fee42d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:20:56.342993 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fa2a9-d06f-4a36-9911-915ec0fee42d service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:56.343270 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fa2a9-d06f-4a36-9911-915ec0fee42d service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:56.343545 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fa2a9-d06f-4a36-9911-915ec0fee42d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:56.352562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696fa2a9-d06f-4a36-9911-915ec0fee42d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:20:56.353997 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696fa2a9-d06f-4a36-9911-915ec0fee42d service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:20:56.364077 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 693/1394] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:20:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:20:58.392958 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751cbe8-bf9c-46fd-b6f0-4b51240fccc6 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:58.393534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751cbe8-bf9c-46fd-b6f0-4b51240fccc6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:58.393534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751cbe8-bf9c-46fd-b6f0-4b51240fccc6 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:58.394925 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 702/1395] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:20:58.400084 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fc79b-98bc-4b3b-98b9-6a007782aab9 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:58.400490 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fc79b-98bc-4b3b-98b9-6a007782aab9 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:58.400640 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fc79b-98bc-4b3b-98b9-6a007782aab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:58.418932 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-5b0fc79b-98bc-4b3b-98b9-6a007782aab9 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:20:58.420125 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5b0fc79b-98bc-4b3b-98b9-6a007782aab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:58.428227 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 694/1396] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:20:58.484116 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138781f-f310-45de-8de6-dc6edefc15dd None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:58.484476 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138781f-f310-45de-8de6-dc6edefc15dd None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:58.484828 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138781f-f310-45de-8de6-dc6edefc15dd None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:58.486340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 703/1397] 10.222.0.13 () {54 vars in 962 bytes} [Tue Jul 5 21:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:20:58.491344 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2e4db-e464-4a5c-be3a-d2e23af4b484 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:58.491631 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2e4db-e464-4a5c-be3a-d2e23af4b484 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:58.491906 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2e4db-e464-4a5c-be3a-d2e23af4b484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:58.523214 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deece47-139f-45bb-9850-50328a5f5a9f None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:58.524115 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deece47-139f-45bb-9850-50328a5f5a9f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:58.524386 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deece47-139f-45bb-9850-50328a5f5a9f None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:58.525850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 704/1398] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:20:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:20:58.530687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8997327-ec93-4f0a-87a1-3de5a6aea7a8 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:58.530980 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8997327-ec93-4f0a-87a1-3de5a6aea7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:58.531264 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8997327-ec93-4f0a-87a1-3de5a6aea7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:58.542187 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-88c2e4db-e464-4a5c-be3a-d2e23af4b484 None None] MFA Rules not processed for user `436d7cc587bc4b2a8a3242fc39876ade`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:20:58.543394 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-88c2e4db-e464-4a5c-be3a-d2e23af4b484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:58.549768 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e8997327-ec93-4f0a-87a1-3de5a6aea7a8 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:20:58.550966 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e8997327-ec93-4f0a-87a1-3de5a6aea7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:58.559167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 705/1399] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:20:58.604818 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8997327-ec93-4f0a-87a1-3de5a6aea7a8 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:20:58.606152 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 695/1400] 10.222.0.13 () {58 vars in 1059 bytes} [Tue Jul 5 21:20:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:20:58.613953 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2e4db-e464-4a5c-be3a-d2e23af4b484 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:20:58.617745 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8997327-ec93-4f0a-87a1-3de5a6aea7a8 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:20:58.622052 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2e4db-e464-4a5c-be3a-d2e23af4b484 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:20:58.623395 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d06cc-b988-4eca-9d9b-2b4167c06564 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:20:58.624038 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d06cc-b988-4eca-9d9b-2b4167c06564 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:58.624324 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d06cc-b988-4eca-9d9b-2b4167c06564 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:58.624602 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d06cc-b988-4eca-9d9b-2b4167c06564 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:58.625709 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa543a88-f4ad-47a4-a5a9-7c322f2c68b0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '436d7cc587bc4b2a8a3242fc39876ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:20:58.626352 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa543a88-f4ad-47a4-a5a9-7c322f2c68b0 service glance] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:58.626634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa543a88-f4ad-47a4-a5a9-7c322f2c68b0 service glance] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:58.626908 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa543a88-f4ad-47a4-a5a9-7c322f2c68b0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:58.633564 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d06cc-b988-4eca-9d9b-2b4167c06564 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:20:58.635391 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d06cc-b988-4eca-9d9b-2b4167c06564 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:20:58.637835 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa543a88-f4ad-47a4-a5a9-7c322f2c68b0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:20:58.639307 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa543a88-f4ad-47a4-a5a9-7c322f2c68b0 service glance] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:20:58.644843 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 706/1401] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:20:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:20:58.649115 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 696/1402] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:20:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:20:59.577126 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39489a4e-8f81-4a0e-8401-1ee54739a536 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:59.577660 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39489a4e-8f81-4a0e-8401-1ee54739a536 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:59.577772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39489a4e-8f81-4a0e-8401-1ee54739a536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:59.627550 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-39489a4e-8f81-4a0e-8401-1ee54739a536 None None] MFA Rules not processed for user `063ce3b820a74d648d709ab6ac4d7be2`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:20:59.628768 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-39489a4e-8f81-4a0e-8401-1ee54739a536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:59.693318 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 707/1403] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Jul 5 21:20:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:20:59.733747 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e618b4-b305-4675-9a55-66f237a949a6 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:59.734283 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e618b4-b305-4675-9a55-66f237a949a6 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:59.734381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e618b4-b305-4675-9a55-66f237a949a6 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:59.735737 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 697/1404] 10.222.0.13 () {54 vars in 942 bytes} [Tue Jul 5 21:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:20:59.741909 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cef1c7-9354-4c43-a9cd-0ddf0e73dd39 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:59.742873 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cef1c7-9354-4c43-a9cd-0ddf0e73dd39 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:59.743161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cef1c7-9354-4c43-a9cd-0ddf0e73dd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:59.792104 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-03cef1c7-9354-4c43-a9cd-0ddf0e73dd39 None None] MFA Rules not processed for user `441be62a077444b9b9f78714e24a760a`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:20:59.793302 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-03cef1c7-9354-4c43-a9cd-0ddf0e73dd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:20:59.826812 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:20:59.866258 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 708/1405] 10.222.0.13 () {58 vars in 1039 bytes} [Tue Jul 5 21:20:59 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:20:59.875716 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e618b4-b305-4675-9a55-66f237a949a6 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:20:59.883174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:20:59.889568 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e618b4-b305-4675-9a55-66f237a949a6 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:20:59.894681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce989b-86ec-492f-a9a3-2a60f5323a4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '441be62a077444b9b9f78714e24a760a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:20:59.895318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce989b-86ec-492f-a9a3-2a60f5323a4d service swift] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:20:59.895605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce989b-86ec-492f-a9a3-2a60f5323a4d service swift] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:20:59.895888 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce989b-86ec-492f-a9a3-2a60f5323a4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:20:59.904837 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce989b-86ec-492f-a9a3-2a60f5323a4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:20:59.922074 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce989b-86ec-492f-a9a3-2a60f5323a4d service swift] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:20:59.922074 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 698/1406] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Jul 5 21:20:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 21:21:00.974675 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf768ba0-0de5-44cd-86cd-59dea6b13d6d None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:00.975328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf768ba0-0de5-44cd-86cd-59dea6b13d6d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:00.975328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf768ba0-0de5-44cd-86cd-59dea6b13d6d None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:00.977434 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 709/1407] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:21:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:21:00.982948 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237af2d4-d7f7-4caa-a3b3-ba0a70c05307 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:00.983876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237af2d4-d7f7-4caa-a3b3-ba0a70c05307 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:00.984337 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237af2d4-d7f7-4caa-a3b3-ba0a70c05307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:01.006458 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-237af2d4-d7f7-4caa-a3b3-ba0a70c05307 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:21:01.008319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-237af2d4-d7f7-4caa-a3b3-ba0a70c05307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:21:01.016851 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 699/1408] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:21:01.061099 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf768ba0-0de5-44cd-86cd-59dea6b13d6d None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:21:01.076446 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf768ba0-0de5-44cd-86cd-59dea6b13d6d None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:21:01.081916 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498c6b0-5479-4bad-aecc-0703a4249fac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:21:01.082594 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498c6b0-5479-4bad-aecc-0703a4249fac service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:01.082877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498c6b0-5479-4bad-aecc-0703a4249fac service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:01.083137 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498c6b0-5479-4bad-aecc-0703a4249fac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:01.092351 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498c6b0-5479-4bad-aecc-0703a4249fac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:21:01.093953 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498c6b0-5479-4bad-aecc-0703a4249fac service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:21:01.108138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 710/1409] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:21:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:21:11.001154 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=8 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:21:11.099816 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=21 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:21:23.170855 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc098e-65d1-4d42-a3f3-a1c4d660b902 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:23.171469 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc098e-65d1-4d42-a3f3-a1c4d660b902 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:23.171469 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc098e-65d1-4d42-a3f3-a1c4d660b902 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:23.172912 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 700/1410] 10.222.0.13 () {54 vars in 918 bytes} [Tue Jul 5 21:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:21:23.178327 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8933f0a-53a9-49e7-b9fd-e78c30acd1bc None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:23.178769 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8933f0a-53a9-49e7-b9fd-e78c30acd1bc None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:23.178877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8933f0a-53a9-49e7-b9fd-e78c30acd1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:23.197579 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e8933f0a-53a9-49e7-b9fd-e78c30acd1bc None None] MFA Rules not processed for user `992db9dab5944769b192a868d6637a02`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:21:23.198818 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e8933f0a-53a9-49e7-b9fd-e78c30acd1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:21:23.207167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 711/1411] 10.222.0.13 () {58 vars in 1015 bytes} [Tue Jul 5 21:21:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:21:23.221319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec5b32-5198-4840-a607-81e0277c39e7 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:23.221604 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec5b32-5198-4840-a607-81e0277c39e7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:23.221881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec5b32-5198-4840-a607-81e0277c39e7 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:23.223256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 701/1412] 10.222.0.13 () {54 vars in 918 bytes} [Tue Jul 5 21:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:21:23.228550 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c373cc1-8f61-4886-8266-978a24a3d134 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:23.228833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c373cc1-8f61-4886-8266-978a24a3d134 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:23.229112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c373cc1-8f61-4886-8266-978a24a3d134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:23.246952 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-1c373cc1-8f61-4886-8266-978a24a3d134 None None] MFA Rules not processed for user `910cd341df8943f18af2765e2a30b238`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:21:23.248133 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-1c373cc1-8f61-4886-8266-978a24a3d134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:21:23.257066 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 712/1413] 10.222.0.13 () {58 vars in 1015 bytes} [Tue Jul 5 21:21:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:21:25.772436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a87de-ad6d-4e95-a666-e03212dd649d None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:25.772997 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a87de-ad6d-4e95-a666-e03212dd649d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:25.772997 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a87de-ad6d-4e95-a666-e03212dd649d None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:25.775363 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 21:21:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:21:25.780847 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92929bb3-a107-4524-8b39-f4be1005db1b None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:25.781296 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92929bb3-a107-4524-8b39-f4be1005db1b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:25.786062 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92929bb3-a107-4524-8b39-f4be1005db1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:25.799810 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-92929bb3-a107-4524-8b39-f4be1005db1b None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:21:25.801012 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-92929bb3-a107-4524-8b39-f4be1005db1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:21:25.809107 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 21:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:21:25.852556 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a87de-ad6d-4e95-a666-e03212dd649d None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:21:25.867065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a87de-ad6d-4e95-a666-e03212dd649d None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:21:25.872530 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37279606-eab5-4d1b-a03c-2a8a4a14df11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:21:25.873187 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37279606-eab5-4d1b-a03c-2a8a4a14df11 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:25.873468 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37279606-eab5-4d1b-a03c-2a8a4a14df11 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:25.873746 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37279606-eab5-4d1b-a03c-2a8a4a14df11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:25.882201 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37279606-eab5-4d1b-a03c-2a8a4a14df11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:21:25.884298 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37279606-eab5-4d1b-a03c-2a8a4a14df11 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:21:25.893939 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 703/1416] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:21:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:21:26.795680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebc6fa-ad28-4e87-be90-712d7ce7d628 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:26.796252 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebc6fa-ad28-4e87-be90-712d7ce7d628 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:26.796252 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebc6fa-ad28-4e87-be90-712d7ce7d628 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:26.797625 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 21:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:21:26.802414 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640fe54-8c20-4b8f-be07-76434a0c6176 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:26.802843 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640fe54-8c20-4b8f-be07-76434a0c6176 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:26.803005 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640fe54-8c20-4b8f-be07-76434a0c6176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:26.821299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-c640fe54-8c20-4b8f-be07-76434a0c6176 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:21:26.822527 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c640fe54-8c20-4b8f-be07-76434a0c6176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:21:26.830259 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 21:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:21:26.987107 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebc6fa-ad28-4e87-be90-712d7ce7d628 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:21:27.001757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebc6fa-ad28-4e87-be90-712d7ce7d628 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:21:27.007515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31e3bb-ee2d-479d-a85f-14786eaac68a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:21:27.014567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31e3bb-ee2d-479d-a85f-14786eaac68a service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:27.014567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31e3bb-ee2d-479d-a85f-14786eaac68a service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:27.014567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31e3bb-ee2d-479d-a85f-14786eaac68a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:27.018394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31e3bb-ee2d-479d-a85f-14786eaac68a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:21:27.021041 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31e3bb-ee2d-479d-a85f-14786eaac68a service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:21:27.031405 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 715/1419] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:21:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:21:27.918163 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e1130-b5b1-43b6-9a99-133ff98c3e5d None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:27.918732 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e1130-b5b1-43b6-9a99-133ff98c3e5d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:27.918732 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e1130-b5b1-43b6-9a99-133ff98c3e5d None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:27.920054 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 21:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:21:27.924929 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e17ba-ae6a-47ee-991d-948472838781 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:27.925360 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e17ba-ae6a-47ee-991d-948472838781 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:27.925622 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e17ba-ae6a-47ee-991d-948472838781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:27.944446 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-4d6e17ba-ae6a-47ee-991d-948472838781 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:21:27.946285 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4d6e17ba-ae6a-47ee-991d-948472838781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:21:27.954072 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 21:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:21:28.106092 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e1130-b5b1-43b6-9a99-133ff98c3e5d None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:21:28.121025 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e1130-b5b1-43b6-9a99-133ff98c3e5d None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:21:28.126380 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0508b4-7a6f-4a68-abd5-c6a82de7b5d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:21:28.127004 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0508b4-7a6f-4a68-abd5-c6a82de7b5d2 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:28.127285 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0508b4-7a6f-4a68-abd5-c6a82de7b5d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:28.127559 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0508b4-7a6f-4a68-abd5-c6a82de7b5d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:28.136736 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0508b4-7a6f-4a68-abd5-c6a82de7b5d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:21:28.138345 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0508b4-7a6f-4a68-abd5-c6a82de7b5d2 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:21:28.147754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 706/1422] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:21:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:21:29.009721 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8a8a8-b0c2-432b-bfd3-20212acbc518 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:29.010265 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8a8a8-b0c2-432b-bfd3-20212acbc518 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:29.010265 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8a8a8-b0c2-432b-bfd3-20212acbc518 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:29.011891 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 21:21:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:21:29.016715 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c566a12-94d9-4bd6-8a4d-b7a5bb05b5eb None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:29.017154 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c566a12-94d9-4bd6-8a4d-b7a5bb05b5eb None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:29.017263 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c566a12-94d9-4bd6-8a4d-b7a5bb05b5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:29.035682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-2c566a12-94d9-4bd6-8a4d-b7a5bb05b5eb None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:21:29.036876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2c566a12-94d9-4bd6-8a4d-b7a5bb05b5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:21:29.044899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 21:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:21:29.198106 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8a8a8-b0c2-432b-bfd3-20212acbc518 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:21:29.213151 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8a8a8-b0c2-432b-bfd3-20212acbc518 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:21:29.218579 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613547f7-ec34-4229-b0fe-4637c2d13618 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:21:29.219209 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613547f7-ec34-4229-b0fe-4637c2d13618 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:29.219492 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613547f7-ec34-4229-b0fe-4637c2d13618 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:29.219770 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613547f7-ec34-4229-b0fe-4637c2d13618 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:29.227878 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613547f7-ec34-4229-b0fe-4637c2d13618 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:21:29.229448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613547f7-ec34-4229-b0fe-4637c2d13618 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:21:29.238672 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 718/1425] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:21:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:21:30.102575 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd039b0-f7ac-443f-9100-3551b39b0226 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:30.103117 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd039b0-f7ac-443f-9100-3551b39b0226 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:30.103117 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd039b0-f7ac-443f-9100-3551b39b0226 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:30.104503 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 21:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:21:30.109318 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37f940-babe-4577-a226-c8af723b063f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:30.109750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37f940-babe-4577-a226-c8af723b063f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:30.109907 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37f940-babe-4577-a226-c8af723b063f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:30.128373 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-cf37f940-babe-4577-a226-c8af723b063f None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:21:30.131976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-cf37f940-babe-4577-a226-c8af723b063f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:21:30.138634 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 21:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:21:30.288218 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd039b0-f7ac-443f-9100-3551b39b0226 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:21:30.302497 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd039b0-f7ac-443f-9100-3551b39b0226 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:21:30.308440 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1b723-c121-41df-84ba-afb62bc0e4b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:21:30.309080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1b723-c121-41df-84ba-afb62bc0e4b0 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:30.309363 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1b723-c121-41df-84ba-afb62bc0e4b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:30.309639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1b723-c121-41df-84ba-afb62bc0e4b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:30.317718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1b723-c121-41df-84ba-afb62bc0e4b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:21:30.321295 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1b723-c121-41df-84ba-afb62bc0e4b0 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:21:30.329412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 709/1428] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:21:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:21:31.192251 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985d542-27ee-4f46-9abb-1932b4447a15 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:31.192821 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985d542-27ee-4f46-9abb-1932b4447a15 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:31.192821 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985d542-27ee-4f46-9abb-1932b4447a15 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:31.194226 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 21:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:21:31.199159 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbc0b4-ea8c-4510-a974-d0af1327afa3 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:31.199600 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbc0b4-ea8c-4510-a974-d0af1327afa3 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:31.199734 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbc0b4-ea8c-4510-a974-d0af1327afa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:31.217495 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-f9bbc0b4-ea8c-4510-a974-d0af1327afa3 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:21:31.218729 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f9bbc0b4-ea8c-4510-a974-d0af1327afa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:21:31.226346 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 21:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:21:31.381626 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985d542-27ee-4f46-9abb-1932b4447a15 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:21:31.395948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985d542-27ee-4f46-9abb-1932b4447a15 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:21:31.401307 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be729c-08f0-4453-b8fd-281212906133 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:21:31.401931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be729c-08f0-4453-b8fd-281212906133 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:31.402247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be729c-08f0-4453-b8fd-281212906133 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:31.402525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be729c-08f0-4453-b8fd-281212906133 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:31.410462 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be729c-08f0-4453-b8fd-281212906133 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:21:31.412022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be729c-08f0-4453-b8fd-281212906133 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:21:31.421818 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 721/1431] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:21:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:21:32.287170 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15bfeb-c673-49c8-bc2b-776340b5af6a None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:32.287714 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15bfeb-c673-49c8-bc2b-776340b5af6a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:32.287815 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15bfeb-c673-49c8-bc2b-776340b5af6a None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:32.289186 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 21:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:21:32.294358 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a0382-c0c1-449f-955f-48661a019d4b None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:32.294817 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a0382-c0c1-449f-955f-48661a019d4b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:32.294923 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a0382-c0c1-449f-955f-48661a019d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:32.313112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0d3a0382-c0c1-449f-955f-48661a019d4b None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:21:32.314341 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0d3a0382-c0c1-449f-955f-48661a019d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:21:32.322702 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 21:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:21:32.470826 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15bfeb-c673-49c8-bc2b-776340b5af6a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:21:32.484787 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15bfeb-c673-49c8-bc2b-776340b5af6a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:21:32.490031 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a66e0-6ba0-4108-8f6c-54d758b54b50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:21:32.490679 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a66e0-6ba0-4108-8f6c-54d758b54b50 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:32.490960 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a66e0-6ba0-4108-8f6c-54d758b54b50 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:32.491230 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a66e0-6ba0-4108-8f6c-54d758b54b50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:32.499775 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a66e0-6ba0-4108-8f6c-54d758b54b50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:21:32.501330 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a66e0-6ba0-4108-8f6c-54d758b54b50 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:21:32.511503 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 712/1434] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:21:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:21:33.399951 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a74e7-4b13-463c-9969-296b8977a8da None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:33.400532 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a74e7-4b13-463c-9969-296b8977a8da None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:33.400532 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a74e7-4b13-463c-9969-296b8977a8da None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:33.401886 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 21:21:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:21:33.406856 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fa12e-54df-4edd-80e4-2300d4df5031 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:33.407261 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fa12e-54df-4edd-80e4-2300d4df5031 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:33.407408 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fa12e-54df-4edd-80e4-2300d4df5031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:33.425921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-934fa12e-54df-4edd-80e4-2300d4df5031 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:21:33.427153 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-934fa12e-54df-4edd-80e4-2300d4df5031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:21:33.435579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 21:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:21:33.586325 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a74e7-4b13-463c-9969-296b8977a8da None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:21:33.600758 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a74e7-4b13-463c-9969-296b8977a8da None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:21:33.607095 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237e816-57f5-47ba-8190-5bb3e1175397 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:21:33.607736 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237e816-57f5-47ba-8190-5bb3e1175397 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:33.608024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237e816-57f5-47ba-8190-5bb3e1175397 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:33.608304 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237e816-57f5-47ba-8190-5bb3e1175397 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:33.616454 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237e816-57f5-47ba-8190-5bb3e1175397 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:21:33.619023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237e816-57f5-47ba-8190-5bb3e1175397 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:21:33.628631 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 724/1437] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:21:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:21:34.479937 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088a6b0-79ab-4f2e-8f42-a7c1b1fe788a None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:34.480473 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088a6b0-79ab-4f2e-8f42-a7c1b1fe788a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:34.480582 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088a6b0-79ab-4f2e-8f42-a7c1b1fe788a None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:34.481881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 21:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:21:34.486960 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036e67f-357c-46f7-9d4b-83517f94fbc5 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:34.487369 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036e67f-357c-46f7-9d4b-83517f94fbc5 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:34.487525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036e67f-357c-46f7-9d4b-83517f94fbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:34.506211 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-7036e67f-357c-46f7-9d4b-83517f94fbc5 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:21:34.507424 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7036e67f-357c-46f7-9d4b-83517f94fbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:21:34.516338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 21:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:21:34.666471 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088a6b0-79ab-4f2e-8f42-a7c1b1fe788a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:21:34.681080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088a6b0-79ab-4f2e-8f42-a7c1b1fe788a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:21:34.686403 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad8c31-a244-486d-9867-e2a773f879f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:21:34.687030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad8c31-a244-486d-9867-e2a773f879f1 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:34.687313 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad8c31-a244-486d-9867-e2a773f879f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:34.687591 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad8c31-a244-486d-9867-e2a773f879f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:34.696230 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad8c31-a244-486d-9867-e2a773f879f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:21:34.697797 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad8c31-a244-486d-9867-e2a773f879f1 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:21:34.707023 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 715/1440] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:21:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:21:36.654511 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb875267-7102-4406-8afb-6f9cff9ce96d None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:36.654970 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb875267-7102-4406-8afb-6f9cff9ce96d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:36.655095 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb875267-7102-4406-8afb-6f9cff9ce96d None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:36.656424 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 21:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:21:36.661664 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc81b6-3dd3-4d67-859d-6ebe22a0b8b0 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:36.662046 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc81b6-3dd3-4d67-859d-6ebe22a0b8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:36.662253 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc81b6-3dd3-4d67-859d-6ebe22a0b8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:36.680527 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-2fdc81b6-3dd3-4d67-859d-6ebe22a0b8b0 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:21:36.681731 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2fdc81b6-3dd3-4d67-859d-6ebe22a0b8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:21:36.689485 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 21:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:21:36.728119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb875267-7102-4406-8afb-6f9cff9ce96d None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:21:36.738585 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb875267-7102-4406-8afb-6f9cff9ce96d None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:21:36.742500 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6604cb1-bb60-4083-8bda-d81ce4b2bbf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:21:36.743151 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6604cb1-bb60-4083-8bda-d81ce4b2bbf4 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:36.743420 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6604cb1-bb60-4083-8bda-d81ce4b2bbf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:36.743686 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6604cb1-bb60-4083-8bda-d81ce4b2bbf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:36.752440 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6604cb1-bb60-4083-8bda-d81ce4b2bbf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:21:36.753865 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6604cb1-bb60-4083-8bda-d81ce4b2bbf4 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:21:36.764594 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 727/1443] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:21:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:21:38.948140 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe1a76-ffe7-40f3-ba8f-6a1f93e11592 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:38.948671 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe1a76-ffe7-40f3-ba8f-6a1f93e11592 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:38.948671 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe1a76-ffe7-40f3-ba8f-6a1f93e11592 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:38.949972 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 21:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:21:38.955370 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750c823-d16d-4ff1-ae0f-8489555b313c None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:38.955802 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750c823-d16d-4ff1-ae0f-8489555b313c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:38.955937 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750c823-d16d-4ff1-ae0f-8489555b313c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:38.974155 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b750c823-d16d-4ff1-ae0f-8489555b313c None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:21:38.975421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b750c823-d16d-4ff1-ae0f-8489555b313c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:21:38.983444 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 21:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:21:39.021579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe1a76-ffe7-40f3-ba8f-6a1f93e11592 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:21:39.032395 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe1a76-ffe7-40f3-ba8f-6a1f93e11592 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:21:39.035886 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad083ce4-246a-46d3-a86f-fd0ff9baf045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:21:39.036493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad083ce4-246a-46d3-a86f-fd0ff9baf045 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:39.036769 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad083ce4-246a-46d3-a86f-fd0ff9baf045 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:39.037041 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad083ce4-246a-46d3-a86f-fd0ff9baf045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:39.046338 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad083ce4-246a-46d3-a86f-fd0ff9baf045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:21:39.047798 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad083ce4-246a-46d3-a86f-fd0ff9baf045 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:21:39.057527 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 718/1446] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:21:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:21:41.435050 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe753c4-a1b9-4690-8737-768bcc1b139d None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:41.435600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe753c4-a1b9-4690-8737-768bcc1b139d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:41.435600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe753c4-a1b9-4690-8737-768bcc1b139d None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:41.436983 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 21:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:21:41.442386 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f5eba-ed72-4ef4-86d9-16951906cc22 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:41.442793 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f5eba-ed72-4ef4-86d9-16951906cc22 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:41.442969 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f5eba-ed72-4ef4-86d9-16951906cc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:41.461184 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-755f5eba-ed72-4ef4-86d9-16951906cc22 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:21:41.462430 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-755f5eba-ed72-4ef4-86d9-16951906cc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:21:41.470040 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 21:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:21:41.508251 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe753c4-a1b9-4690-8737-768bcc1b139d None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:21:41.519209 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe753c4-a1b9-4690-8737-768bcc1b139d None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:21:41.522636 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84aa6f0-f60a-4b6a-823f-7d5813d6436b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:21:41.523292 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84aa6f0-f60a-4b6a-823f-7d5813d6436b service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:41.523573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84aa6f0-f60a-4b6a-823f-7d5813d6436b service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:41.523844 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84aa6f0-f60a-4b6a-823f-7d5813d6436b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:41.532471 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84aa6f0-f60a-4b6a-823f-7d5813d6436b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:21:41.533885 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84aa6f0-f60a-4b6a-823f-7d5813d6436b service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:21:41.543651 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 730/1449] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:21:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:21:43.733058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eb58f-d3d2-4b05-80db-24621ac18a8a None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:43.733702 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eb58f-d3d2-4b05-80db-24621ac18a8a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:43.733702 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eb58f-d3d2-4b05-80db-24621ac18a8a None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:43.735018 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 21:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:21:43.740294 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2065df-1f4c-4e98-896f-d3d8a0d5c055 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:43.740740 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2065df-1f4c-4e98-896f-d3d8a0d5c055 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:43.740865 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2065df-1f4c-4e98-896f-d3d8a0d5c055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:43.759065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0d2065df-1f4c-4e98-896f-d3d8a0d5c055 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:21:43.760282 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0d2065df-1f4c-4e98-896f-d3d8a0d5c055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:21:43.768274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 21:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:21:43.807488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385eb58f-d3d2-4b05-80db-24621ac18a8a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:21:43.809144 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-385eb58f-d3d2-4b05-80db-24621ac18a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:21:43.821946 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385eb58f-d3d2-4b05-80db-24621ac18a8a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:21:43.825821 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712b758-abd4-4653-8195-9752d3d9d2f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:21:43.826480 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712b758-abd4-4653-8195-9752d3d9d2f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:43.826763 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712b758-abd4-4653-8195-9752d3d9d2f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:43.827038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712b758-abd4-4653-8195-9752d3d9d2f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:43.836248 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712b758-abd4-4653-8195-9752d3d9d2f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:21:43.837660 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712b758-abd4-4653-8195-9752d3d9d2f5 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:21:43.847063 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 721/1452] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:21:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:21:46.175121 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0aca4e-c3a0-4afc-b2b6-08deeab210c5 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:46.175695 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0aca4e-c3a0-4afc-b2b6-08deeab210c5 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:46.175695 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0aca4e-c3a0-4afc-b2b6-08deeab210c5 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:46.177094 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 21:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:21:46.182431 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108f34b-134f-4bb3-bd51-7a0644c253da None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:46.182846 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108f34b-134f-4bb3-bd51-7a0644c253da None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:46.182985 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108f34b-134f-4bb3-bd51-7a0644c253da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:46.200759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-6108f34b-134f-4bb3-bd51-7a0644c253da None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:21:46.201935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6108f34b-134f-4bb3-bd51-7a0644c253da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:21:46.209621 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 21:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:21:46.247285 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0aca4e-c3a0-4afc-b2b6-08deeab210c5 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:21:46.258506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0aca4e-c3a0-4afc-b2b6-08deeab210c5 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:21:46.262281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006af3cd-2814-444a-b908-c447b835b958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:21:46.262932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006af3cd-2814-444a-b908-c447b835b958 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:46.263213 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006af3cd-2814-444a-b908-c447b835b958 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:46.263488 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006af3cd-2814-444a-b908-c447b835b958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:46.272403 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006af3cd-2814-444a-b908-c447b835b958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:21:46.274762 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006af3cd-2814-444a-b908-c447b835b958 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:21:46.283944 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 733/1455] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:21:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:21:48.404579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1033e7-cccd-4097-87cb-f7a84e81a5fe None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:48.405153 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1033e7-cccd-4097-87cb-f7a84e81a5fe None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:48.405153 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1033e7-cccd-4097-87cb-f7a84e81a5fe None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:48.406601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 21:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:21:48.411703 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc728615-c4c1-49a1-92d6-ecd78687fd76 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:48.412117 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc728615-c4c1-49a1-92d6-ecd78687fd76 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:48.412339 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc728615-c4c1-49a1-92d6-ecd78687fd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:48.431974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-dc728615-c4c1-49a1-92d6-ecd78687fd76 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:21:48.433161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-dc728615-c4c1-49a1-92d6-ecd78687fd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:21:48.440772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 21:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:21:48.477877 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1033e7-cccd-4097-87cb-f7a84e81a5fe None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:21:48.488525 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1033e7-cccd-4097-87cb-f7a84e81a5fe None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:21:48.492934 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d678f62-3517-48ff-8416-3e53fa1a8e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:21:48.493572 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d678f62-3517-48ff-8416-3e53fa1a8e68 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:48.493853 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d678f62-3517-48ff-8416-3e53fa1a8e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:48.494148 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d678f62-3517-48ff-8416-3e53fa1a8e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:48.502875 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d678f62-3517-48ff-8416-3e53fa1a8e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:21:48.504276 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d678f62-3517-48ff-8416-3e53fa1a8e68 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:21:48.514177 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 724/1458] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:21:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:21:50.604483 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b6578-831f-416d-bde6-2660ebca6c24 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:50.604914 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b6578-831f-416d-bde6-2660ebca6c24 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:50.605027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b6578-831f-416d-bde6-2660ebca6c24 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:50.606451 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 21:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:21:50.611668 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66819755-df59-4575-a719-f5b1b5038525 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:50.612149 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66819755-df59-4575-a719-f5b1b5038525 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:50.612256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66819755-df59-4575-a719-f5b1b5038525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:50.629529 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-66819755-df59-4575-a719-f5b1b5038525 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:21:50.630755 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-66819755-df59-4575-a719-f5b1b5038525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:21:50.639570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 21:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:21:50.676723 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b6578-831f-416d-bde6-2660ebca6c24 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:21:50.687494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b6578-831f-416d-bde6-2660ebca6c24 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:21:50.690987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0194488-dab8-4456-9d2d-de973419d4c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:21:50.691615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0194488-dab8-4456-9d2d-de973419d4c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:50.691896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0194488-dab8-4456-9d2d-de973419d4c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:50.692169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0194488-dab8-4456-9d2d-de973419d4c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:50.701344 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0194488-dab8-4456-9d2d-de973419d4c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:21:50.702805 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0194488-dab8-4456-9d2d-de973419d4c6 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:21:50.712652 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 736/1461] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:21:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:21:52.915827 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357963e5-ea9f-4b06-8a6b-c99eb6b03032 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:52.916358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357963e5-ea9f-4b06-8a6b-c99eb6b03032 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:52.916358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357963e5-ea9f-4b06-8a6b-c99eb6b03032 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:52.917721 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 21:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:21:52.923260 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b35de-f659-472c-8bb4-4e350229945e None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:52.923650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b35de-f659-472c-8bb4-4e350229945e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:52.923926 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b35de-f659-472c-8bb4-4e350229945e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:52.929954 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=79 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:21:52.941654 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-ba2b35de-f659-472c-8bb4-4e350229945e None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:21:52.942877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ba2b35de-f659-472c-8bb4-4e350229945e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:21:52.951316 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 21:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:21:52.988577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357963e5-ea9f-4b06-8a6b-c99eb6b03032 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:21:52.993880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=73 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:21:52.999449 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357963e5-ea9f-4b06-8a6b-c99eb6b03032 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:21:53.003000 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a7542-26ae-476d-8e34-e82eeb83a8f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:21:53.004076 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a7542-26ae-476d-8e34-e82eeb83a8f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:53.004076 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a7542-26ae-476d-8e34-e82eeb83a8f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:53.004270 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a7542-26ae-476d-8e34-e82eeb83a8f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:53.013807 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a7542-26ae-476d-8e34-e82eeb83a8f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:21:53.015299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a7542-26ae-476d-8e34-e82eeb83a8f2 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:21:53.025361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 727/1464] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:21:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:21:55.097265 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e1cf3-4888-461b-a6d6-a6ba04dc2532 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:55.097895 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e1cf3-4888-461b-a6d6-a6ba04dc2532 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:55.097895 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e1cf3-4888-461b-a6d6-a6ba04dc2532 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:55.099208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 21:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:21:55.104695 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e473b-2fc6-40b1-a399-aa7f19c11a32 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:55.105110 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e473b-2fc6-40b1-a399-aa7f19c11a32 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:55.105254 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e473b-2fc6-40b1-a399-aa7f19c11a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:55.123484 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-252e473b-2fc6-40b1-a399-aa7f19c11a32 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:21:55.124680 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-252e473b-2fc6-40b1-a399-aa7f19c11a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:21:55.133250 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 21:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:21:55.169690 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e1cf3-4888-461b-a6d6-a6ba04dc2532 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:21:55.181534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e1cf3-4888-461b-a6d6-a6ba04dc2532 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:21:55.185208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f6531-6526-4b69-acf0-2ccfc70998d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:21:55.185841 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f6531-6526-4b69-acf0-2ccfc70998d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:55.186178 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f6531-6526-4b69-acf0-2ccfc70998d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:55.186465 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f6531-6526-4b69-acf0-2ccfc70998d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:55.195767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f6531-6526-4b69-acf0-2ccfc70998d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:21:55.197269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f6531-6526-4b69-acf0-2ccfc70998d3 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:21:55.206848 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 739/1467] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:21:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:21:57.238464 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab35a1-7aa6-45b2-b17b-aeda024aa3a0 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:57.239009 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab35a1-7aa6-45b2-b17b-aeda024aa3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:57.239009 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab35a1-7aa6-45b2-b17b-aeda024aa3a0 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:57.240412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 21:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:21:57.246225 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7965a-2481-4076-a4bb-6f30e54958da None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:57.246661 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7965a-2481-4076-a4bb-6f30e54958da None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:57.246775 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7965a-2481-4076-a4bb-6f30e54958da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:57.265119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-8ab7965a-2481-4076-a4bb-6f30e54958da None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:21:57.266353 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8ab7965a-2481-4076-a4bb-6f30e54958da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:21:57.274060 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 21:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:21:57.310065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab35a1-7aa6-45b2-b17b-aeda024aa3a0 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:21:57.321237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab35a1-7aa6-45b2-b17b-aeda024aa3a0 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:21:57.324684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f55764-a0a7-4b99-a13d-8d083ea3e7a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:21:57.325399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f55764-a0a7-4b99-a13d-8d083ea3e7a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:21:57.325678 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f55764-a0a7-4b99-a13d-8d083ea3e7a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:21:57.325951 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f55764-a0a7-4b99-a13d-8d083ea3e7a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:21:57.334842 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f55764-a0a7-4b99-a13d-8d083ea3e7a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:21:57.336491 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f55764-a0a7-4b99-a13d-8d083ea3e7a0 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:21:57.346205 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 730/1470] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:21:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:22:07.259750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=11 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:22:07.341958 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=14 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:22:17.406994 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb063d9-c917-44e8-b4a8-4907a840da1b None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:22:17.407610 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb063d9-c917-44e8-b4a8-4907a840da1b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:22:17.407610 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb063d9-c917-44e8-b4a8-4907a840da1b None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:22:17.408930 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 741/1471] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:22:17.414626 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bb83d-c0b7-4c16-9d13-73909334a19e None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:22:17.415070 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bb83d-c0b7-4c16-9d13-73909334a19e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:22:17.415186 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bb83d-c0b7-4c16-9d13-73909334a19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:22:17.432538 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-cc8bb83d-c0b7-4c16-9d13-73909334a19e None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:22:17.433729 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-cc8bb83d-c0b7-4c16-9d13-73909334a19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:22:17.441475 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 731/1472] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:22:17.525386 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f882430-8917-405e-895d-3890b2a8641a None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:22:17.525676 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f882430-8917-405e-895d-3890b2a8641a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:22:17.525958 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f882430-8917-405e-895d-3890b2a8641a None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:22:17.527366 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 742/1473] 10.222.0.13 () {54 vars in 962 bytes} [Tue Jul 5 21:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:22:17.532184 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9020a-17e2-40e7-91c1-3ff48a5ca824 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:22:17.532474 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9020a-17e2-40e7-91c1-3ff48a5ca824 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:22:17.532754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9020a-17e2-40e7-91c1-3ff48a5ca824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:22:17.551112 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-c0d9020a-17e2-40e7-91c1-3ff48a5ca824 None None] MFA Rules not processed for user `436d7cc587bc4b2a8a3242fc39876ade`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:22:17.552326 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c0d9020a-17e2-40e7-91c1-3ff48a5ca824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:22:17.559085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 732/1474] 10.222.0.13 () {58 vars in 1059 bytes} [Tue Jul 5 21:22:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:22:17.566244 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f882430-8917-405e-895d-3890b2a8641a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:22:17.576624 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f882430-8917-405e-895d-3890b2a8641a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:22:17.580083 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334bec3-42c9-44b8-97d6-5451b373edd5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '436d7cc587bc4b2a8a3242fc39876ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:22:17.580695 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334bec3-42c9-44b8-97d6-5451b373edd5 service glance] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:22:17.580974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334bec3-42c9-44b8-97d6-5451b373edd5 service glance] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:22:17.581247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334bec3-42c9-44b8-97d6-5451b373edd5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:22:17.590631 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334bec3-42c9-44b8-97d6-5451b373edd5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:22:17.592070 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334bec3-42c9-44b8-97d6-5451b373edd5 service glance] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:22:17.602158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 743/1475] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:22:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:22:19.725747 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bee50-fb27-45f6-b7fe-32d8a1b0ac0a None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:22:19.726341 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bee50-fb27-45f6-b7fe-32d8a1b0ac0a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:22:19.726341 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bee50-fb27-45f6-b7fe-32d8a1b0ac0a None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:22:19.727716 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 733/1476] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:22:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:22:19.732789 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a61ffb-6ab6-471e-9aae-87948de82726 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:22:19.733195 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a61ffb-6ab6-471e-9aae-87948de82726 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:22:19.733347 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a61ffb-6ab6-471e-9aae-87948de82726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:22:19.751368 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f4a61ffb-6ab6-471e-9aae-87948de82726 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:22:19.752557 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f4a61ffb-6ab6-471e-9aae-87948de82726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:22:19.760918 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 744/1477] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:22:19.784188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bee50-fb27-45f6-b7fe-32d8a1b0ac0a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:22:19.797630 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bee50-fb27-45f6-b7fe-32d8a1b0ac0a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:22:19.802190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94083b-e880-4d27-ad1a-98420eafba75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:22:19.802911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94083b-e880-4d27-ad1a-98420eafba75 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:22:19.803460 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94083b-e880-4d27-ad1a-98420eafba75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:22:19.803605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94083b-e880-4d27-ad1a-98420eafba75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:22:19.804334 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94083b-e880-4d27-ad1a-98420eafba75 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:22:19.806153 dv-cinder-847335-3-smb devstack@keystone.service[80246]: WARNING py.warnings [None req-cb94083b-e880-4d27-ad1a-98420eafba75 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 21:22:19.806153 dv-cinder-847335-3-smb devstack@keystone.service[80246]: warnings.warn(msg) Jul 05 21:22:19.806153 dv-cinder-847335-3-smb devstack@keystone.service[80246]: Jul 05 21:22:19.807383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94083b-e880-4d27-ad1a-98420eafba75 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:22:19.826695 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 734/1478] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 21:22:19 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:22:21.869043 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84c1e9-af3a-48f0-bf83-23076caecde1 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:22:21.869572 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84c1e9-af3a-48f0-bf83-23076caecde1 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:22:21.869572 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84c1e9-af3a-48f0-bf83-23076caecde1 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:22:21.870920 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 745/1479] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:22:21.876127 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55031c03-5959-4c9b-b94d-67353984f505 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:22:21.876565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55031c03-5959-4c9b-b94d-67353984f505 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:22:21.876673 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55031c03-5959-4c9b-b94d-67353984f505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:22:21.894947 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-55031c03-5959-4c9b-b94d-67353984f505 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:22:21.896123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-55031c03-5959-4c9b-b94d-67353984f505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:22:21.904049 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 735/1480] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:22:21.946862 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84c1e9-af3a-48f0-bf83-23076caecde1 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:22:21.962097 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84c1e9-af3a-48f0-bf83-23076caecde1 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:22:21.971817 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983054c-66c9-47b5-a9ad-94b2e684c2b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:22:21.974502 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983054c-66c9-47b5-a9ad-94b2e684c2b4 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:22:21.974502 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983054c-66c9-47b5-a9ad-94b2e684c2b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:22:21.974502 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983054c-66c9-47b5-a9ad-94b2e684c2b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:22:21.981708 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1983054c-66c9-47b5-a9ad-94b2e684c2b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:22:21.983311 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1983054c-66c9-47b5-a9ad-94b2e684c2b4 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:22:21.993674 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 746/1481] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:22:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:22:24.215823 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99962044-7095-44ee-8045-b8957fca31ad None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:22:24.216401 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99962044-7095-44ee-8045-b8957fca31ad None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:22:24.216401 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99962044-7095-44ee-8045-b8957fca31ad None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:22:24.217756 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 736/1482] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:22:24.223130 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eabfdc-57f8-4bdd-9d71-ae723d1c16aa None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:22:24.223555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eabfdc-57f8-4bdd-9d71-ae723d1c16aa None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:22:24.223669 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eabfdc-57f8-4bdd-9d71-ae723d1c16aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:22:24.242153 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-64eabfdc-57f8-4bdd-9d71-ae723d1c16aa None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:22:24.243357 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-64eabfdc-57f8-4bdd-9d71-ae723d1c16aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:22:24.253940 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 747/1483] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:22:24.290946 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99962044-7095-44ee-8045-b8957fca31ad None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:22:24.301731 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99962044-7095-44ee-8045-b8957fca31ad None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:22:24.306111 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790cb9e-5990-4e22-a47e-f6d2617e1b0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:22:24.306793 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790cb9e-5990-4e22-a47e-f6d2617e1b0f service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:22:24.307077 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790cb9e-5990-4e22-a47e-f6d2617e1b0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:22:24.307357 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790cb9e-5990-4e22-a47e-f6d2617e1b0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:22:24.322643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790cb9e-5990-4e22-a47e-f6d2617e1b0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:22:24.324076 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790cb9e-5990-4e22-a47e-f6d2617e1b0f service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:22:24.333635 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 737/1484] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:22:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:22:26.461743 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3d0d5-de70-4b35-be4e-e1ba190e8cd5 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:22:26.462341 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3d0d5-de70-4b35-be4e-e1ba190e8cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:22:26.462341 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3d0d5-de70-4b35-be4e-e1ba190e8cd5 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:22:26.463684 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 748/1485] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:22:26.468738 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589a8d3-8729-4739-bf90-987d3958c3b0 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:22:26.469149 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589a8d3-8729-4739-bf90-987d3958c3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:22:26.469300 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589a8d3-8729-4739-bf90-987d3958c3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:22:26.486754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-4589a8d3-8729-4739-bf90-987d3958c3b0 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:22:26.487944 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4589a8d3-8729-4739-bf90-987d3958c3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:22:26.496619 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 738/1486] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:22:26.535326 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3d0d5-de70-4b35-be4e-e1ba190e8cd5 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:22:26.545981 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3d0d5-de70-4b35-be4e-e1ba190e8cd5 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:22:26.549488 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef915a11-0ed3-4ed5-8267-88e5097eb68a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:22:26.550112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef915a11-0ed3-4ed5-8267-88e5097eb68a service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:22:26.550418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef915a11-0ed3-4ed5-8267-88e5097eb68a service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:22:26.550692 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef915a11-0ed3-4ed5-8267-88e5097eb68a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:22:26.560075 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef915a11-0ed3-4ed5-8267-88e5097eb68a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:22:26.561515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef915a11-0ed3-4ed5-8267-88e5097eb68a service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:22:26.571959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 749/1487] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:22:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:22:28.679204 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ddd6b-2ee1-434e-a1e8-90dea1c1ef9f None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:22:28.679687 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ddd6b-2ee1-434e-a1e8-90dea1c1ef9f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:22:28.679790 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ddd6b-2ee1-434e-a1e8-90dea1c1ef9f None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:22:28.681199 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 739/1488] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:22:28.686332 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4639f3-cd12-4a8a-b57c-edb38845513e None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:22:28.686728 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4639f3-cd12-4a8a-b57c-edb38845513e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:22:28.686889 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4639f3-cd12-4a8a-b57c-edb38845513e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:22:28.704128 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-ba4639f3-cd12-4a8a-b57c-edb38845513e None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:22:28.705316 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ba4639f3-cd12-4a8a-b57c-edb38845513e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:22:28.713670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 750/1489] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:22:28.753046 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ddd6b-2ee1-434e-a1e8-90dea1c1ef9f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:22:28.764217 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ddd6b-2ee1-434e-a1e8-90dea1c1ef9f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:22:28.767657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ad01a-c19b-4b94-b149-4401b47c65f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:22:28.768274 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ad01a-c19b-4b94-b149-4401b47c65f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:22:28.768553 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ad01a-c19b-4b94-b149-4401b47c65f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:22:28.768824 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ad01a-c19b-4b94-b149-4401b47c65f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:22:28.778609 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ad01a-c19b-4b94-b149-4401b47c65f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:22:28.780016 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ad01a-c19b-4b94-b149-4401b47c65f7 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:22:28.790373 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 740/1490] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:22:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:22:31.286588 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481e780-b69a-46b6-a71a-8e5415401439 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:22:31.287233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481e780-b69a-46b6-a71a-8e5415401439 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:22:31.287419 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481e780-b69a-46b6-a71a-8e5415401439 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:22:31.288800 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 751/1491] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 21:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:22:31.294039 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81372e0b-eefc-4712-a32e-89bd5ed1cb5c None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:22:31.294486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81372e0b-eefc-4712-a32e-89bd5ed1cb5c None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:22:31.294646 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81372e0b-eefc-4712-a32e-89bd5ed1cb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:22:31.312207 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-81372e0b-eefc-4712-a32e-89bd5ed1cb5c None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:22:31.313390 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-81372e0b-eefc-4712-a32e-89bd5ed1cb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:22:31.321972 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 741/1492] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 21:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:22:31.360995 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481e780-b69a-46b6-a71a-8e5415401439 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:22:31.371602 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481e780-b69a-46b6-a71a-8e5415401439 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:22:31.375328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec158ad-1c84-45fe-9db6-bcfd3bfb7667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:22:31.375958 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec158ad-1c84-45fe-9db6-bcfd3bfb7667 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:22:31.376237 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec158ad-1c84-45fe-9db6-bcfd3bfb7667 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:22:31.376510 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec158ad-1c84-45fe-9db6-bcfd3bfb7667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:22:31.386427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec158ad-1c84-45fe-9db6-bcfd3bfb7667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:22:31.387828 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec158ad-1c84-45fe-9db6-bcfd3bfb7667 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:22:31.397832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 752/1493] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:22:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:22:41.307292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=33 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:22:41.392884 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=33 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:24:16.664987 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49a87e-f675-46ef-a9fc-92c91b5b453e None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:24:16.665524 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49a87e-f675-46ef-a9fc-92c91b5b453e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:24:16.665524 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49a87e-f675-46ef-a9fc-92c91b5b453e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:24:16.683911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-ca49a87e-f675-46ef-a9fc-92c91b5b453e None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:24:16.685084 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ca49a87e-f675-46ef-a9fc-92c91b5b453e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:24:16.693551 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 742/1494] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:24:16.701311 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bbe68-34a0-4c96-aef5-3d4a61226ace None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:24:16.701817 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bbe68-34a0-4c96-aef5-3d4a61226ace None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:24:16.701938 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bbe68-34a0-4c96-aef5-3d4a61226ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:24:16.720161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f14bbe68-34a0-4c96-aef5-3d4a61226ace None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:24:16.721584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f14bbe68-34a0-4c96-aef5-3d4a61226ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:24:16.729641 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 753/1495] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:24:16.734847 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49a87e-f675-46ef-a9fc-92c91b5b453e None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:24:16.744373 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49a87e-f675-46ef-a9fc-92c91b5b453e None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:24:16.748800 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6aaec4-4667-4661-a77f-df2072625698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:24:16.749444 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6aaec4-4667-4661-a77f-df2072625698 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:24:16.749726 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6aaec4-4667-4661-a77f-df2072625698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:24:16.750693 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6aaec4-4667-4661-a77f-df2072625698 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:24:16.751413 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6aaec4-4667-4661-a77f-df2072625698 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:24:16.751713 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6aaec4-4667-4661-a77f-df2072625698 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:24:16.752716 dv-cinder-847335-3-smb devstack@keystone.service[80246]: WARNING py.warnings [None req-6c6aaec4-4667-4661-a77f-df2072625698 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 21:24:16.752716 dv-cinder-847335-3-smb devstack@keystone.service[80246]: warnings.warn(msg) Jul 05 21:24:16.752716 dv-cinder-847335-3-smb devstack@keystone.service[80246]: Jul 05 21:24:16.753593 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6aaec4-4667-4661-a77f-df2072625698 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:24:16.765140 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 743/1496] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:24:16.773416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bbe68-34a0-4c96-aef5-3d4a61226ace None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:24:16.782882 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bbe68-34a0-4c96-aef5-3d4a61226ace None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:24:16.791256 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47a208-03a7-4e03-9199-841efb985bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:24:16.791902 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47a208-03a7-4e03-9199-841efb985bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:24:16.792186 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47a208-03a7-4e03-9199-841efb985bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:24:16.792463 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47a208-03a7-4e03-9199-841efb985bc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:24:16.793159 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47a208-03a7-4e03-9199-841efb985bc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:24:16.794962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: WARNING py.warnings [None req-8b47a208-03a7-4e03-9199-841efb985bc4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 21:24:16.794962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: warnings.warn(msg) Jul 05 21:24:16.794962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: Jul 05 21:24:16.796161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47a208-03a7-4e03-9199-841efb985bc4 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:24:16.899578 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 754/1497] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:24:16 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:24:16.903749 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6aaec4-4667-4661-a77f-df2072625698 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:24:16.914441 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6aaec4-4667-4661-a77f-df2072625698 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:24:16.973806 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba6756-9fb9-4e4f-9eba-a23e1b228b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:24:16.974515 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba6756-9fb9-4e4f-9eba-a23e1b228b0f admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:24:16.974806 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba6756-9fb9-4e4f-9eba-a23e1b228b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:24:16.975083 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba6756-9fb9-4e4f-9eba-a23e1b228b0f admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:24:16.975782 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba6756-9fb9-4e4f-9eba-a23e1b228b0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:24:16.976794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: WARNING py.warnings [None req-c8ba6756-9fb9-4e4f-9eba-a23e1b228b0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 21:24:16.976794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: warnings.warn(msg) Jul 05 21:24:16.976794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: Jul 05 21:24:16.978006 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba6756-9fb9-4e4f-9eba-a23e1b228b0f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:24:17.379177 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 744/1498] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:24:16 2022] POST /identity/v3/users => generated 289 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:24:17.383398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47a208-03a7-4e03-9199-841efb985bc4 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:24:17.394352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47a208-03a7-4e03-9199-841efb985bc4 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:24:17.399014 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7206a-a6b9-4390-8b37-9e4ae93cd924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:24:17.402657 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7206a-a6b9-4390-8b37-9e4ae93cd924 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:24:17.402657 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7206a-a6b9-4390-8b37-9e4ae93cd924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:24:17.402657 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7206a-a6b9-4390-8b37-9e4ae93cd924 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:24:17.402657 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7206a-a6b9-4390-8b37-9e4ae93cd924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:24:17.402657 dv-cinder-847335-3-smb devstack@keystone.service[80247]: WARNING py.warnings [None req-b6a7206a-a6b9-4390-8b37-9e4ae93cd924 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 21:24:17.402657 dv-cinder-847335-3-smb devstack@keystone.service[80247]: warnings.warn(msg) Jul 05 21:24:17.402657 dv-cinder-847335-3-smb devstack@keystone.service[80247]: Jul 05 21:24:17.403279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7206a-a6b9-4390-8b37-9e4ae93cd924 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:24:17.416836 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 755/1499] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:24:17.420833 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba6756-9fb9-4e4f-9eba-a23e1b228b0f admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:24:17.430940 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba6756-9fb9-4e4f-9eba-a23e1b228b0f admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:24:17.435537 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e2dc9-0be6-4859-ba5d-520e15dfd5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:24:17.436189 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e2dc9-0be6-4859-ba5d-520e15dfd5ac admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:24:17.436468 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e2dc9-0be6-4859-ba5d-520e15dfd5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:24:17.436742 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e2dc9-0be6-4859-ba5d-520e15dfd5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:24:17.437469 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e2dc9-0be6-4859-ba5d-520e15dfd5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:24:17.438588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: WARNING py.warnings [None req-aa3e2dc9-0be6-4859-ba5d-520e15dfd5ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 21:24:17.438588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: warnings.warn(msg) Jul 05 21:24:17.438588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: Jul 05 21:24:17.439461 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e2dc9-0be6-4859-ba5d-520e15dfd5ac admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:24:17.452590 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 745/1500] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:24:17.457210 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7206a-a6b9-4390-8b37-9e4ae93cd924 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:24:17.467158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7206a-a6b9-4390-8b37-9e4ae93cd924 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:24:17.472701 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb257e-15f4-42ea-ad63-95a1c93fd264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:24:17.473574 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb257e-15f4-42ea-ad63-95a1c93fd264 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:24:17.473860 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb257e-15f4-42ea-ad63-95a1c93fd264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:24:17.474171 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb257e-15f4-42ea-ad63-95a1c93fd264 admin admin] PATH_INFO: `/v3/projects/fba028d612b54817b4f7f0e1b8a97142/users/b99f841cf9744a4785db69dbdadc0017/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:24:17.488826 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb257e-15f4-42ea-ad63-95a1c93fd264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba028d612b54817b4f7f0e1b8a97142, user_id=b99f841cf9744a4785db69dbdadc0017, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:24:17.489859 dv-cinder-847335-3-smb devstack@keystone.service[80247]: WARNING py.warnings [None req-10eb257e-15f4-42ea-ad63-95a1c93fd264 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 21:24:17.489859 dv-cinder-847335-3-smb devstack@keystone.service[80247]: warnings.warn(msg) Jul 05 21:24:17.489859 dv-cinder-847335-3-smb devstack@keystone.service[80247]: Jul 05 21:24:17.491818 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb257e-15f4-42ea-ad63-95a1c93fd264 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:24:17.618302 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 756/1501] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:24:17 2022] PUT /identity/v3/projects/fba028d612b54817b4f7f0e1b8a97142/users/b99f841cf9744a4785db69dbdadc0017/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:24:17.631243 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab79a46-c483-41af-8fe1-9c1cffb8661a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:24:17.631463 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab79a46-c483-41af-8fe1-9c1cffb8661a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:24:17.631739 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab79a46-c483-41af-8fe1-9c1cffb8661a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:24:17.658090 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-7ab79a46-c483-41af-8fe1-9c1cffb8661a None None] MFA Rules not processed for user `b99f841cf9744a4785db69dbdadc0017`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:24:17.659350 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7ab79a46-c483-41af-8fe1-9c1cffb8661a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:24:17.721440 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 746/1502] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:24:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:24:17.734869 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedc9f8-4eff-42f2-a330-bf7354d7db43 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:24:17.735291 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedc9f8-4eff-42f2-a330-bf7354d7db43 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:24:17.735544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedc9f8-4eff-42f2-a330-bf7354d7db43 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:24:17.736941 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 757/1503] 10.222.0.13 () {54 vars in 963 bytes} [Tue Jul 5 21:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:24:17.741607 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fc584-71fa-4826-b4d5-28f7be687c0f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:24:17.741902 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fc584-71fa-4826-b4d5-28f7be687c0f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:24:17.742221 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fc584-71fa-4826-b4d5-28f7be687c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:24:17.760385 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-f43fc584-71fa-4826-b4d5-28f7be687c0f None None] MFA Rules not processed for user `6d59037633db47efa1ed340055bf520a`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:24:17.761571 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f43fc584-71fa-4826-b4d5-28f7be687c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:24:17.804108 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:24:17.811241 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 747/1504] 10.222.0.13 () {58 vars in 1060 bytes} [Tue Jul 5 21:24:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:24:17.819861 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedc9f8-4eff-42f2-a330-bf7354d7db43 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:24:17.832612 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedc9f8-4eff-42f2-a330-bf7354d7db43 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:24:17.836136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aeb390-c932-4dac-bf36-9f165ba26422 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:24:17.836768 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeb390-c932-4dac-bf36-9f165ba26422 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:24:17.837055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeb390-c932-4dac-bf36-9f165ba26422 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:24:17.837338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeb390-c932-4dac-bf36-9f165ba26422 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:24:17.845799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aeb390-c932-4dac-bf36-9f165ba26422 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:24:17.862795 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aeb390-c932-4dac-bf36-9f165ba26422 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:24:17.862795 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 758/1505] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:24:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:24:17.898875 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd933fe1-ecbc-46ea-aeb6-6b4173bdd84b None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:24:17.899168 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd933fe1-ecbc-46ea-aeb6-6b4173bdd84b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:24:17.899447 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd933fe1-ecbc-46ea-aeb6-6b4173bdd84b None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:24:17.900732 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 748/1506] 10.222.0.13 () {52 vars in 829 bytes} [Tue Jul 5 21:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:24:17.904263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aeb390-c932-4dac-bf36-9f165ba26422 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:24:17.966441 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aeb390-c932-4dac-bf36-9f165ba26422 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:24:17.971721 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8dc98-d7f3-4820-a9b0-c9957246d5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:24:17.972588 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8dc98-d7f3-4820-a9b0-c9957246d5fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:24:17.972867 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8dc98-d7f3-4820-a9b0-c9957246d5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:24:17.973142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8dc98-d7f3-4820-a9b0-c9957246d5fa admin admin] PATH_INFO: `/v3/users/b99f841cf9744a4785db69dbdadc0017` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:24:17.974337 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8dc98-d7f3-4820-a9b0-c9957246d5fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b99f841cf9744a4785db69dbdadc0017)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:24:17.975350 dv-cinder-847335-3-smb devstack@keystone.service[80247]: WARNING py.warnings [None req-55b8dc98-d7f3-4820-a9b0-c9957246d5fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 21:24:17.975350 dv-cinder-847335-3-smb devstack@keystone.service[80247]: warnings.warn(msg) Jul 05 21:24:17.975350 dv-cinder-847335-3-smb devstack@keystone.service[80247]: Jul 05 21:24:17.976809 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8dc98-d7f3-4820-a9b0-c9957246d5fa admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:24:18.139091 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-55b8dc98-d7f3-4820-a9b0-c9957246d5fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b99f841cf9744a4785db69dbdadc0017'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:24:18.194103 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-55b8dc98-d7f3-4820-a9b0-c9957246d5fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b99f841cf9744a4785db69dbdadc0017'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:24:18.212537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-55b8dc98-d7f3-4820-a9b0-c9957246d5fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b99f841cf9744a4785db69dbdadc0017'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:24:18.221304 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:24:18.225666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-55b8dc98-d7f3-4820-a9b0-c9957246d5fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b99f841cf9744a4785db69dbdadc0017'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:24:18.226575 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-55b8dc98-d7f3-4820-a9b0-c9957246d5fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b99f841cf9744a4785db69dbdadc0017'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:24:18.232569 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 759/1507] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:24:17 2022] DELETE /identity/v3/users/b99f841cf9744a4785db69dbdadc0017 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:24:18.237813 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05f134-be9a-415a-9fd3-e4801f29a221 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:24:18.238168 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05f134-be9a-415a-9fd3-e4801f29a221 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:24:18.238459 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05f134-be9a-415a-9fd3-e4801f29a221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:24:18.256143 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-ff05f134-be9a-415a-9fd3-e4801f29a221 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:24:18.257337 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ff05f134-be9a-415a-9fd3-e4801f29a221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:24:18.315515 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 749/1508] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:24:18.326373 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8dc98-d7f3-4820-a9b0-c9957246d5fa admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:24:18.327815 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-55b8dc98-d7f3-4820-a9b0-c9957246d5fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:24:18.384516 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8dc98-d7f3-4820-a9b0-c9957246d5fa admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:24:18.388269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd544024-e58a-4477-9526-59f97d815395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:24:18.388907 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd544024-e58a-4477-9526-59f97d815395 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:24:18.389239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd544024-e58a-4477-9526-59f97d815395 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:24:18.389463 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd544024-e58a-4477-9526-59f97d815395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:24:18.398403 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd544024-e58a-4477-9526-59f97d815395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:24:18.399823 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd544024-e58a-4477-9526-59f97d815395 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:24:18.409684 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 760/1509] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:24:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:24:18.913425 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05f134-be9a-415a-9fd3-e4801f29a221 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:24:18.916084 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ff05f134-be9a-415a-9fd3-e4801f29a221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:24:18.937747 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05f134-be9a-415a-9fd3-e4801f29a221 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:24:18.945567 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f1aff-d4a0-49c7-9d57-cebc9640c314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:24:18.949013 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f1aff-d4a0-49c7-9d57-cebc9640c314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:24:18.949013 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f1aff-d4a0-49c7-9d57-cebc9640c314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:24:18.949013 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f1aff-d4a0-49c7-9d57-cebc9640c314 admin admin] PATH_INFO: `/v3/projects/fba028d612b54817b4f7f0e1b8a97142` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:24:18.949907 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f1aff-d4a0-49c7-9d57-cebc9640c314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fba028d612b54817b4f7f0e1b8a97142)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:24:18.951886 dv-cinder-847335-3-smb devstack@keystone.service[80246]: WARNING py.warnings [None req-378f1aff-d4a0-49c7-9d57-cebc9640c314 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 21:24:18.951886 dv-cinder-847335-3-smb devstack@keystone.service[80246]: warnings.warn(msg) Jul 05 21:24:18.951886 dv-cinder-847335-3-smb devstack@keystone.service[80246]: Jul 05 21:24:18.957766 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f1aff-d4a0-49c7-9d57-cebc9640c314 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:24:19.126778 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-378f1aff-d4a0-49c7-9d57-cebc9640c314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fba028d612b54817b4f7f0e1b8a97142', 'request_id': 'req-378f1aff-d4a0-49c7-9d57-cebc9640c314'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:24:19.133088 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-378f1aff-d4a0-49c7-9d57-cebc9640c314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fba028d612b54817b4f7f0e1b8a97142', 'request_id': 'req-378f1aff-d4a0-49c7-9d57-cebc9640c314'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:24:19.206645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-378f1aff-d4a0-49c7-9d57-cebc9640c314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fba028d612b54817b4f7f0e1b8a97142', 'request_id': 'req-378f1aff-d4a0-49c7-9d57-cebc9640c314'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:24:19.225377 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-378f1aff-d4a0-49c7-9d57-cebc9640c314 admin admin] The token cache is being invalidate because project fba028d612b54817b4f7f0e1b8a97142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:24:19.225661 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-378f1aff-d4a0-49c7-9d57-cebc9640c314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:24:19.226424 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-378f1aff-d4a0-49c7-9d57-cebc9640c314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:24:19.227970 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 750/1510] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:24:18 2022] DELETE /identity/v3/projects/fba028d612b54817b4f7f0e1b8a97142 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:24:28.404921 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=29 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:24:29.222419 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:02.866764 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d403fe-993c-4c36-a096-b99888f313d7 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:02.867300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d403fe-993c-4c36-a096-b99888f313d7 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:02.867300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d403fe-993c-4c36-a096-b99888f313d7 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:02.868656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 21:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:02.874012 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda06bc-8f49-4098-a1d2-d5d3a1f31c1f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:02.874508 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda06bc-8f49-4098-a1d2-d5d3a1f31c1f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:02.874641 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda06bc-8f49-4098-a1d2-d5d3a1f31c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:02.893505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-dcda06bc-8f49-4098-a1d2-d5d3a1f31c1f None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:02.894750 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-dcda06bc-8f49-4098-a1d2-d5d3a1f31c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:02.955113 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 21:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:26:03.108524 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d403fe-993c-4c36-a096-b99888f313d7 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:03.110415 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e1d403fe-993c-4c36-a096-b99888f313d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:03.187332 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d403fe-993c-4c36-a096-b99888f313d7 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:03.192539 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d167f9-d2bd-4864-baf9-87a8b12a0ce6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:03.193170 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d167f9-d2bd-4864-baf9-87a8b12a0ce6 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:03.193480 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d167f9-d2bd-4864-baf9-87a8b12a0ce6 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:03.193757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d167f9-d2bd-4864-baf9-87a8b12a0ce6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:03.201932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d167f9-d2bd-4864-baf9-87a8b12a0ce6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:03.203554 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d167f9-d2bd-4864-baf9-87a8b12a0ce6 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:03.212805 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 762/1513] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:26:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:26:04.053380 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de400ce0-4e41-4586-be04-47a50e0228bf None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:04.053962 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de400ce0-4e41-4586-be04-47a50e0228bf None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:04.053962 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de400ce0-4e41-4586-be04-47a50e0228bf None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:04.055361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 21:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:04.060988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda5348-bc4a-4235-96eb-316c239b9ebd None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:04.061441 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda5348-bc4a-4235-96eb-316c239b9ebd None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:04.061604 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda5348-bc4a-4235-96eb-316c239b9ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:04.080060 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-6dda5348-bc4a-4235-96eb-316c239b9ebd None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:04.081282 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6dda5348-bc4a-4235-96eb-316c239b9ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:04.089088 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 763/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 21:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:26:04.244439 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de400ce0-4e41-4586-be04-47a50e0228bf None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:04.260551 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de400ce0-4e41-4586-be04-47a50e0228bf None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:04.266771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8547073-afb8-4cc3-afa6-5621fd62ac0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:04.267404 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8547073-afb8-4cc3-afa6-5621fd62ac0a service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:04.267687 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8547073-afb8-4cc3-afa6-5621fd62ac0a service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:04.267963 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8547073-afb8-4cc3-afa6-5621fd62ac0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:04.276098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8547073-afb8-4cc3-afa6-5621fd62ac0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:04.277716 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8547073-afb8-4cc3-afa6-5621fd62ac0a service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:04.287155 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 753/1516] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:26:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:26:04.621698 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d6a39-8c48-4fa7-b4bd-162a0691f3d7 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:04.622020 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d6a39-8c48-4fa7-b4bd-162a0691f3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:04.622310 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d6a39-8c48-4fa7-b4bd-162a0691f3d7 None None] PATH_INFO: `/v3` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:04.623662 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 764/1517] 10.222.0.39 () {54 vars in 925 bytes} [Tue Jul 5 21:26:04 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:04.630237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d06a0-9ef8-4ecd-a499-1ecc49ae933a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:04.630549 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d06a0-9ef8-4ecd-a499-1ecc49ae933a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:04.630826 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d06a0-9ef8-4ecd-a499-1ecc49ae933a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:04.648817 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-da7d06a0-9ef8-4ecd-a499-1ecc49ae933a None None] MFA Rules not processed for user `992db9dab5944769b192a868d6637a02`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:04.650035 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-da7d06a0-9ef8-4ecd-a499-1ecc49ae933a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:04.716988 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 754/1518] 10.222.0.39 () {58 vars in 1015 bytes} [Tue Jul 5 21:26:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:26:13.839441 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461cf43-9f11-4b1a-b065-9d493ade1062 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:13.839966 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461cf43-9f11-4b1a-b065-9d493ade1062 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:13.839966 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461cf43-9f11-4b1a-b065-9d493ade1062 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:13.841359 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 765/1519] 10.222.0.13 () {54 vars in 960 bytes} [Tue Jul 5 21:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:13.846229 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1200160-dd12-4c82-b2e3-683cacf15964 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:13.846670 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1200160-dd12-4c82-b2e3-683cacf15964 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:13.846778 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1200160-dd12-4c82-b2e3-683cacf15964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:13.864850 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d1200160-dd12-4c82-b2e3-683cacf15964 None None] MFA Rules not processed for user `992db9dab5944769b192a868d6637a02`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:13.866051 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d1200160-dd12-4c82-b2e3-683cacf15964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:13.875196 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 755/1520] 10.222.0.13 () {58 vars in 1057 bytes} [Tue Jul 5 21:26:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:26:13.882816 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461cf43-9f11-4b1a-b065-9d493ade1062 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:13.896797 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461cf43-9f11-4b1a-b065-9d493ade1062 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:13.901713 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca22ec-d51f-450b-9df1-23ea072f957a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992db9dab5944769b192a868d6637a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:13.902372 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca22ec-d51f-450b-9df1-23ea072f957a service placement] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:13.902658 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca22ec-d51f-450b-9df1-23ea072f957a service placement] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:13.902936 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca22ec-d51f-450b-9df1-23ea072f957a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:13.911015 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca22ec-d51f-450b-9df1-23ea072f957a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:13.912615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca22ec-d51f-450b-9df1-23ea072f957a service placement] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:13.922253 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 766/1521] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:26:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:26:15.513240 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf3ac0-0276-4223-8072-d6924c7fa0e1 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:15.513789 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf3ac0-0276-4223-8072-d6924c7fa0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:15.513884 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf3ac0-0276-4223-8072-d6924c7fa0e1 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:15.515308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 21:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:15.519974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad193a2-3485-4f83-bf9b-ff74f3acd04b None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:15.520356 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad193a2-3485-4f83-bf9b-ff74f3acd04b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:15.520529 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad193a2-3485-4f83-bf9b-ff74f3acd04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:15.538611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-cad193a2-3485-4f83-bf9b-ff74f3acd04b None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:15.539795 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-cad193a2-3485-4f83-bf9b-ff74f3acd04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:15.548427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 21:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:26:15.702805 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf3ac0-0276-4223-8072-d6924c7fa0e1 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:15.717273 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf3ac0-0276-4223-8072-d6924c7fa0e1 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:15.723308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d454f85-1b31-4433-a902-30754cf2bf65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:15.723942 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d454f85-1b31-4433-a902-30754cf2bf65 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:15.724223 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d454f85-1b31-4433-a902-30754cf2bf65 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:15.724501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d454f85-1b31-4433-a902-30754cf2bf65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:15.732708 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d454f85-1b31-4433-a902-30754cf2bf65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:15.734352 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d454f85-1b31-4433-a902-30754cf2bf65 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:15.743635 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 757/1524] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:26:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:26:16.565027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833d3c3-1b85-48b3-84a0-29172f6bf57b None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:16.565575 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833d3c3-1b85-48b3-84a0-29172f6bf57b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:16.565575 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833d3c3-1b85-48b3-84a0-29172f6bf57b None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:16.567113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 21:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:16.571786 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446a9fa-bed3-4a69-ae21-3a1727a4bc35 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:16.572234 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446a9fa-bed3-4a69-ae21-3a1727a4bc35 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:16.572347 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446a9fa-bed3-4a69-ae21-3a1727a4bc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:16.590940 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-c446a9fa-bed3-4a69-ae21-3a1727a4bc35 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:16.592154 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c446a9fa-bed3-4a69-ae21-3a1727a4bc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:16.600922 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 21:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:26:16.754658 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833d3c3-1b85-48b3-84a0-29172f6bf57b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:16.769914 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833d3c3-1b85-48b3-84a0-29172f6bf57b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:16.775226 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9cb10-f3fa-46cb-8c56-1b0bd7fe5f13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:16.775855 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9cb10-f3fa-46cb-8c56-1b0bd7fe5f13 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:16.776140 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9cb10-f3fa-46cb-8c56-1b0bd7fe5f13 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:16.776418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9cb10-f3fa-46cb-8c56-1b0bd7fe5f13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:16.784892 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9cb10-f3fa-46cb-8c56-1b0bd7fe5f13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:16.786533 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9cb10-f3fa-46cb-8c56-1b0bd7fe5f13 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:16.795954 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 769/1527] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:26:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:26:20.741960 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a8cc-11e8-44ae-8021-09db2f78c80c None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:20.742457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a8cc-11e8-44ae-8021-09db2f78c80c None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:20.742562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a8cc-11e8-44ae-8021-09db2f78c80c None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:20.743931 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 21:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:20.749855 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f87cfe-6995-4067-9ee2-a88d2338330e None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:20.750423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f87cfe-6995-4067-9ee2-a88d2338330e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:20.750528 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f87cfe-6995-4067-9ee2-a88d2338330e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:20.768988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-37f87cfe-6995-4067-9ee2-a88d2338330e None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:20.770229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-37f87cfe-6995-4067-9ee2-a88d2338330e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:20.777920 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 21:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:26:20.849131 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5a8cc-11e8-44ae-8021-09db2f78c80c None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:20.850782 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7db5a8cc-11e8-44ae-8021-09db2f78c80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:20.908039 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5a8cc-11e8-44ae-8021-09db2f78c80c None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:20.911653 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bee1e-578e-4da4-9cbe-e3de260b59ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:20.912293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bee1e-578e-4da4-9cbe-e3de260b59ba service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:20.912614 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bee1e-578e-4da4-9cbe-e3de260b59ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:20.912873 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bee1e-578e-4da4-9cbe-e3de260b59ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:20.922457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6bee1e-578e-4da4-9cbe-e3de260b59ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:20.923892 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6bee1e-578e-4da4-9cbe-e3de260b59ba service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:20.928983 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:20.933869 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 760/1530] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:26:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:26:22.964108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc081be5-d295-4d56-8a85-279829b33680 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:22.964676 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc081be5-d295-4d56-8a85-279829b33680 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:22.964676 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc081be5-d295-4d56-8a85-279829b33680 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:22.966011 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 21:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:22.971346 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeacc8d-879f-41e1-b4ab-5a0f9383614b None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:22.971760 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeacc8d-879f-41e1-b4ab-5a0f9383614b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:22.971941 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeacc8d-879f-41e1-b4ab-5a0f9383614b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:22.989945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-daeacc8d-879f-41e1-b4ab-5a0f9383614b None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:22.991165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-daeacc8d-879f-41e1-b4ab-5a0f9383614b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:22.999776 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 21:26:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:26:23.035766 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc081be5-d295-4d56-8a85-279829b33680 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:23.047126 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc081be5-d295-4d56-8a85-279829b33680 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:23.050585 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a7cfb-aa3c-44eb-991b-a14a844a57f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:23.051204 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a7cfb-aa3c-44eb-991b-a14a844a57f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:23.051485 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a7cfb-aa3c-44eb-991b-a14a844a57f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:23.051759 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a7cfb-aa3c-44eb-991b-a14a844a57f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:23.060417 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a7cfb-aa3c-44eb-991b-a14a844a57f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:23.063096 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a7cfb-aa3c-44eb-991b-a14a844a57f9 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:23.072872 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 772/1533] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:26:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:26:26.479269 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896fcda-39a1-4d2b-90e5-b893954212b4 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:26.479852 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896fcda-39a1-4d2b-90e5-b893954212b4 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:26.479852 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896fcda-39a1-4d2b-90e5-b893954212b4 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:26.481230 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 21:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:26.486858 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827982d-2704-404c-8a21-c10fad504b8c None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:26.487292 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827982d-2704-404c-8a21-c10fad504b8c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:26.487426 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827982d-2704-404c-8a21-c10fad504b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:26.505589 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-2827982d-2704-404c-8a21-c10fad504b8c None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:26.506834 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2827982d-2704-404c-8a21-c10fad504b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:26.515527 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 21:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:26:26.821575 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896fcda-39a1-4d2b-90e5-b893954212b4 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:26.823353 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9896fcda-39a1-4d2b-90e5-b893954212b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:26.881280 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896fcda-39a1-4d2b-90e5-b893954212b4 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:26.885173 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f46d5-bf30-471f-9f04-d97a8798b058 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:26.885828 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f46d5-bf30-471f-9f04-d97a8798b058 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:26.886114 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f46d5-bf30-471f-9f04-d97a8798b058 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:26.886425 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f46d5-bf30-471f-9f04-d97a8798b058 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:26.895608 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f46d5-bf30-471f-9f04-d97a8798b058 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:26.897058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f46d5-bf30-471f-9f04-d97a8798b058 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:26.906654 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 763/1536] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:26:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:26:28.977401 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cdcdd-0b10-41bd-a7e3-f3b2be137eb9 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:28.977935 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cdcdd-0b10-41bd-a7e3-f3b2be137eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:28.977935 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cdcdd-0b10-41bd-a7e3-f3b2be137eb9 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:28.979294 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 21:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:28.984912 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d062c-61ce-45a4-8bfe-9e3229b608e6 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:28.985316 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d062c-61ce-45a4-8bfe-9e3229b608e6 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:28.985471 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d062c-61ce-45a4-8bfe-9e3229b608e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:29.004177 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-9c2d062c-61ce-45a4-8bfe-9e3229b608e6 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:29.005387 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9c2d062c-61ce-45a4-8bfe-9e3229b608e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:29.013595 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 21:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:26:29.317624 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cdcdd-0b10-41bd-a7e3-f3b2be137eb9 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:29.319327 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-385cdcdd-0b10-41bd-a7e3-f3b2be137eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:29.327753 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=65 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:29.333712 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cdcdd-0b10-41bd-a7e3-f3b2be137eb9 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:29.337250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5299c3-013d-402b-bfbc-b69822f465e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:29.337908 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5299c3-013d-402b-bfbc-b69822f465e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:29.338221 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5299c3-013d-402b-bfbc-b69822f465e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:29.338522 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5299c3-013d-402b-bfbc-b69822f465e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:29.348367 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5299c3-013d-402b-bfbc-b69822f465e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:29.349775 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5299c3-013d-402b-bfbc-b69822f465e1 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:29.359213 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 775/1539] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:26:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:26:38.998328 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=32 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:39.360130 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=5 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:03.011016 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8564abc-4b0b-4ec3-863e-09d665deb3e3 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:03.012000 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8564abc-4b0b-4ec3-863e-09d665deb3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:03.012738 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8564abc-4b0b-4ec3-863e-09d665deb3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:03.051404 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-a8564abc-4b0b-4ec3-863e-09d665deb3e3 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:03.052691 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a8564abc-4b0b-4ec3-863e-09d665deb3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:03.064032 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 765/1540] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:03.073433 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34673277-bfb4-4111-96f2-85818a3af77e None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:03.074054 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34673277-bfb4-4111-96f2-85818a3af77e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:03.074054 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34673277-bfb4-4111-96f2-85818a3af77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:03.100926 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-34673277-bfb4-4111-96f2-85818a3af77e None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:03.102201 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-34673277-bfb4-4111-96f2-85818a3af77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:03.120808 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 776/1541] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:03.126490 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8564abc-4b0b-4ec3-863e-09d665deb3e3 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:03.140812 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8564abc-4b0b-4ec3-863e-09d665deb3e3 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:03.149073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fa3c1-d7fb-4696-91f6-bfe7530dc343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:03.150090 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fa3c1-d7fb-4696-91f6-bfe7530dc343 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:03.150635 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fa3c1-d7fb-4696-91f6-bfe7530dc343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:03.151139 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fa3c1-d7fb-4696-91f6-bfe7530dc343 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:03.152098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fa3c1-d7fb-4696-91f6-bfe7530dc343 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:03.152771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fa3c1-d7fb-4696-91f6-bfe7530dc343 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:03.154950 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fa3c1-d7fb-4696-91f6-bfe7530dc343 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:03.170755 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 766/1542] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:03.179805 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34673277-bfb4-4111-96f2-85818a3af77e None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:03.194382 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34673277-bfb4-4111-96f2-85818a3af77e None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:03.199574 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60317c64-be3d-4e1e-b350-3a3c7c73d02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:03.200255 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60317c64-be3d-4e1e-b350-3a3c7c73d02a admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:03.200691 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60317c64-be3d-4e1e-b350-3a3c7c73d02a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:03.201138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60317c64-be3d-4e1e-b350-3a3c7c73d02a admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:03.201862 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60317c64-be3d-4e1e-b350-3a3c7c73d02a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:03.203841 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60317c64-be3d-4e1e-b350-3a3c7c73d02a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:03.316219 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 777/1543] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:03 2022] POST /identity/v3/projects => generated 391 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:03.317314 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b078688-3ec3-43ba-85c9-25d441138352 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:03.317927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b078688-3ec3-43ba-85c9-25d441138352 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:03.318465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b078688-3ec3-43ba-85c9-25d441138352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:03.320630 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60317c64-be3d-4e1e-b350-3a3c7c73d02a admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:03.351353 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-7b078688-3ec3-43ba-85c9-25d441138352 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:03.353940 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7b078688-3ec3-43ba-85c9-25d441138352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:03.410583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60317c64-be3d-4e1e-b350-3a3c7c73d02a admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:03.427956 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37936e64-9edf-466b-b67b-a405be100891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:03.428877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37936e64-9edf-466b-b67b-a405be100891 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:03.429086 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37936e64-9edf-466b-b67b-a405be100891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:03.429357 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37936e64-9edf-466b-b67b-a405be100891 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:03.430070 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37936e64-9edf-466b-b67b-a405be100891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:03.431268 dv-cinder-847335-3-smb devstack@keystone.service[80247]: WARNING py.warnings [None req-37936e64-9edf-466b-b67b-a405be100891 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 21:28:03.431268 dv-cinder-847335-3-smb devstack@keystone.service[80247]: warnings.warn(msg) Jul 05 21:28:03.431268 dv-cinder-847335-3-smb devstack@keystone.service[80247]: Jul 05 21:28:03.432508 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37936e64-9edf-466b-b67b-a405be100891 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:03.454048 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 767/1544] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:03.455554 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b246c70-15a9-4385-ac20-10dfa4f236fe None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:03.456012 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b246c70-15a9-4385-ac20-10dfa4f236fe None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:03.456298 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b246c70-15a9-4385-ac20-10dfa4f236fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:03.480962 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-2b246c70-15a9-4385-ac20-10dfa4f236fe None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:03.482793 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2b246c70-15a9-4385-ac20-10dfa4f236fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:03.493386 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 768/1545] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:03.493386 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d720352-a1eb-4214-a97a-78af12b2f6a3 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:03.493386 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d720352-a1eb-4214-a97a-78af12b2f6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:03.493727 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d720352-a1eb-4214-a97a-78af12b2f6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:03.516477 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-5d720352-a1eb-4214-a97a-78af12b2f6a3 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:03.518974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5d720352-a1eb-4214-a97a-78af12b2f6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:03.519869 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 778/1546] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:03 2022] POST /identity/v3/users => generated 296 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:03.521316 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d422f4-d9b8-4861-a8ce-57b457be4048 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:03.521763 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d422f4-d9b8-4861-a8ce-57b457be4048 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:03.525322 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d422f4-d9b8-4861-a8ce-57b457be4048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:03.530798 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 769/1547] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:03.532496 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954483aa-6d5b-491a-889d-b3eb125c76a6 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:03.532959 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954483aa-6d5b-491a-889d-b3eb125c76a6 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:03.533409 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954483aa-6d5b-491a-889d-b3eb125c76a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:03.544242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-10d422f4-d9b8-4861-a8ce-57b457be4048 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:03.545715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-10d422f4-d9b8-4861-a8ce-57b457be4048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:03.553951 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-954483aa-6d5b-491a-889d-b3eb125c76a6 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:03.554464 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 779/1548] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:03.555744 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a147ca6-a265-45bb-97b8-25f69f50a1fa None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:03.556037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a147ca6-a265-45bb-97b8-25f69f50a1fa None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:03.556293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-954483aa-6d5b-491a-889d-b3eb125c76a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:03.556509 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a147ca6-a265-45bb-97b8-25f69f50a1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:03.567348 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 770/1549] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:03.568944 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea26e38-59d0-4d9e-81a5-372fa595bf4d None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:03.569416 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea26e38-59d0-4d9e-81a5-372fa595bf4d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:03.569865 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea26e38-59d0-4d9e-81a5-372fa595bf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:03.582151 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-3a147ca6-a265-45bb-97b8-25f69f50a1fa None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:03.582151 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3a147ca6-a265-45bb-97b8-25f69f50a1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:03.591611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 780/1550] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:03.594665 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a147ca6-a265-45bb-97b8-25f69f50a1fa None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:03.594808 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-7ea26e38-59d0-4d9e-81a5-372fa595bf4d None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:03.594808 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7ea26e38-59d0-4d9e-81a5-372fa595bf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:03.602642 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 771/1551] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:03.604020 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df747f3-b153-4bbb-b6d5-6de4f5f1c1cb None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:03.604311 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df747f3-b153-4bbb-b6d5-6de4f5f1c1cb None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:03.604592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df747f3-b153-4bbb-b6d5-6de4f5f1c1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:03.606422 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a147ca6-a265-45bb-97b8-25f69f50a1fa None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:03.611305 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc96f30-2944-48e9-81e1-121ce908762c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:03.611979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc96f30-2944-48e9-81e1-121ce908762c admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:03.612305 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc96f30-2944-48e9-81e1-121ce908762c admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:03.612551 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc96f30-2944-48e9-81e1-121ce908762c admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:03.613288 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc96f30-2944-48e9-81e1-121ce908762c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:03.614948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc96f30-2944-48e9-81e1-121ce908762c admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:03.623203 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-5df747f3-b153-4bbb-b6d5-6de4f5f1c1cb None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:03.624405 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5df747f3-b153-4bbb-b6d5-6de4f5f1c1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:03.625750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 781/1552] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:03.627074 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c23551-0280-4de2-b9c7-2d6ea8a1417f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:03.627374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c23551-0280-4de2-b9c7-2d6ea8a1417f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:03.628051 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c23551-0280-4de2-b9c7-2d6ea8a1417f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:03.633121 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 772/1553] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:03.634362 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590997b-ee6f-4869-b347-44cdf0ff7448 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:03.634651 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590997b-ee6f-4869-b347-44cdf0ff7448 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:03.634933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590997b-ee6f-4869-b347-44cdf0ff7448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:03.647378 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-a5c23551-0280-4de2-b9c7-2d6ea8a1417f None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:03.648595 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a5c23551-0280-4de2-b9c7-2d6ea8a1417f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:03.652870 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-b590997b-ee6f-4869-b347-44cdf0ff7448 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:03.654068 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b590997b-ee6f-4869-b347-44cdf0ff7448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:03.657148 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 782/1554] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:03.657929 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c23551-0280-4de2-b9c7-2d6ea8a1417f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:03.665105 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 773/1555] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:03.666228 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf57def-6474-44d7-891e-70a51171fcfc None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:03.666521 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf57def-6474-44d7-891e-70a51171fcfc None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:03.666802 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf57def-6474-44d7-891e-70a51171fcfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:03.668585 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c23551-0280-4de2-b9c7-2d6ea8a1417f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:03.673598 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401944d-fa7c-4194-987e-93bc5b06030d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:03.674325 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401944d-fa7c-4194-987e-93bc5b06030d admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:03.674611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401944d-fa7c-4194-987e-93bc5b06030d admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:03.674921 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401944d-fa7c-4194-987e-93bc5b06030d admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:03.675655 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401944d-fa7c-4194-987e-93bc5b06030d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:03.675965 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401944d-fa7c-4194-987e-93bc5b06030d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:03.676985 dv-cinder-847335-3-smb devstack@keystone.service[80247]: WARNING py.warnings [None req-a401944d-fa7c-4194-987e-93bc5b06030d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 21:28:03.676985 dv-cinder-847335-3-smb devstack@keystone.service[80247]: warnings.warn(msg) Jul 05 21:28:03.676985 dv-cinder-847335-3-smb devstack@keystone.service[80247]: Jul 05 21:28:03.677932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401944d-fa7c-4194-987e-93bc5b06030d admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:03.684168 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-ccf57def-6474-44d7-891e-70a51171fcfc None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:03.690786 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ccf57def-6474-44d7-891e-70a51171fcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:03.690907 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 783/1556] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:03.691725 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17fb3e-b037-41dd-9b98-7fde4b2c9c08 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:03.692023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17fb3e-b037-41dd-9b98-7fde4b2c9c08 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:03.692308 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17fb3e-b037-41dd-9b98-7fde4b2c9c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:03.698160 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 774/1557] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:03.698160 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf57def-6474-44d7-891e-70a51171fcfc None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:03.706701 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf57def-6474-44d7-891e-70a51171fcfc None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:03.711220 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b145085-7d74-40bf-9153-ed1a617b83c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:03.711883 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-6b17fb3e-b037-41dd-9b98-7fde4b2c9c08 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:03.712013 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b145085-7d74-40bf-9153-ed1a617b83c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:03.712164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b145085-7d74-40bf-9153-ed1a617b83c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:03.712499 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b145085-7d74-40bf-9153-ed1a617b83c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:03.713137 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6b17fb3e-b037-41dd-9b98-7fde4b2c9c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:03.713268 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b145085-7d74-40bf-9153-ed1a617b83c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:03.713510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b145085-7d74-40bf-9153-ed1a617b83c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:03.715194 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b145085-7d74-40bf-9153-ed1a617b83c7 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:03.721497 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 784/1558] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:03.722329 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17fb3e-b037-41dd-9b98-7fde4b2c9c08 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:03.727378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 775/1559] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:03.728671 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6a77c-d3c0-4cab-8d47-987f65fcf6fb None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:03.728958 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6a77c-d3c0-4cab-8d47-987f65fcf6fb None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:03.729232 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6a77c-d3c0-4cab-8d47-987f65fcf6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:03.735940 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17fb3e-b037-41dd-9b98-7fde4b2c9c08 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:03.741977 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa03d8-8d70-4b0e-aae4-8c91f1fbca21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:03.742701 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa03d8-8d70-4b0e-aae4-8c91f1fbca21 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:03.743118 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa03d8-8d70-4b0e-aae4-8c91f1fbca21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:03.743526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa03d8-8d70-4b0e-aae4-8c91f1fbca21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:03.744269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa03d8-8d70-4b0e-aae4-8c91f1fbca21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:03.745904 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa03d8-8d70-4b0e-aae4-8c91f1fbca21 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:03.747969 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-caa6a77c-d3c0-4cab-8d47-987f65fcf6fb None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:03.749161 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-caa6a77c-d3c0-4cab-8d47-987f65fcf6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:03.757006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 785/1560] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:03.757350 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 776/1561] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:03.758148 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6a77c-d3c0-4cab-8d47-987f65fcf6fb None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:03.758274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa03d8-8d70-4b0e-aae4-8c91f1fbca21 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:03.768711 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6a77c-d3c0-4cab-8d47-987f65fcf6fb None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:03.769254 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa03d8-8d70-4b0e-aae4-8c91f1fbca21 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:03.773303 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a306bbf-85ca-4232-bbd2-4465be53d700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:03.773950 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a306bbf-85ca-4232-bbd2-4465be53d700 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:03.774202 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeaf18e-c948-4522-a4e0-c0433ec0013a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:03.774345 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a306bbf-85ca-4232-bbd2-4465be53d700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:03.774580 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a306bbf-85ca-4232-bbd2-4465be53d700 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:03.774856 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeaf18e-c948-4522-a4e0-c0433ec0013a admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:03.775144 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeaf18e-c948-4522-a4e0-c0433ec0013a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:03.775422 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeaf18e-c948-4522-a4e0-c0433ec0013a admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:03.775539 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a306bbf-85ca-4232-bbd2-4465be53d700 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:03.775733 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a306bbf-85ca-4232-bbd2-4465be53d700 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:03.776149 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeaf18e-c948-4522-a4e0-c0433ec0013a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:03.776461 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeaf18e-c948-4522-a4e0-c0433ec0013a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:03.777435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a306bbf-85ca-4232-bbd2-4465be53d700 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:03.778184 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeaf18e-c948-4522-a4e0-c0433ec0013a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:03.789512 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 777/1562] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:03.790326 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a306bbf-85ca-4232-bbd2-4465be53d700 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:03.798239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 786/1563] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:03.798239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4df13-32df-4bfa-94ec-5783967e135b None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:03.798239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4df13-32df-4bfa-94ec-5783967e135b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:03.798239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4df13-32df-4bfa-94ec-5783967e135b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:03.802488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a306bbf-85ca-4232-bbd2-4465be53d700 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:03.807287 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc790b11-5b83-4b41-8957-64853a85ee80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:03.807932 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc790b11-5b83-4b41-8957-64853a85ee80 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:03.808212 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc790b11-5b83-4b41-8957-64853a85ee80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:03.808482 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc790b11-5b83-4b41-8957-64853a85ee80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:03.809170 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc790b11-5b83-4b41-8957-64853a85ee80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:03.810869 dv-cinder-847335-3-smb devstack@keystone.service[80246]: WARNING py.warnings [None req-cc790b11-5b83-4b41-8957-64853a85ee80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 21:28:03.810869 dv-cinder-847335-3-smb devstack@keystone.service[80246]: warnings.warn(msg) Jul 05 21:28:03.810869 dv-cinder-847335-3-smb devstack@keystone.service[80246]: Jul 05 21:28:03.812133 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc790b11-5b83-4b41-8957-64853a85ee80 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:03.812344 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-49d4df13-32df-4bfa-94ec-5783967e135b None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:03.813545 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-49d4df13-32df-4bfa-94ec-5783967e135b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:03.821728 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 787/1564] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:03.822465 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4df13-32df-4bfa-94ec-5783967e135b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:03.832853 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4df13-32df-4bfa-94ec-5783967e135b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:03.837681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da38d0-75c4-46f3-93de-e4b1e6aee1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:03.838355 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da38d0-75c4-46f3-93de-e4b1e6aee1bc admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:03.838642 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da38d0-75c4-46f3-93de-e4b1e6aee1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:03.838921 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da38d0-75c4-46f3-93de-e4b1e6aee1bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:03.839667 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da38d0-75c4-46f3-93de-e4b1e6aee1bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:03.839999 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da38d0-75c4-46f3-93de-e4b1e6aee1bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:03.841750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da38d0-75c4-46f3-93de-e4b1e6aee1bc admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:03.853729 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 788/1565] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:03.854508 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da38d0-75c4-46f3-93de-e4b1e6aee1bc admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:03.864810 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da38d0-75c4-46f3-93de-e4b1e6aee1bc admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:03.869345 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d3ef0-4012-484e-85b7-48716a6e1b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:03.869960 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d3ef0-4012-484e-85b7-48716a6e1b36 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:03.870279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d3ef0-4012-484e-85b7-48716a6e1b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:03.875452 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d3ef0-4012-484e-85b7-48716a6e1b36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:03.875452 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d3ef0-4012-484e-85b7-48716a6e1b36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:03.875452 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d3ef0-4012-484e-85b7-48716a6e1b36 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:04.016408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 789/1566] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:03 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:04.016408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d3ef0-4012-484e-85b7-48716a6e1b36 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:04.021527 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:04.077582 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d3ef0-4012-484e-85b7-48716a6e1b36 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:04.082433 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6de084-6edb-48ed-aeb9-84a19ae7bc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:04.083317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6de084-6edb-48ed-aeb9-84a19ae7bc5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:04.083598 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6de084-6edb-48ed-aeb9-84a19ae7bc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:04.083875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6de084-6edb-48ed-aeb9-84a19ae7bc5c admin admin] PATH_INFO: `/v3/projects/b8185d7c4cc047feba5a64699c26550e/users/1f329dcc462c425c8a9ab50e799e4edd/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:04.092372 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 778/1567] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:03 2022] POST /identity/v3/projects => generated 373 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:04.092372 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc790b11-5b83-4b41-8957-64853a85ee80 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:04.100522 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6de084-6edb-48ed-aeb9-84a19ae7bc5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8185d7c4cc047feba5a64699c26550e, user_id=1f329dcc462c425c8a9ab50e799e4edd, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:04.104103 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6de084-6edb-48ed-aeb9-84a19ae7bc5c admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:04.133344 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:04.152152 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc790b11-5b83-4b41-8957-64853a85ee80 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:04.156877 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993518e-de63-43f7-b128-eb2d50c304ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:04.157536 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993518e-de63-43f7-b128-eb2d50c304ed admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:04.157821 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993518e-de63-43f7-b128-eb2d50c304ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:04.158099 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993518e-de63-43f7-b128-eb2d50c304ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:04.158885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993518e-de63-43f7-b128-eb2d50c304ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:04.159214 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993518e-de63-43f7-b128-eb2d50c304ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:04.160834 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993518e-de63-43f7-b128-eb2d50c304ed admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:04.173317 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 779/1568] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:04.175515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 790/1569] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:04 2022] PUT /identity/v3/projects/b8185d7c4cc047feba5a64699c26550e/users/1f329dcc462c425c8a9ab50e799e4edd/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:04.175665 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993518e-de63-43f7-b128-eb2d50c304ed admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:04.181796 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6de084-6edb-48ed-aeb9-84a19ae7bc5c admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:04.188439 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993518e-de63-43f7-b128-eb2d50c304ed admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:04.241629 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6de084-6edb-48ed-aeb9-84a19ae7bc5c admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:04.245448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19fded-6aa6-42f1-bebc-336ce225b283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:04.246251 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb862eb-ce03-4300-9bdb-dad254035c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:04.246430 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19fded-6aa6-42f1-bebc-336ce225b283 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:04.246661 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19fded-6aa6-42f1-bebc-336ce225b283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:04.246907 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb862eb-ce03-4300-9bdb-dad254035c66 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:04.247021 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19fded-6aa6-42f1-bebc-336ce225b283 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:04.247325 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb862eb-ce03-4300-9bdb-dad254035c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:04.247630 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb862eb-ce03-4300-9bdb-dad254035c66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:04.248234 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19fded-6aa6-42f1-bebc-336ce225b283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:04.248353 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb862eb-ce03-4300-9bdb-dad254035c66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:04.250189 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19fded-6aa6-42f1-bebc-336ce225b283 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:04.250310 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb862eb-ce03-4300-9bdb-dad254035c66 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:04.346760 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 791/1570] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:04 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:04.347571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb862eb-ce03-4300-9bdb-dad254035c66 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:04.359845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 780/1571] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:04 2022] POST /identity/v3/projects => generated 403 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:04.360968 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19fded-6aa6-42f1-bebc-336ce225b283 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:04.413045 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb862eb-ce03-4300-9bdb-dad254035c66 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:04.423573 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19fded-6aa6-42f1-bebc-336ce225b283 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:04.428287 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b8492-cbf0-4e5e-a57e-5bcd1e2301a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:04.428945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b8492-cbf0-4e5e-a57e-5bcd1e2301a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:04.429228 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b8492-cbf0-4e5e-a57e-5bcd1e2301a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:04.429503 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b8492-cbf0-4e5e-a57e-5bcd1e2301a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:04.430216 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b8492-cbf0-4e5e-a57e-5bcd1e2301a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:04.432178 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b8492-cbf0-4e5e-a57e-5bcd1e2301a5 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:04.439018 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:04.470952 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57e2a7-f4dc-4282-b87b-dc227ae4dbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:04.471627 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57e2a7-f4dc-4282-b87b-dc227ae4dbe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:04.471921 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57e2a7-f4dc-4282-b87b-dc227ae4dbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:04.472188 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57e2a7-f4dc-4282-b87b-dc227ae4dbe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:04.472914 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57e2a7-f4dc-4282-b87b-dc227ae4dbe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:04.473223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57e2a7-f4dc-4282-b87b-dc227ae4dbe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:04.475022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57e2a7-f4dc-4282-b87b-dc227ae4dbe7 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:04.487500 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 792/1572] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:04.488270 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57e2a7-f4dc-4282-b87b-dc227ae4dbe7 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:04.497746 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57e2a7-f4dc-4282-b87b-dc227ae4dbe7 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:04.502387 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66acea4-b85a-430f-8dd6-00167f652bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:04.503019 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66acea4-b85a-430f-8dd6-00167f652bca admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:04.503302 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66acea4-b85a-430f-8dd6-00167f652bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:04.503584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66acea4-b85a-430f-8dd6-00167f652bca admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:04.504254 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66acea4-b85a-430f-8dd6-00167f652bca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:04.506390 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66acea4-b85a-430f-8dd6-00167f652bca admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:04.522856 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 781/1573] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:04 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:04.523887 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b8492-cbf0-4e5e-a57e-5bcd1e2301a5 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:04.569470 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:04.584568 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 793/1574] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:04 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:04.587518 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b8492-cbf0-4e5e-a57e-5bcd1e2301a5 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:04.589321 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66acea4-b85a-430f-8dd6-00167f652bca admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:04.590386 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffaed4-e430-49ed-a54d-cab228b32d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:04.592294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffaed4-e430-49ed-a54d-cab228b32d5c admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:04.592294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffaed4-e430-49ed-a54d-cab228b32d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:04.592493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffaed4-e430-49ed-a54d-cab228b32d5c admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:04.593150 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffaed4-e430-49ed-a54d-cab228b32d5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:04.595701 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffaed4-e430-49ed-a54d-cab228b32d5c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:04.600721 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66acea4-b85a-430f-8dd6-00167f652bca admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:04.606110 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805ff28-8ba4-4845-8458-1293f75025c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:04.606813 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805ff28-8ba4-4845-8458-1293f75025c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:04.607094 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805ff28-8ba4-4845-8458-1293f75025c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:04.607372 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805ff28-8ba4-4845-8458-1293f75025c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:04.608056 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805ff28-8ba4-4845-8458-1293f75025c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:04.610059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805ff28-8ba4-4845-8458-1293f75025c9 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:04.716825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 782/1575] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:04 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:04.718263 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fe68f-b4a2-4d4b-bc18-8a68d267a94a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:04.718553 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fe68f-b4a2-4d4b-bc18-8a68d267a94a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:04.718831 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fe68f-b4a2-4d4b-bc18-8a68d267a94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:04.721021 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 794/1576] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:04 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:04.721839 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805ff28-8ba4-4845-8458-1293f75025c9 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:04.739761 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-7b0fe68f-b4a2-4d4b-bc18-8a68d267a94a None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:04.740970 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7b0fe68f-b4a2-4d4b-bc18-8a68d267a94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:04.801536 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805ff28-8ba4-4845-8458-1293f75025c9 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:04.805631 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 783/1577] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:04.806201 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc901803-fc5f-4df7-b50d-19a7fa7c9e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:04.806554 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fe68f-b4a2-4d4b-bc18-8a68d267a94a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:04.806875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc901803-fc5f-4df7-b50d-19a7fa7c9e9e admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:04.807166 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc901803-fc5f-4df7-b50d-19a7fa7c9e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:04.807447 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc901803-fc5f-4df7-b50d-19a7fa7c9e9e admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:04.808141 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc901803-fc5f-4df7-b50d-19a7fa7c9e9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:04.810182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc901803-fc5f-4df7-b50d-19a7fa7c9e9e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:04.817427 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fe68f-b4a2-4d4b-bc18-8a68d267a94a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:04.822073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88513a89-b4f6-4049-88c6-2e44ec58f1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:04.824596 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88513a89-b4f6-4049-88c6-2e44ec58f1a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:04.824879 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88513a89-b4f6-4049-88c6-2e44ec58f1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:04.825157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88513a89-b4f6-4049-88c6-2e44ec58f1a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:04.826588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88513a89-b4f6-4049-88c6-2e44ec58f1a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:04.828546 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88513a89-b4f6-4049-88c6-2e44ec58f1a3 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:04.911001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 795/1578] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:04 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:04.911755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc901803-fc5f-4df7-b50d-19a7fa7c9e9e admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:04.921917 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc901803-fc5f-4df7-b50d-19a7fa7c9e9e admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:04.926485 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf10ebc-65f3-4aa4-be06-790e7cdc1c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:04.927100 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf10ebc-65f3-4aa4-be06-790e7cdc1c6e admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:04.927382 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf10ebc-65f3-4aa4-be06-790e7cdc1c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:04.927653 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf10ebc-65f3-4aa4-be06-790e7cdc1c6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:04.928340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf10ebc-65f3-4aa4-be06-790e7cdc1c6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:04.930226 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf10ebc-65f3-4aa4-be06-790e7cdc1c6e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:04.944579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 784/1579] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:04 2022] POST /identity/v3/users => generated 302 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:04.945398 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88513a89-b4f6-4049-88c6-2e44ec58f1a3 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:04.956736 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88513a89-b4f6-4049-88c6-2e44ec58f1a3 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:04.963790 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a37354-9d29-40cc-9172-9ef7473050e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:04.964518 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a37354-9d29-40cc-9172-9ef7473050e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:04.964802 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a37354-9d29-40cc-9172-9ef7473050e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:04.965076 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a37354-9d29-40cc-9172-9ef7473050e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:04.965755 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a37354-9d29-40cc-9172-9ef7473050e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:04.968215 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a37354-9d29-40cc-9172-9ef7473050e2 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:05.030348 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 796/1580] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:04 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:05.031174 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf10ebc-65f3-4aa4-be06-790e7cdc1c6e admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:05.063823 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 785/1581] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:04 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:05.065080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a37354-9d29-40cc-9172-9ef7473050e2 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:05.075005 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a37354-9d29-40cc-9172-9ef7473050e2 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:05.078288 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:05.095568 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf10ebc-65f3-4aa4-be06-790e7cdc1c6e admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:05.100143 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be13b1-474c-491d-91b9-a6d0d7729163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:05.100806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be13b1-474c-491d-91b9-a6d0d7729163 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:05.101091 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be13b1-474c-491d-91b9-a6d0d7729163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:05.101370 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be13b1-474c-491d-91b9-a6d0d7729163 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:05.102128 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be13b1-474c-491d-91b9-a6d0d7729163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:05.103774 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be13b1-474c-491d-91b9-a6d0d7729163 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:05.113701 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 797/1582] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:05.114877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be13b1-474c-491d-91b9-a6d0d7729163 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:05.124922 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be13b1-474c-491d-91b9-a6d0d7729163 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:05.129833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3262b4-342c-4c34-bb8d-bf1a5212edba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:05.130511 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3262b4-342c-4c34-bb8d-bf1a5212edba admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:05.130822 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3262b4-342c-4c34-bb8d-bf1a5212edba admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:05.131123 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3262b4-342c-4c34-bb8d-bf1a5212edba admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:05.131885 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3262b4-342c-4c34-bb8d-bf1a5212edba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:05.133802 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3262b4-342c-4c34-bb8d-bf1a5212edba admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:05.136420 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d622e-fbf9-4a42-810e-445fda651894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:05.137085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d622e-fbf9-4a42-810e-445fda651894 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:05.137370 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d622e-fbf9-4a42-810e-445fda651894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:05.137646 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d622e-fbf9-4a42-810e-445fda651894 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:05.139037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d622e-fbf9-4a42-810e-445fda651894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:05.140655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d622e-fbf9-4a42-810e-445fda651894 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:05.151016 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 786/1583] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:05.152083 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d622e-fbf9-4a42-810e-445fda651894 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:05.191445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:05.207681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d622e-fbf9-4a42-810e-445fda651894 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:05.211347 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4a21c-7a58-41af-af78-047065f16891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:05.211986 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4a21c-7a58-41af-af78-047065f16891 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:05.212266 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4a21c-7a58-41af-af78-047065f16891 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:05.212575 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4a21c-7a58-41af-af78-047065f16891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:05.221493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4a21c-7a58-41af-af78-047065f16891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:05.222951 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4a21c-7a58-41af-af78-047065f16891 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:05.232642 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 787/1584] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:05.233449 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4a21c-7a58-41af-af78-047065f16891 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:05.235258 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 798/1585] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:05 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:05.236151 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3262b4-342c-4c34-bb8d-bf1a5212edba admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:05.246600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3262b4-342c-4c34-bb8d-bf1a5212edba admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:05.248470 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4a21c-7a58-41af-af78-047065f16891 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:05.252013 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9084c0-5a77-446f-8554-791a5ecac78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:05.252741 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9084c0-5a77-446f-8554-791a5ecac78b admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:05.253089 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9084c0-5a77-446f-8554-791a5ecac78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:05.253435 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9084c0-5a77-446f-8554-791a5ecac78b admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:05.253985 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43640f7-2bf6-4941-9f28-d7a47a32dd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:05.254585 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9084c0-5a77-446f-8554-791a5ecac78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:05.255116 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43640f7-2bf6-4941-9f28-d7a47a32dd80 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:05.255520 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43640f7-2bf6-4941-9f28-d7a47a32dd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:05.255995 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43640f7-2bf6-4941-9f28-d7a47a32dd80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:05.256315 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9084c0-5a77-446f-8554-791a5ecac78b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:05.256881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43640f7-2bf6-4941-9f28-d7a47a32dd80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:05.258734 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43640f7-2bf6-4941-9f28-d7a47a32dd80 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:05.271735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 799/1586] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:05.271735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9084c0-5a77-446f-8554-791a5ecac78b admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:05.272053 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 788/1587] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:05.272053 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43640f7-2bf6-4941-9f28-d7a47a32dd80 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:05.281997 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43640f7-2bf6-4941-9f28-d7a47a32dd80 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:05.282685 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9084c0-5a77-446f-8554-791a5ecac78b admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:05.287035 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94eab5-f363-414e-8d13-4cb1c459b8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:05.287206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05493188-3a0b-4797-853b-c5e9ba510a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:05.287692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94eab5-f363-414e-8d13-4cb1c459b8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:05.287838 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05493188-3a0b-4797-853b-c5e9ba510a30 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:05.287983 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94eab5-f363-414e-8d13-4cb1c459b8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:05.288136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05493188-3a0b-4797-853b-c5e9ba510a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:05.288269 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94eab5-f363-414e-8d13-4cb1c459b8c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:05.288390 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05493188-3a0b-4797-853b-c5e9ba510a30 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:05.288966 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05493188-3a0b-4797-853b-c5e9ba510a30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:05.289075 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94eab5-f363-414e-8d13-4cb1c459b8c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:05.290595 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94eab5-f363-414e-8d13-4cb1c459b8c4 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:05.290911 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05493188-3a0b-4797-853b-c5e9ba510a30 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:05.301560 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 789/1588] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:05.302405 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94eab5-f363-414e-8d13-4cb1c459b8c4 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:05.312935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94eab5-f363-414e-8d13-4cb1c459b8c4 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:05.317595 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7becd40-deb7-4943-90ea-17bff271a999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:05.318253 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7becd40-deb7-4943-90ea-17bff271a999 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:05.318537 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7becd40-deb7-4943-90ea-17bff271a999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:05.318810 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7becd40-deb7-4943-90ea-17bff271a999 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:05.319706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7becd40-deb7-4943-90ea-17bff271a999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:05.321313 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7becd40-deb7-4943-90ea-17bff271a999 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:05.331590 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 790/1589] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:05.332362 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7becd40-deb7-4943-90ea-17bff271a999 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:05.341503 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7becd40-deb7-4943-90ea-17bff271a999 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:05.346151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f33ea5-f1d5-47f9-bccc-b1966da1cd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:05.346761 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f33ea5-f1d5-47f9-bccc-b1966da1cd0b admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:05.347046 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f33ea5-f1d5-47f9-bccc-b1966da1cd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:05.347323 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f33ea5-f1d5-47f9-bccc-b1966da1cd0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:05.348010 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f33ea5-f1d5-47f9-bccc-b1966da1cd0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:05.349650 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f33ea5-f1d5-47f9-bccc-b1966da1cd0b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:05.359972 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 791/1590] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:05.360762 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f33ea5-f1d5-47f9-bccc-b1966da1cd0b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:05.370066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f33ea5-f1d5-47f9-bccc-b1966da1cd0b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:05.375607 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9e52a-b78e-43e9-b82c-36256aace41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:05.381127 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e52a-b78e-43e9-b82c-36256aace41a admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:05.381127 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e52a-b78e-43e9-b82c-36256aace41a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:05.381127 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e52a-b78e-43e9-b82c-36256aace41a admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:05.381127 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9e52a-b78e-43e9-b82c-36256aace41a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:05.381127 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9e52a-b78e-43e9-b82c-36256aace41a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:05.390258 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 792/1591] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:05.391156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9e52a-b78e-43e9-b82c-36256aace41a admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:05.400821 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9e52a-b78e-43e9-b82c-36256aace41a admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:05.405804 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d355f7-58af-4b37-b378-5e2d288bc069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:05.406783 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d355f7-58af-4b37-b378-5e2d288bc069 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:05.407271 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d355f7-58af-4b37-b378-5e2d288bc069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:05.417494 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d355f7-58af-4b37-b378-5e2d288bc069 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:05.417494 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d355f7-58af-4b37-b378-5e2d288bc069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:05.417494 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d355f7-58af-4b37-b378-5e2d288bc069 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:05.417783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 800/1592] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:05 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:05.417783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05493188-3a0b-4797-853b-c5e9ba510a30 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:05.423075 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 793/1593] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:05.423998 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d355f7-58af-4b37-b378-5e2d288bc069 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:05.431742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05493188-3a0b-4797-853b-c5e9ba510a30 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:05.436470 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d355f7-58af-4b37-b378-5e2d288bc069 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:05.438636 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751a5c2-8c61-4afe-82bc-86b6eeaa80b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:05.439491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751a5c2-8c61-4afe-82bc-86b6eeaa80b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:05.439926 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751a5c2-8c61-4afe-82bc-86b6eeaa80b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:05.440453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751a5c2-8c61-4afe-82bc-86b6eeaa80b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:05.441338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751a5c2-8c61-4afe-82bc-86b6eeaa80b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:05.442196 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f42bd-3330-4434-af7b-9aa0487bcfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:05.442882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f42bd-3330-4434-af7b-9aa0487bcfe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:05.443009 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751a5c2-8c61-4afe-82bc-86b6eeaa80b4 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:05.443283 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f42bd-3330-4434-af7b-9aa0487bcfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:05.443800 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f42bd-3330-4434-af7b-9aa0487bcfe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:05.444522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f42bd-3330-4434-af7b-9aa0487bcfe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:05.446219 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f42bd-3330-4434-af7b-9aa0487bcfe5 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:05.454462 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 801/1594] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:05.455235 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751a5c2-8c61-4afe-82bc-86b6eeaa80b4 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:05.458767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 794/1595] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:05.459903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f42bd-3330-4434-af7b-9aa0487bcfe5 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:05.467607 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751a5c2-8c61-4afe-82bc-86b6eeaa80b4 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:05.472115 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f42bd-3330-4434-af7b-9aa0487bcfe5 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:05.473930 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86bafb-4a10-4c82-b979-73ad2d8b1498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:05.475005 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86bafb-4a10-4c82-b979-73ad2d8b1498 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:05.475347 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86bafb-4a10-4c82-b979-73ad2d8b1498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:05.475633 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86bafb-4a10-4c82-b979-73ad2d8b1498 admin admin] PATH_INFO: `/v3/projects/d4714768c4d74b6399d830e422738458/users/06f950c835b045a290343f4cec9b506b/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:05.477512 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c7cdf0-993a-4570-9936-d8558f704d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:05.478520 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7cdf0-993a-4570-9936-d8558f704d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:05.478829 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7cdf0-993a-4570-9936-d8558f704d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:05.479110 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7cdf0-993a-4570-9936-d8558f704d6e admin admin] PATH_INFO: `/v3/projects/e6ee5ca64787453ba9c8cddb30b7b33d/users/cf7bd3d63f4c43fe9dadc11b874bd991/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:05.492647 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86bafb-4a10-4c82-b979-73ad2d8b1498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4714768c4d74b6399d830e422738458, user_id=06f950c835b045a290343f4cec9b506b, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:05.496104 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86bafb-4a10-4c82-b979-73ad2d8b1498 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:05.499099 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c7cdf0-993a-4570-9936-d8558f704d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6ee5ca64787453ba9c8cddb30b7b33d, user_id=cf7bd3d63f4c43fe9dadc11b874bd991, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:05.500387 dv-cinder-847335-3-smb devstack@keystone.service[80246]: WARNING py.warnings [None req-f6c7cdf0-993a-4570-9936-d8558f704d6e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 21:28:05.500387 dv-cinder-847335-3-smb devstack@keystone.service[80246]: warnings.warn(msg) Jul 05 21:28:05.500387 dv-cinder-847335-3-smb devstack@keystone.service[80246]: Jul 05 21:28:05.502757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c7cdf0-993a-4570-9936-d8558f704d6e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:05.596587 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 802/1596] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:05 2022] PUT /identity/v3/projects/d4714768c4d74b6399d830e422738458/users/06f950c835b045a290343f4cec9b506b/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:05.597426 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86bafb-4a10-4c82-b979-73ad2d8b1498 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:05.656071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 795/1597] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:05 2022] PUT /identity/v3/projects/e6ee5ca64787453ba9c8cddb30b7b33d/users/cf7bd3d63f4c43fe9dadc11b874bd991/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:05.657260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c7cdf0-993a-4570-9936-d8558f704d6e admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:05.676862 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86bafb-4a10-4c82-b979-73ad2d8b1498 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:05.742084 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c7cdf0-993a-4570-9936-d8558f704d6e admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:05.748198 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf01de-de5f-4f88-ae29-57f78e53c838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:05.749091 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf01de-de5f-4f88-ae29-57f78e53c838 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:05.749374 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf01de-de5f-4f88-ae29-57f78e53c838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:05.749651 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf01de-de5f-4f88-ae29-57f78e53c838 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:05.750491 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf01de-de5f-4f88-ae29-57f78e53c838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:05.752190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf01de-de5f-4f88-ae29-57f78e53c838 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:05.762567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af882b-c272-4498-8d7a-abdec18eeb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:05.763467 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af882b-c272-4498-8d7a-abdec18eeb05 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:05.764076 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af882b-c272-4498-8d7a-abdec18eeb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:05.764432 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af882b-c272-4498-8d7a-abdec18eeb05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:05.764742 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 796/1598] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:05.765649 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf01de-de5f-4f88-ae29-57f78e53c838 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:05.765865 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af882b-c272-4498-8d7a-abdec18eeb05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:05.768009 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af882b-c272-4498-8d7a-abdec18eeb05 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:05.774162 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:05.776181 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf01de-de5f-4f88-ae29-57f78e53c838 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:05.783491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 803/1599] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:05.783491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af882b-c272-4498-8d7a-abdec18eeb05 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:05.785675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ccf29-d453-44e3-8725-7f9a0929d41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:05.786819 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ccf29-d453-44e3-8725-7f9a0929d41e admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:05.787102 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ccf29-d453-44e3-8725-7f9a0929d41e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:05.787392 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ccf29-d453-44e3-8725-7f9a0929d41e admin admin] PATH_INFO: `/v3/projects/e3c107983f2c46a6a8d0ff79f5d05e1e/users/d02563e9cc594b319b356a6400121dac/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:05.792451 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af882b-c272-4498-8d7a-abdec18eeb05 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:05.798184 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a2d00-d80c-4781-b5c2-3e15f5d66000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:05.799297 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a2d00-d80c-4781-b5c2-3e15f5d66000 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:05.799717 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a2d00-d80c-4781-b5c2-3e15f5d66000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:05.800102 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a2d00-d80c-4781-b5c2-3e15f5d66000 admin admin] PATH_INFO: `/v3/projects/243cd73659c3454fb5724cfb6900807c/users/bf8ba3e86672440aa22ed3fae5d90721/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:05.809623 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ccf29-d453-44e3-8725-7f9a0929d41e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3c107983f2c46a6a8d0ff79f5d05e1e, user_id=d02563e9cc594b319b356a6400121dac, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:05.812576 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ccf29-d453-44e3-8725-7f9a0929d41e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:05.816646 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a2d00-d80c-4781-b5c2-3e15f5d66000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=243cd73659c3454fb5724cfb6900807c, user_id=bf8ba3e86672440aa22ed3fae5d90721, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:05.819496 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a2d00-d80c-4781-b5c2-3e15f5d66000 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:05.893103 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 797/1600] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:05 2022] PUT /identity/v3/projects/e3c107983f2c46a6a8d0ff79f5d05e1e/users/d02563e9cc594b319b356a6400121dac/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:05.894729 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ccf29-d453-44e3-8725-7f9a0929d41e admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:05.908774 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 804/1601] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:05 2022] PUT /identity/v3/projects/243cd73659c3454fb5724cfb6900807c/users/bf8ba3e86672440aa22ed3fae5d90721/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:05.911233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f7193-0b69-4b68-86bf-6989c711f816 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:05.912221 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f7193-0b69-4b68-86bf-6989c711f816 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:05.912608 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f7193-0b69-4b68-86bf-6989c711f816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:05.915928 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:05.940602 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e90f7193-0b69-4b68-86bf-6989c711f816 None None] MFA Rules not processed for user `06f950c835b045a290343f4cec9b506b`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:05.942709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e90f7193-0b69-4b68-86bf-6989c711f816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:05.971196 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ccf29-d453-44e3-8725-7f9a0929d41e admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:06.010672 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 805/1602] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:06.027267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a6955-9191-4609-9fa7-b56a375f21f5 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:06.030223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a6955-9191-4609-9fa7-b56a375f21f5 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:06.030679 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a6955-9191-4609-9fa7-b56a375f21f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:06.049496 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48313d03-349c-42f5-82dc-e74301e4dd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:06.051281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48313d03-349c-42f5-82dc-e74301e4dd12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:06.051433 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48313d03-349c-42f5-82dc-e74301e4dd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:06.051610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48313d03-349c-42f5-82dc-e74301e4dd12 admin admin] PATH_INFO: `/v3/projects/d1aa7ef43ac148ae9adc05d9c78c4134/users/0e1b6f5fa3df4b829f521e1154a1f304/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:06.066155 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-6a9a6955-9191-4609-9fa7-b56a375f21f5 None None] MFA Rules not processed for user `cf7bd3d63f4c43fe9dadc11b874bd991`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:06.067501 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6a9a6955-9191-4609-9fa7-b56a375f21f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:06.069133 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48313d03-349c-42f5-82dc-e74301e4dd12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1aa7ef43ac148ae9adc05d9c78c4134, user_id=0e1b6f5fa3df4b829f521e1154a1f304, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:06.072238 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48313d03-349c-42f5-82dc-e74301e4dd12 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:06.136099 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 806/1603] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:06.137051 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a6955-9191-4609-9fa7-b56a375f21f5 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:06.148454 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a6955-9191-4609-9fa7-b56a375f21f5 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:06.154277 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f97d1-ff1f-4953-9be6-05cd8c69ea83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:06.155052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f97d1-ff1f-4953-9be6-05cd8c69ea83 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:06.155337 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f97d1-ff1f-4953-9be6-05cd8c69ea83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:06.155642 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f97d1-ff1f-4953-9be6-05cd8c69ea83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:06.156339 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f97d1-ff1f-4953-9be6-05cd8c69ea83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:06.158051 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f97d1-ff1f-4953-9be6-05cd8c69ea83 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:06.162360 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 798/1604] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:05 2022] PUT /identity/v3/projects/d1aa7ef43ac148ae9adc05d9c78c4134/users/0e1b6f5fa3df4b829f521e1154a1f304/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:06.163248 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48313d03-349c-42f5-82dc-e74301e4dd12 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:06.170359 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 807/1605] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:06.172470 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b396f25-696e-49ab-83fb-887f6c8b9665 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:06.172470 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b396f25-696e-49ab-83fb-887f6c8b9665 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:06.172470 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b396f25-696e-49ab-83fb-887f6c8b9665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:06.198207 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-2b396f25-696e-49ab-83fb-887f6c8b9665 None None] MFA Rules not processed for user `d02563e9cc594b319b356a6400121dac`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:06.199426 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2b396f25-696e-49ab-83fb-887f6c8b9665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:06.231754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48313d03-349c-42f5-82dc-e74301e4dd12 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:06.237523 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23899ad9-687f-4e82-b0cf-dc3b36f4b44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:06.238623 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23899ad9-687f-4e82-b0cf-dc3b36f4b44e admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:06.238915 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23899ad9-687f-4e82-b0cf-dc3b36f4b44e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:06.239194 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23899ad9-687f-4e82-b0cf-dc3b36f4b44e admin admin] PATH_INFO: `/v3/projects/2b635bea44f64c5e9f457d9441a2bf0e/users/965ff1332c07459fad714ef47733b1fa/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:06.248070 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:06.256940 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23899ad9-687f-4e82-b0cf-dc3b36f4b44e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b635bea44f64c5e9f457d9441a2bf0e, user_id=965ff1332c07459fad714ef47733b1fa, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:06.259878 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23899ad9-687f-4e82-b0cf-dc3b36f4b44e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:06.276972 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 808/1606] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:06.279215 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2748b8c-eded-49fd-a216-cca925389c29 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:06.279728 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2748b8c-eded-49fd-a216-cca925389c29 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:06.280070 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2748b8c-eded-49fd-a216-cca925389c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:06.298093 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e2748b8c-eded-49fd-a216-cca925389c29 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:06.299449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e2748b8c-eded-49fd-a216-cca925389c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:06.307450 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 809/1607] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:06.308990 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155074ad-7254-427b-a02b-f832439f4727 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:06.309406 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155074ad-7254-427b-a02b-f832439f4727 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:06.309879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155074ad-7254-427b-a02b-f832439f4727 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:06.311971 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 810/1608] 10.222.0.13 () {54 vars in 961 bytes} [Tue Jul 5 21:28:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:28:06.313026 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b2d8f-7e51-4b7e-8991-240a72e5e190 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:06.313412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b2d8f-7e51-4b7e-8991-240a72e5e190 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:06.313794 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b2d8f-7e51-4b7e-8991-240a72e5e190 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:06.315671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 811/1609] 10.222.0.13 () {54 vars in 961 bytes} [Tue Jul 5 21:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:28:06.316889 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6e018-97bb-4871-94c5-4448abe50236 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:06.317283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6e018-97bb-4871-94c5-4448abe50236 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:06.317675 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6e018-97bb-4871-94c5-4448abe50236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:06.336555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-6bf6e018-97bb-4871-94c5-4448abe50236 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:06.337846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6bf6e018-97bb-4871-94c5-4448abe50236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:06.349657 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 812/1610] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:06.362029 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6e018-97bb-4871-94c5-4448abe50236 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:06.362343 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 799/1611] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:06 2022] PUT /identity/v3/projects/2b635bea44f64c5e9f457d9441a2bf0e/users/965ff1332c07459fad714ef47733b1fa/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:06.362343 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23899ad9-687f-4e82-b0cf-dc3b36f4b44e admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:06.362540 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6e018-97bb-4871-94c5-4448abe50236 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:06.418940 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342d509-db81-46e9-ab6d-151d7e553f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:06.420330 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342d509-db81-46e9-ab6d-151d7e553f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:06.421188 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342d509-db81-46e9-ab6d-151d7e553f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:06.421188 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342d509-db81-46e9-ab6d-151d7e553f67 admin admin] PATH_INFO: `/v3/projects/39964d4adc0941f5838e415d9efeb9ce/users/db2792db73c24a75a449894faf6fbf73/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:06.424901 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23899ad9-687f-4e82-b0cf-dc3b36f4b44e admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:06.429439 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6130c-4016-4232-b013-d14ccae63284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:06.430103 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6130c-4016-4232-b013-d14ccae63284 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:06.430453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6130c-4016-4232-b013-d14ccae63284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:06.430807 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6130c-4016-4232-b013-d14ccae63284 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:06.431660 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a6130c-4016-4232-b013-d14ccae63284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:06.433600 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a6130c-4016-4232-b013-d14ccae63284 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:06.436818 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342d509-db81-46e9-ab6d-151d7e553f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39964d4adc0941f5838e415d9efeb9ce, user_id=db2792db73c24a75a449894faf6fbf73, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:06.439585 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342d509-db81-46e9-ab6d-151d7e553f67 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:06.448061 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:06.545391 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 813/1612] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:06 2022] PUT /identity/v3/projects/39964d4adc0941f5838e415d9efeb9ce/users/db2792db73c24a75a449894faf6fbf73/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:06.546824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a87ab-ebf5-494f-aa81-3416a55137e0 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:06.547114 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a87ab-ebf5-494f-aa81-3416a55137e0 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:06.547391 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a87ab-ebf5-494f-aa81-3416a55137e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:06.564419 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-714a87ab-ebf5-494f-aa81-3416a55137e0 None None] MFA Rules not processed for user `910cd341df8943f18af2765e2a30b238`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:06.565782 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-714a87ab-ebf5-494f-aa81-3416a55137e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:06.577633 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 800/1613] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:06 2022] POST /identity/v3/projects => generated 403 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:06.579075 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18649ce3-3389-4ba3-8b9f-54fbc6a1adeb None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:06.579364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18649ce3-3389-4ba3-8b9f-54fbc6a1adeb None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:06.579648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18649ce3-3389-4ba3-8b9f-54fbc6a1adeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:06.598787 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-18649ce3-3389-4ba3-8b9f-54fbc6a1adeb None None] MFA Rules not processed for user `910cd341df8943f18af2765e2a30b238`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:06.600017 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-18649ce3-3389-4ba3-8b9f-54fbc6a1adeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:06.651352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 814/1614] 10.222.0.13 () {58 vars in 1058 bytes} [Tue Jul 5 21:28:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:06.652220 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a87ab-ebf5-494f-aa81-3416a55137e0 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:06.671741 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 801/1615] 10.222.0.13 () {58 vars in 1058 bytes} [Tue Jul 5 21:28:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:06.672653 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18649ce3-3389-4ba3-8b9f-54fbc6a1adeb None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:06.674035 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-18649ce3-3389-4ba3-8b9f-54fbc6a1adeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:06.707097 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a87ab-ebf5-494f-aa81-3416a55137e0 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:06.731181 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18649ce3-3389-4ba3-8b9f-54fbc6a1adeb None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:06.737078 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e87992-4f86-449e-bbf9-b8a6bfa98b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:06.749562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e87992-4f86-449e-bbf9-b8a6bfa98b3d service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:06.749562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e87992-4f86-449e-bbf9-b8a6bfa98b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:06.749562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e87992-4f86-449e-bbf9-b8a6bfa98b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:06.759909 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a83e8f-cfd5-41c9-a884-2bce4996bfee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:06.760661 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a83e8f-cfd5-41c9-a884-2bce4996bfee service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:06.761024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a83e8f-cfd5-41c9-a884-2bce4996bfee service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:06.761371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a83e8f-cfd5-41c9-a884-2bce4996bfee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:06.817118 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e87992-4f86-449e-bbf9-b8a6bfa98b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:06.818988 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e87992-4f86-449e-bbf9-b8a6bfa98b3d service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:06.829959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a83e8f-cfd5-41c9-a884-2bce4996bfee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:06.831316 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 802/1616] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:06.831451 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a83e8f-cfd5-41c9-a884-2bce4996bfee service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:06.832931 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a99b6-554e-4b9c-ac1d-ef4fe473133b None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:06.833376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a99b6-554e-4b9c-ac1d-ef4fe473133b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:06.833806 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a99b6-554e-4b9c-ac1d-ef4fe473133b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:06.848869 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 815/1617] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:06.850474 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7283519-8614-42ec-a48e-56bccd9e6707 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:06.850769 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7283519-8614-42ec-a48e-56bccd9e6707 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:06.851121 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7283519-8614-42ec-a48e-56bccd9e6707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:06.875510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-c87a99b6-554e-4b9c-ac1d-ef4fe473133b None None] MFA Rules not processed for user `965ff1332c07459fad714ef47733b1fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:06.875510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c87a99b6-554e-4b9c-ac1d-ef4fe473133b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:06.875898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f7283519-8614-42ec-a48e-56bccd9e6707 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:06.875898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f7283519-8614-42ec-a48e-56bccd9e6707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:06.893826 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 816/1618] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:06.898986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7283519-8614-42ec-a48e-56bccd9e6707 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:06.909567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7283519-8614-42ec-a48e-56bccd9e6707 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:06.919989 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87504cb-5e8d-43e7-b9a4-14ede61dbbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:06.921230 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87504cb-5e8d-43e7-b9a4-14ede61dbbea admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:06.921583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87504cb-5e8d-43e7-b9a4-14ede61dbbea admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:06.922159 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87504cb-5e8d-43e7-b9a4-14ede61dbbea admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:06.923057 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87504cb-5e8d-43e7-b9a4-14ede61dbbea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:06.926357 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87504cb-5e8d-43e7-b9a4-14ede61dbbea admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:06.959119 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 803/1619] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:06.959984 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a99b6-554e-4b9c-ac1d-ef4fe473133b None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:06.979182 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a99b6-554e-4b9c-ac1d-ef4fe473133b None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:06.987502 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e2829-f3a4-4cac-921b-e15e6bd9c74a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:06.988465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e2829-f3a4-4cac-921b-e15e6bd9c74a service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:06.988855 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e2829-f3a4-4cac-921b-e15e6bd9c74a service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:06.989146 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e2829-f3a4-4cac-921b-e15e6bd9c74a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:07.057464 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 817/1620] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:06 2022] POST /identity/v3/users => generated 308 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:07.057464 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87504cb-5e8d-43e7-b9a4-14ede61dbbea admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:07.076008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87504cb-5e8d-43e7-b9a4-14ede61dbbea admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:07.083783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673020e-91ee-4034-be3f-1a8b0e7b2962 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:07.084586 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673020e-91ee-4034-be3f-1a8b0e7b2962 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:07.085025 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673020e-91ee-4034-be3f-1a8b0e7b2962 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:07.085464 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673020e-91ee-4034-be3f-1a8b0e7b2962 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:07.098847 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:07.113845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e2829-f3a4-4cac-921b-e15e6bd9c74a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:07.116191 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e2829-f3a4-4cac-921b-e15e6bd9c74a service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:07.142968 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 804/1621] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:07.143672 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e2829-f3a4-4cac-921b-e15e6bd9c74a service nova] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:07.160196 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:07.174053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6673020e-91ee-4034-be3f-1a8b0e7b2962 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:07.176786 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6673020e-91ee-4034-be3f-1a8b0e7b2962 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:07.183287 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e2829-f3a4-4cac-921b-e15e6bd9c74a service nova] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:07.188482 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf1d17-e845-4e6b-9b3c-85f6e13d99e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:07.189356 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf1d17-e845-4e6b-9b3c-85f6e13d99e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:07.189920 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf1d17-e845-4e6b-9b3c-85f6e13d99e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:07.190382 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf1d17-e845-4e6b-9b3c-85f6e13d99e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:07.194506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 818/1622] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:07.195995 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673020e-91ee-4034-be3f-1a8b0e7b2962 service nova] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:07.210756 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf1d17-e845-4e6b-9b3c-85f6e13d99e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:07.213768 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf1d17-e845-4e6b-9b3c-85f6e13d99e6 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:07.239033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673020e-91ee-4034-be3f-1a8b0e7b2962 service nova] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:07.245290 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 805/1623] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:07.254641 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ae627-bb1e-4fdb-9885-f4af36d75af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:07.256570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ae627-bb1e-4fdb-9885-f4af36d75af6 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:07.257485 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ae627-bb1e-4fdb-9885-f4af36d75af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:07.257835 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ae627-bb1e-4fdb-9885-f4af36d75af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:07.258787 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ae627-bb1e-4fdb-9885-f4af36d75af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:07.261169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ae627-bb1e-4fdb-9885-f4af36d75af6 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:07.281175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 819/1624] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:07.282431 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf1d17-e845-4e6b-9b3c-85f6e13d99e6 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:07.296695 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf1d17-e845-4e6b-9b3c-85f6e13d99e6 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:07.309823 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03375ad-eed4-4b1c-b6f2-62a8a3a57ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:07.310974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03375ad-eed4-4b1c-b6f2-62a8a3a57ab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:07.311251 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03375ad-eed4-4b1c-b6f2-62a8a3a57ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:07.311460 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03375ad-eed4-4b1c-b6f2-62a8a3a57ab9 admin admin] PATH_INFO: `/v3/projects/eab4ae0654964a1ea55e62235d68d674/users/8ddce924f0fd49e6a07b11e7c64359bb/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:07.345223 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03375ad-eed4-4b1c-b6f2-62a8a3a57ab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eab4ae0654964a1ea55e62235d68d674, user_id=8ddce924f0fd49e6a07b11e7c64359bb, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:07.348334 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03375ad-eed4-4b1c-b6f2-62a8a3a57ab9 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:07.447121 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 806/1625] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:07 2022] PUT /identity/v3/projects/eab4ae0654964a1ea55e62235d68d674/users/8ddce924f0fd49e6a07b11e7c64359bb/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:07.451217 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ae627-bb1e-4fdb-9885-f4af36d75af6 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:07.469527 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ae627-bb1e-4fdb-9885-f4af36d75af6 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:07.511948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:07.529514 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade37b8-a2b4-4a4a-a444-3a173df77327 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:07.529864 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade37b8-a2b4-4a4a-a444-3a173df77327 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:07.530344 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade37b8-a2b4-4a4a-a444-3a173df77327 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:07.531824 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 807/1626] 10.222.0.13 () {54 vars in 912 bytes} [Tue Jul 5 21:28:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:28:07.541951 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73654b07-4123-482d-bfd7-2de775c9c170 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:07.542308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73654b07-4123-482d-bfd7-2de775c9c170 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:07.543027 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73654b07-4123-482d-bfd7-2de775c9c170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:07.575679 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-73654b07-4123-482d-bfd7-2de775c9c170 None None] MFA Rules not processed for user `910cd341df8943f18af2765e2a30b238`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:07.577093 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-73654b07-4123-482d-bfd7-2de775c9c170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:07.601023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19143090-5498-4bfb-8f74-ea7827f9c9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:07.601771 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19143090-5498-4bfb-8f74-ea7827f9c9e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:07.602135 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19143090-5498-4bfb-8f74-ea7827f9c9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:07.602452 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19143090-5498-4bfb-8f74-ea7827f9c9e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:07.604775 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19143090-5498-4bfb-8f74-ea7827f9c9e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:07.607035 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19143090-5498-4bfb-8f74-ea7827f9c9e4 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:07.629862 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 820/1627] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:07.631787 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19143090-5498-4bfb-8f74-ea7827f9c9e4 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:07.657655 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19143090-5498-4bfb-8f74-ea7827f9c9e4 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:07.672182 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:07.679724 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fee91-6009-4257-acd9-ef4f0bcedad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:07.680640 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fee91-6009-4257-acd9-ef4f0bcedad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:07.680919 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fee91-6009-4257-acd9-ef4f0bcedad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:07.682638 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fee91-6009-4257-acd9-ef4f0bcedad4 admin admin] PATH_INFO: `/v3/projects/eab4ae0654964a1ea55e62235d68d674/users/8ddce924f0fd49e6a07b11e7c64359bb/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:07.692283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fee91-6009-4257-acd9-ef4f0bcedad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eab4ae0654964a1ea55e62235d68d674, user_id=8ddce924f0fd49e6a07b11e7c64359bb, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:07.692283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fee91-6009-4257-acd9-ef4f0bcedad4 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:07.706165 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 821/1628] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:07 2022] PUT /identity/v3/projects/eab4ae0654964a1ea55e62235d68d674/users/8ddce924f0fd49e6a07b11e7c64359bb/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:07.711223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3f02d-d948-43de-8984-d9f0ba7b5f6b None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:07.711540 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3f02d-d948-43de-8984-d9f0ba7b5f6b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:07.712622 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3f02d-d948-43de-8984-d9f0ba7b5f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:07.727523 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 808/1629] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Jul 5 21:28:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:28:07.735557 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73654b07-4123-482d-bfd7-2de775c9c170 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:07.767377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d6b3f02d-d948-43de-8984-d9f0ba7b5f6b None None] MFA Rules not processed for user `8ddce924f0fd49e6a07b11e7c64359bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:07.768943 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d6b3f02d-d948-43de-8984-d9f0ba7b5f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:07.820566 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73654b07-4123-482d-bfd7-2de775c9c170 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:07.861607 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 822/1630] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:07 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:07.863770 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d556e8-f369-4e07-b177-4d5339f54435 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:07.864321 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d556e8-f369-4e07-b177-4d5339f54435 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:07.864731 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d556e8-f369-4e07-b177-4d5339f54435 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:07.872812 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 823/1631] 10.222.0.13 () {54 vars in 912 bytes} [Tue Jul 5 21:28:07 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:28:07.874576 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62174ed-7b7c-4f0f-96de-cccb2255f570 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:07.874868 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62174ed-7b7c-4f0f-96de-cccb2255f570 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:07.875155 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62174ed-7b7c-4f0f-96de-cccb2255f570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:07.907953 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-c62174ed-7b7c-4f0f-96de-cccb2255f570 None None] MFA Rules not processed for user `910cd341df8943f18af2765e2a30b238`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:07.909373 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c62174ed-7b7c-4f0f-96de-cccb2255f570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:07.912048 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0e589-b6c2-4335-ba4b-03e02aab6516 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:07.939459 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0e589-b6c2-4335-ba4b-03e02aab6516 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:07.940386 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0e589-b6c2-4335-ba4b-03e02aab6516 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:07.942444 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0e589-b6c2-4335-ba4b-03e02aab6516 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:08.016601 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 824/1632] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Jul 5 21:28:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:08.018303 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62174ed-7b7c-4f0f-96de-cccb2255f570 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:08.030340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62174ed-7b7c-4f0f-96de-cccb2255f570 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:08.036191 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134fef5-275f-42eb-b689-08a7946297dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:08.037354 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134fef5-275f-42eb-b689-08a7946297dd service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:08.037795 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134fef5-275f-42eb-b689-08a7946297dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:08.038676 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134fef5-275f-42eb-b689-08a7946297dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:08.052177 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134fef5-275f-42eb-b689-08a7946297dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:08.054629 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134fef5-275f-42eb-b689-08a7946297dd service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:08.075775 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 825/1633] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:08 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:08.089844 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0e589-b6c2-4335-ba4b-03e02aab6516 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:08.091835 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0e589-b6c2-4335-ba4b-03e02aab6516 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:08.104996 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 809/1634] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:08.202173 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134fef5-275f-42eb-b689-08a7946297dd service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:08.212260 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134fef5-275f-42eb-b689-08a7946297dd service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:08.216817 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255da95f-4a79-4cec-aa7e-aadbdaa692b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:08.217768 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255da95f-4a79-4cec-aa7e-aadbdaa692b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:08.218059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255da95f-4a79-4cec-aa7e-aadbdaa692b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:08.218369 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255da95f-4a79-4cec-aa7e-aadbdaa692b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:08.258592 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255da95f-4a79-4cec-aa7e-aadbdaa692b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:08.260307 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255da95f-4a79-4cec-aa7e-aadbdaa692b4 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:08.276103 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 826/1635] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:08.922235 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:09.707189 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0e589-b6c2-4335-ba4b-03e02aab6516 service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:09.728261 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0e589-b6c2-4335-ba4b-03e02aab6516 service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:09.740500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7be52-234e-4490-a413-15996e7e302e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:09.741168 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7be52-234e-4490-a413-15996e7e302e service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:09.741446 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7be52-234e-4490-a413-15996e7e302e service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:09.741717 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7be52-234e-4490-a413-15996e7e302e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:09.812300 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:09.893384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7be52-234e-4490-a413-15996e7e302e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:09.895135 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7be52-234e-4490-a413-15996e7e302e service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:09.917116 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 810/1636] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:09.972473 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255da95f-4a79-4cec-aa7e-aadbdaa692b4 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:10.297948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255da95f-4a79-4cec-aa7e-aadbdaa692b4 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:10.297948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07ec5a-ebb1-4cca-89e5-e14930e5b62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:10.297948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07ec5a-ebb1-4cca-89e5-e14930e5b62f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:10.297948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07ec5a-ebb1-4cca-89e5-e14930e5b62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:10.300320 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07ec5a-ebb1-4cca-89e5-e14930e5b62f admin admin] PATH_INFO: `/v3/users/d02563e9cc594b319b356a6400121dac` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:10.300320 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a07ec5a-ebb1-4cca-89e5-e14930e5b62f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d02563e9cc594b319b356a6400121dac)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:10.300320 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a07ec5a-ebb1-4cca-89e5-e14930e5b62f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:10.314634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7be52-234e-4490-a413-15996e7e302e service nova] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:10.314634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7be52-234e-4490-a413-15996e7e302e service nova] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:10.314634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d2ab1-80e6-4c99-97b7-3157c037ae6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:10.314634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d2ab1-80e6-4c99-97b7-3157c037ae6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:10.315759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d2ab1-80e6-4c99-97b7-3157c037ae6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:10.315759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d2ab1-80e6-4c99-97b7-3157c037ae6b admin admin] PATH_INFO: `/v3/users/965ff1332c07459fad714ef47733b1fa` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:10.315759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d2ab1-80e6-4c99-97b7-3157c037ae6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=965ff1332c07459fad714ef47733b1fa)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:10.315759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: WARNING py.warnings [None req-378d2ab1-80e6-4c99-97b7-3157c037ae6b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 21:28:10.315759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: warnings.warn(msg) Jul 05 21:28:10.315759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: Jul 05 21:28:10.315759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d2ab1-80e6-4c99-97b7-3157c037ae6b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:10.650307 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2a07ec5a-ebb1-4cca-89e5-e14930e5b62f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd02563e9cc594b319b356a6400121dac'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:10.711290 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-378d2ab1-80e6-4c99-97b7-3157c037ae6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '965ff1332c07459fad714ef47733b1fa'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:10.732986 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-378d2ab1-80e6-4c99-97b7-3157c037ae6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '965ff1332c07459fad714ef47733b1fa'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:10.752434 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2a07ec5a-ebb1-4cca-89e5-e14930e5b62f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd02563e9cc594b319b356a6400121dac'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:10.791546 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2a07ec5a-ebb1-4cca-89e5-e14930e5b62f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd02563e9cc594b319b356a6400121dac'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:10.811825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2a07ec5a-ebb1-4cca-89e5-e14930e5b62f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd02563e9cc594b319b356a6400121dac'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:10.812807 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2a07ec5a-ebb1-4cca-89e5-e14930e5b62f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd02563e9cc594b319b356a6400121dac'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:10.821827 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 827/1637] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:28:09 2022] DELETE /identity/v3/users/d02563e9cc594b319b356a6400121dac => generated 0 bytes in 851 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:10.827419 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe63426-f34a-469b-96cb-ac4c698534e2 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:10.827419 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe63426-f34a-469b-96cb-ac4c698534e2 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:10.827702 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe63426-f34a-469b-96cb-ac4c698534e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:10.858901 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-378d2ab1-80e6-4c99-97b7-3157c037ae6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '965ff1332c07459fad714ef47733b1fa'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:10.863700 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-378d2ab1-80e6-4c99-97b7-3157c037ae6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '965ff1332c07459fad714ef47733b1fa'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:10.866505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-8fe63426-f34a-469b-96cb-ac4c698534e2 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:10.867996 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8fe63426-f34a-469b-96cb-ac4c698534e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:10.951729 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-378d2ab1-80e6-4c99-97b7-3157c037ae6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '965ff1332c07459fad714ef47733b1fa'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:10.962291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 811/1638] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:28:10 2022] DELETE /identity/v3/users/965ff1332c07459fad714ef47733b1fa => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:10.964627 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c858832-17cf-441c-8faa-0a8029cf3401 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:10.964928 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c858832-17cf-441c-8faa-0a8029cf3401 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:10.965189 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c858832-17cf-441c-8faa-0a8029cf3401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:11.009208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:11.031345 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 828/1639] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:28:11.045183 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-7c858832-17cf-441c-8faa-0a8029cf3401 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:11.052295 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7c858832-17cf-441c-8faa-0a8029cf3401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:11.090218 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe63426-f34a-469b-96cb-ac4c698534e2 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:11.092176 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8fe63426-f34a-469b-96cb-ac4c698534e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:11.251783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe63426-f34a-469b-96cb-ac4c698534e2 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:11.335471 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 812/1640] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:11.355343 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c858832-17cf-441c-8faa-0a8029cf3401 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:11.356611 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7c858832-17cf-441c-8faa-0a8029cf3401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:11.380427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8964776-fb43-4850-aaf6-93eb4de62da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:11.381340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8964776-fb43-4850-aaf6-93eb4de62da1 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:11.381943 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8964776-fb43-4850-aaf6-93eb4de62da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:11.385321 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8964776-fb43-4850-aaf6-93eb4de62da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:11.405640 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8964776-fb43-4850-aaf6-93eb4de62da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:11.407741 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8964776-fb43-4850-aaf6-93eb4de62da1 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:11.426152 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 829/1641] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:11.447938 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:11.472743 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c858832-17cf-441c-8faa-0a8029cf3401 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:11.478259 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9f1d7-2106-4c3f-a0c2-f5dc1c2c0b19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:11.479254 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9f1d7-2106-4c3f-a0c2-f5dc1c2c0b19 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:11.479621 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9f1d7-2106-4c3f-a0c2-f5dc1c2c0b19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:11.479975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9f1d7-2106-4c3f-a0c2-f5dc1c2c0b19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:11.493641 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9f1d7-2106-4c3f-a0c2-f5dc1c2c0b19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:11.496377 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9f1d7-2106-4c3f-a0c2-f5dc1c2c0b19 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:11.515341 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 813/1642] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:28:13.119360 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8964776-fb43-4850-aaf6-93eb4de62da1 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:13.122240 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a8964776-fb43-4850-aaf6-93eb4de62da1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:13.152499 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8964776-fb43-4850-aaf6-93eb4de62da1 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:13.172055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf1a63-1d05-47d3-8e49-1e73d8bc5ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:13.173275 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf1a63-1d05-47d3-8e49-1e73d8bc5ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:13.173569 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf1a63-1d05-47d3-8e49-1e73d8bc5ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:13.173846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf1a63-1d05-47d3-8e49-1e73d8bc5ede admin admin] PATH_INFO: `/v3/projects/e3c107983f2c46a6a8d0ff79f5d05e1e` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:13.178772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf1a63-1d05-47d3-8e49-1e73d8bc5ede admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3c107983f2c46a6a8d0ff79f5d05e1e)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:13.182027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: WARNING py.warnings [None req-accf1a63-1d05-47d3-8e49-1e73d8bc5ede admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 21:28:13.182027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: warnings.warn(msg) Jul 05 21:28:13.182027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: Jul 05 21:28:13.201391 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf1a63-1d05-47d3-8e49-1e73d8bc5ede admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:13.447042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-accf1a63-1d05-47d3-8e49-1e73d8bc5ede admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3c107983f2c46a6a8d0ff79f5d05e1e', 'request_id': 'req-accf1a63-1d05-47d3-8e49-1e73d8bc5ede'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:13.517027 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9f1d7-2106-4c3f-a0c2-f5dc1c2c0b19 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:13.518591 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-94f9f1d7-2106-4c3f-a0c2-f5dc1c2c0b19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:13.554424 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9f1d7-2106-4c3f-a0c2-f5dc1c2c0b19 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:13.564280 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-accf1a63-1d05-47d3-8e49-1e73d8bc5ede admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3c107983f2c46a6a8d0ff79f5d05e1e', 'request_id': 'req-accf1a63-1d05-47d3-8e49-1e73d8bc5ede'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:13.574561 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-accf1a63-1d05-47d3-8e49-1e73d8bc5ede admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3c107983f2c46a6a8d0ff79f5d05e1e', 'request_id': 'req-accf1a63-1d05-47d3-8e49-1e73d8bc5ede'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:13.672600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-accf1a63-1d05-47d3-8e49-1e73d8bc5ede admin admin] The token cache is being invalidate because project e3c107983f2c46a6a8d0ff79f5d05e1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:28:13.673731 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-accf1a63-1d05-47d3-8e49-1e73d8bc5ede admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:13.674769 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-accf1a63-1d05-47d3-8e49-1e73d8bc5ede admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:13.677484 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 830/1643] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:28:13 2022] DELETE /identity/v3/projects/e3c107983f2c46a6a8d0ff79f5d05e1e => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:13.682095 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf1a63-1d05-47d3-8e49-1e73d8bc5ede admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:13.684549 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-accf1a63-1d05-47d3-8e49-1e73d8bc5ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:13.731716 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55859687-0096-42ff-baf5-ec594be8be74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:13.735615 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55859687-0096-42ff-baf5-ec594be8be74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:13.735912 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55859687-0096-42ff-baf5-ec594be8be74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:13.736198 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55859687-0096-42ff-baf5-ec594be8be74 admin admin] PATH_INFO: `/v3/projects/2b635bea44f64c5e9f457d9441a2bf0e` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:13.741079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55859687-0096-42ff-baf5-ec594be8be74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b635bea44f64c5e9f457d9441a2bf0e)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:13.744356 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55859687-0096-42ff-baf5-ec594be8be74 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:13.813899 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:13.843308 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf1a63-1d05-47d3-8e49-1e73d8bc5ede admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:13.849021 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8613b-1196-4742-ab3a-f6e0668ba3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:13.849927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8613b-1196-4742-ab3a-f6e0668ba3fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:13.850297 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8613b-1196-4742-ab3a-f6e0668ba3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:13.850523 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8613b-1196-4742-ab3a-f6e0668ba3fb admin admin] PATH_INFO: `/v3/users/8ddce924f0fd49e6a07b11e7c64359bb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:13.851841 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8613b-1196-4742-ab3a-f6e0668ba3fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ddce924f0fd49e6a07b11e7c64359bb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:13.855638 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8613b-1196-4742-ab3a-f6e0668ba3fb admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:14.003876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-55859687-0096-42ff-baf5-ec594be8be74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b635bea44f64c5e9f457d9441a2bf0e', 'request_id': 'req-55859687-0096-42ff-baf5-ec594be8be74'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:14.020390 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-55859687-0096-42ff-baf5-ec594be8be74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b635bea44f64c5e9f457d9441a2bf0e', 'request_id': 'req-55859687-0096-42ff-baf5-ec594be8be74'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:14.096098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-88d8613b-1196-4742-ab3a-f6e0668ba3fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ddce924f0fd49e6a07b11e7c64359bb'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:14.134541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-55859687-0096-42ff-baf5-ec594be8be74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b635bea44f64c5e9f457d9441a2bf0e', 'request_id': 'req-55859687-0096-42ff-baf5-ec594be8be74'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:14.179003 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-55859687-0096-42ff-baf5-ec594be8be74 admin admin] The token cache is being invalidate because project 2b635bea44f64c5e9f457d9441a2bf0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:28:14.183203 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-55859687-0096-42ff-baf5-ec594be8be74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:14.184597 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-55859687-0096-42ff-baf5-ec594be8be74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:14.191186 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 814/1644] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:28:13 2022] DELETE /identity/v3/projects/2b635bea44f64c5e9f457d9441a2bf0e => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:14.191186 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55859687-0096-42ff-baf5-ec594be8be74 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:14.191186 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-55859687-0096-42ff-baf5-ec594be8be74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:14.210998 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-88d8613b-1196-4742-ab3a-f6e0668ba3fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ddce924f0fd49e6a07b11e7c64359bb'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:14.237160 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-88d8613b-1196-4742-ab3a-f6e0668ba3fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ddce924f0fd49e6a07b11e7c64359bb'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:14.265299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-88d8613b-1196-4742-ab3a-f6e0668ba3fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ddce924f0fd49e6a07b11e7c64359bb'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:14.267481 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-88d8613b-1196-4742-ab3a-f6e0668ba3fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ddce924f0fd49e6a07b11e7c64359bb'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:14.289799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 831/1645] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:28:13 2022] DELETE /identity/v3/users/8ddce924f0fd49e6a07b11e7c64359bb => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:14.291383 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafb9ae-a1cb-4b69-a25b-e5cd2ae1f41a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:14.294368 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafb9ae-a1cb-4b69-a25b-e5cd2ae1f41a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:14.294771 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafb9ae-a1cb-4b69-a25b-e5cd2ae1f41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:14.347927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-8dafb9ae-a1cb-4b69-a25b-e5cd2ae1f41a None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:14.354572 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8dafb9ae-a1cb-4b69-a25b-e5cd2ae1f41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:14.384795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55859687-0096-42ff-baf5-ec594be8be74 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:14.454096 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:14.531402 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 832/1646] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:14.541973 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c053293-49e1-4c64-8aab-3c77692b105c None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:14.542667 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c053293-49e1-4c64-8aab-3c77692b105c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:14.542667 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c053293-49e1-4c64-8aab-3c77692b105c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:14.594856 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-2c053293-49e1-4c64-8aab-3c77692b105c None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:14.594856 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2c053293-49e1-4c64-8aab-3c77692b105c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:14.611801 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf33ae-6bef-484f-925e-1ff4bd9ad257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:14.613215 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf33ae-6bef-484f-925e-1ff4bd9ad257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:14.614681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf33ae-6bef-484f-925e-1ff4bd9ad257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:14.616262 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf33ae-6bef-484f-925e-1ff4bd9ad257 admin admin] PATH_INFO: `/v3/users/cf7bd3d63f4c43fe9dadc11b874bd991` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:14.618926 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf33ae-6bef-484f-925e-1ff4bd9ad257 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf7bd3d63f4c43fe9dadc11b874bd991)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:14.631898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 833/1647] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:14.635089 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c053293-49e1-4c64-8aab-3c77692b105c None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:14.635784 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf33ae-6bef-484f-925e-1ff4bd9ad257 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:14.649091 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c053293-49e1-4c64-8aab-3c77692b105c None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:14.659527 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25995d0-fc65-4ca5-ade5-b48dcdb0837f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:14.660799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25995d0-fc65-4ca5-ade5-b48dcdb0837f admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:14.662666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25995d0-fc65-4ca5-ade5-b48dcdb0837f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:14.671693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25995d0-fc65-4ca5-ade5-b48dcdb0837f admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:14.693941 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25995d0-fc65-4ca5-ade5-b48dcdb0837f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:14.701412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25995d0-fc65-4ca5-ade5-b48dcdb0837f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:14.707590 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25995d0-fc65-4ca5-ade5-b48dcdb0837f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:14.733357 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 834/1648] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:14.737759 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25995d0-fc65-4ca5-ade5-b48dcdb0837f admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:14.755391 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25995d0-fc65-4ca5-ade5-b48dcdb0837f admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:14.772083 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2d86a-8147-4076-bfbe-6b2d756c7e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:14.772856 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2d86a-8147-4076-bfbe-6b2d756c7e71 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:14.773220 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2d86a-8147-4076-bfbe-6b2d756c7e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:14.773570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2d86a-8147-4076-bfbe-6b2d756c7e71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:14.774580 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2d86a-8147-4076-bfbe-6b2d756c7e71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:14.776422 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2d86a-8147-4076-bfbe-6b2d756c7e71 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:14.889195 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0bcf33ae-6bef-484f-925e-1ff4bd9ad257 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf7bd3d63f4c43fe9dadc11b874bd991'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:14.907071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0bcf33ae-6bef-484f-925e-1ff4bd9ad257 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf7bd3d63f4c43fe9dadc11b874bd991'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:14.924733 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 835/1649] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:14 2022] POST /identity/v3/projects => generated 387 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:28:14.928655 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2d86a-8147-4076-bfbe-6b2d756c7e71 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:14.933526 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0bcf33ae-6bef-484f-925e-1ff4bd9ad257 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf7bd3d63f4c43fe9dadc11b874bd991'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:14.935332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0bcf33ae-6bef-484f-925e-1ff4bd9ad257 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf7bd3d63f4c43fe9dadc11b874bd991'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:15.045835 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0bcf33ae-6bef-484f-925e-1ff4bd9ad257 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf7bd3d63f4c43fe9dadc11b874bd991'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:15.056450 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 815/1650] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:28:14 2022] DELETE /identity/v3/users/cf7bd3d63f4c43fe9dadc11b874bd991 => generated 0 bytes in 865 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:15.060012 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a5544-e6cd-406f-97b3-42d695f1ac66 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:15.060373 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a5544-e6cd-406f-97b3-42d695f1ac66 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:15.060655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a5544-e6cd-406f-97b3-42d695f1ac66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:15.100419 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-e45a5544-e6cd-406f-97b3-42d695f1ac66 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:15.102799 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e45a5544-e6cd-406f-97b3-42d695f1ac66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:15.120951 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2d86a-8147-4076-bfbe-6b2d756c7e71 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:15.231440 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 816/1651] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:15.244903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a5544-e6cd-406f-97b3-42d695f1ac66 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:15.246534 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e45a5544-e6cd-406f-97b3-42d695f1ac66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:15.271737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2e120-3e50-47da-a728-052c3d84109a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:15.274145 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2e120-3e50-47da-a728-052c3d84109a admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:15.274145 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2e120-3e50-47da-a728-052c3d84109a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:15.274346 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2e120-3e50-47da-a728-052c3d84109a admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:15.275211 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2e120-3e50-47da-a728-052c3d84109a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:15.277164 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2e120-3e50-47da-a728-052c3d84109a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:15.288908 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:15.381429 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 836/1652] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:14 2022] POST /identity/v3/users => generated 294 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:28:15.386245 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2e120-3e50-47da-a728-052c3d84109a admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:15.389053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-fad2e120-3e50-47da-a728-052c3d84109a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:15.402053 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a5544-e6cd-406f-97b3-42d695f1ac66 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:15.412154 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2e120-3e50-47da-a728-052c3d84109a admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:15.416434 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669db04-9cbe-40e1-8d29-a14e40d0bcce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:15.417229 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669db04-9cbe-40e1-8d29-a14e40d0bcce service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:15.417515 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669db04-9cbe-40e1-8d29-a14e40d0bcce service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:15.417783 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669db04-9cbe-40e1-8d29-a14e40d0bcce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:15.419404 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65737a-a100-427a-9fe5-62f92ff91bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:15.420326 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65737a-a100-427a-9fe5-62f92ff91bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:15.420607 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65737a-a100-427a-9fe5-62f92ff91bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:15.421377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65737a-a100-427a-9fe5-62f92ff91bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:15.421928 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef65737a-a100-427a-9fe5-62f92ff91bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:15.424850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef65737a-a100-427a-9fe5-62f92ff91bf4 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:15.436723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669db04-9cbe-40e1-8d29-a14e40d0bcce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:15.438321 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669db04-9cbe-40e1-8d29-a14e40d0bcce service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:15.441197 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 837/1653] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:28:15.459289 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65737a-a100-427a-9fe5-62f92ff91bf4 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:15.466815 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 817/1654] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:28:15.505715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65737a-a100-427a-9fe5-62f92ff91bf4 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:15.525071 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd670e-5480-4cc6-b7ff-504fd47e146a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:15.525911 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd670e-5480-4cc6-b7ff-504fd47e146a admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:15.526700 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd670e-5480-4cc6-b7ff-504fd47e146a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:15.529722 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd670e-5480-4cc6-b7ff-504fd47e146a admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:15.533062 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd670e-5480-4cc6-b7ff-504fd47e146a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:15.535425 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd670e-5480-4cc6-b7ff-504fd47e146a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:15.553941 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 838/1655] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:15.558381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669db04-9cbe-40e1-8d29-a14e40d0bcce service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:15.568942 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669db04-9cbe-40e1-8d29-a14e40d0bcce service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:15.600368 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4fb80-ec5b-4f7e-95f7-78a9ae312d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:15.601275 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4fb80-ec5b-4f7e-95f7-78a9ae312d8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:15.601554 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4fb80-ec5b-4f7e-95f7-78a9ae312d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:15.601830 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4fb80-ec5b-4f7e-95f7-78a9ae312d8b admin admin] PATH_INFO: `/v3/projects/66ae8624ca63408284232815efe988ea/users/b0bd65910d9b4b8a9f65930fa78acdbe/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:15.662643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4fb80-ec5b-4f7e-95f7-78a9ae312d8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ae8624ca63408284232815efe988ea, user_id=b0bd65910d9b4b8a9f65930fa78acdbe, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:15.679341 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4fb80-ec5b-4f7e-95f7-78a9ae312d8b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:15.807802 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 818/1656] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:15 2022] PUT /identity/v3/projects/66ae8624ca63408284232815efe988ea/users/b0bd65910d9b4b8a9f65930fa78acdbe/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:15.819776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e829fd-0347-4bb4-8ac7-52bebb9bdb3f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:15.820085 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e829fd-0347-4bb4-8ac7-52bebb9bdb3f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:15.822387 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e829fd-0347-4bb4-8ac7-52bebb9bdb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:15.900352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-81e829fd-0347-4bb4-8ac7-52bebb9bdb3f None None] MFA Rules not processed for user `b0bd65910d9b4b8a9f65930fa78acdbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:15.902240 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-81e829fd-0347-4bb4-8ac7-52bebb9bdb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:15.967235 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:16.011072 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 839/1657] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:16.015407 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4fb80-ec5b-4f7e-95f7-78a9ae312d8b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:16.171954 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4fb80-ec5b-4f7e-95f7-78a9ae312d8b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:16.180154 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c48ea-97fb-43a1-bf14-91b46a740549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:16.180979 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c48ea-97fb-43a1-bf14-91b46a740549 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:16.181365 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c48ea-97fb-43a1-bf14-91b46a740549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:16.181742 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c48ea-97fb-43a1-bf14-91b46a740549 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:16.182602 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c48ea-97fb-43a1-bf14-91b46a740549 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:16.186483 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c48ea-97fb-43a1-bf14-91b46a740549 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:16.324168 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 819/1658] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:16 2022] POST /identity/v3/projects => generated 385 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:16.325358 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e829fd-0347-4bb4-8ac7-52bebb9bdb3f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:16.341727 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e829fd-0347-4bb4-8ac7-52bebb9bdb3f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:16.467196 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0763bf-7007-4ef3-abf4-9f7f5f3d3e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:16.468494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0763bf-7007-4ef3-abf4-9f7f5f3d3e06 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:16.469076 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0763bf-7007-4ef3-abf4-9f7f5f3d3e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:16.469523 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0763bf-7007-4ef3-abf4-9f7f5f3d3e06 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:16.470671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0763bf-7007-4ef3-abf4-9f7f5f3d3e06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:16.473021 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0763bf-7007-4ef3-abf4-9f7f5f3d3e06 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:16.620682 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 840/1659] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:16 2022] POST /identity/v3/users => generated 293 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:28:16.625065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c48ea-97fb-43a1-bf14-91b46a740549 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:16.636399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c48ea-97fb-43a1-bf14-91b46a740549 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:16.652342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c1575-11a0-4970-af77-31a1a19049f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:16.653434 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c1575-11a0-4970-af77-31a1a19049f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:16.653904 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c1575-11a0-4970-af77-31a1a19049f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:16.654493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c1575-11a0-4970-af77-31a1a19049f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:16.658307 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c1575-11a0-4970-af77-31a1a19049f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:16.660494 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c1575-11a0-4970-af77-31a1a19049f1 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:16.688187 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 820/1660] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:16.693167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0763bf-7007-4ef3-abf4-9f7f5f3d3e06 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:16.707381 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0763bf-7007-4ef3-abf4-9f7f5f3d3e06 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:16.716773 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e98985-4ed2-4b30-88fc-0b4251001a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:16.717974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e98985-4ed2-4b30-88fc-0b4251001a48 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:16.718403 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e98985-4ed2-4b30-88fc-0b4251001a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:16.718776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e98985-4ed2-4b30-88fc-0b4251001a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:16.720183 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e98985-4ed2-4b30-88fc-0b4251001a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:16.722658 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e98985-4ed2-4b30-88fc-0b4251001a48 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:16.748690 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 841/1661] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:16.752653 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c1575-11a0-4970-af77-31a1a19049f1 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:16.772357 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c1575-11a0-4970-af77-31a1a19049f1 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:16.801004 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84f73c-8e75-4b61-b014-33f12ae917d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:16.802307 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84f73c-8e75-4b61-b014-33f12ae917d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:16.802817 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84f73c-8e75-4b61-b014-33f12ae917d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:16.803293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84f73c-8e75-4b61-b014-33f12ae917d5 admin admin] PATH_INFO: `/v3/projects/4e6a60863da94f5a88d086c0f525f7e9/users/e231bec492464b3f9ebcbf12d46febd2/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:16.839756 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84f73c-8e75-4b61-b014-33f12ae917d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e6a60863da94f5a88d086c0f525f7e9, user_id=e231bec492464b3f9ebcbf12d46febd2, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:16.843840 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84f73c-8e75-4b61-b014-33f12ae917d5 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:17.005094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 821/1662] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:16 2022] PUT /identity/v3/projects/4e6a60863da94f5a88d086c0f525f7e9/users/e231bec492464b3f9ebcbf12d46febd2/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:17.020756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ec6ef-3a31-4053-a1a5-affbd9b1cf35 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:17.021047 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ec6ef-3a31-4053-a1a5-affbd9b1cf35 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:17.021331 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ec6ef-3a31-4053-a1a5-affbd9b1cf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:17.093281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-792ec6ef-3a31-4053-a1a5-affbd9b1cf35 None None] MFA Rules not processed for user `e231bec492464b3f9ebcbf12d46febd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:17.096032 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-792ec6ef-3a31-4053-a1a5-affbd9b1cf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:17.127724 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460382cc-0d6f-42ed-bfba-6b244e4e9edb None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:17.128570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460382cc-0d6f-42ed-bfba-6b244e4e9edb None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:17.129106 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460382cc-0d6f-42ed-bfba-6b244e4e9edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:17.191114 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-460382cc-0d6f-42ed-bfba-6b244e4e9edb None None] MFA Rules not processed for user `1f329dcc462c425c8a9ab50e799e4edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:17.194891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-460382cc-0d6f-42ed-bfba-6b244e4e9edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:17.284459 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 842/1663] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:17.288798 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ec6ef-3a31-4053-a1a5-affbd9b1cf35 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:17.354675 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:17.357996 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 822/1664] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:28:17.359240 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460382cc-0d6f-42ed-bfba-6b244e4e9edb None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:17.368031 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-460382cc-0d6f-42ed-bfba-6b244e4e9edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:17.447431 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ec6ef-3a31-4053-a1a5-affbd9b1cf35 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:17.472898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334a9f7-6859-4cf5-984e-1baf31fdc0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:17.473583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334a9f7-6859-4cf5-984e-1baf31fdc0c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:17.473867 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334a9f7-6859-4cf5-984e-1baf31fdc0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:17.474165 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334a9f7-6859-4cf5-984e-1baf31fdc0c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:17.474920 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334a9f7-6859-4cf5-984e-1baf31fdc0c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:17.476885 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334a9f7-6859-4cf5-984e-1baf31fdc0c9 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:17.581633 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460382cc-0d6f-42ed-bfba-6b244e4e9edb None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:17.627971 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eafbdf-2d2a-4300-aa9a-537a5d52863b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:17.638481 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 843/1665] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:17 2022] POST /identity/v3/projects => generated 385 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:28:17.638481 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83f5ae-b425-4f7d-a2ee-9da290e691d1 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:17.638914 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eafbdf-2d2a-4300-aa9a-537a5d52863b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:17.639002 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83f5ae-b425-4f7d-a2ee-9da290e691d1 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:17.639081 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eafbdf-2d2a-4300-aa9a-537a5d52863b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:17.639158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83f5ae-b425-4f7d-a2ee-9da290e691d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:17.639234 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eafbdf-2d2a-4300-aa9a-537a5d52863b admin admin] PATH_INFO: `/v3/projects/eab4ae0654964a1ea55e62235d68d674` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:17.639234 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eafbdf-2d2a-4300-aa9a-537a5d52863b admin admin] RBAC: Authorizing `identity:delete_project(project_id=eab4ae0654964a1ea55e62235d68d674)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:17.649880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eafbdf-2d2a-4300-aa9a-537a5d52863b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:17.686558 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-ad83f5ae-b425-4f7d-a2ee-9da290e691d1 None None] MFA Rules not processed for user `1f329dcc462c425c8a9ab50e799e4edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:17.687792 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ad83f5ae-b425-4f7d-a2ee-9da290e691d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:17.864246 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 844/1666] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:17.876508 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83f5ae-b425-4f7d-a2ee-9da290e691d1 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:17.918623 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-62eafbdf-2d2a-4300-aa9a-537a5d52863b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eab4ae0654964a1ea55e62235d68d674', 'request_id': 'req-62eafbdf-2d2a-4300-aa9a-537a5d52863b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:17.934597 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-62eafbdf-2d2a-4300-aa9a-537a5d52863b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eab4ae0654964a1ea55e62235d68d674', 'request_id': 'req-62eafbdf-2d2a-4300-aa9a-537a5d52863b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:17.986228 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83f5ae-b425-4f7d-a2ee-9da290e691d1 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:18.069805 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-62eafbdf-2d2a-4300-aa9a-537a5d52863b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eab4ae0654964a1ea55e62235d68d674', 'request_id': 'req-62eafbdf-2d2a-4300-aa9a-537a5d52863b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:18.091856 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-62eafbdf-2d2a-4300-aa9a-537a5d52863b admin admin] The token cache is being invalidate because project eab4ae0654964a1ea55e62235d68d674 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:28:18.092153 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-62eafbdf-2d2a-4300-aa9a-537a5d52863b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:18.095717 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-62eafbdf-2d2a-4300-aa9a-537a5d52863b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:18.097507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 823/1667] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:28:17 2022] DELETE /identity/v3/projects/eab4ae0654964a1ea55e62235d68d674 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:18.099637 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eafbdf-2d2a-4300-aa9a-537a5d52863b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:18.104304 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-62eafbdf-2d2a-4300-aa9a-537a5d52863b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:18.111674 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5309a-858d-47d1-b373-2e9767973d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:18.112561 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5309a-858d-47d1-b373-2e9767973d7d admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:18.113174 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5309a-858d-47d1-b373-2e9767973d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:18.113642 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5309a-858d-47d1-b373-2e9767973d7d admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:18.114904 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5309a-858d-47d1-b373-2e9767973d7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:18.117441 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5309a-858d-47d1-b373-2e9767973d7d admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:18.138750 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eafbdf-2d2a-4300-aa9a-537a5d52863b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:18.156169 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f082b-147d-4a0d-a21e-4041fe358521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:18.157331 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f082b-147d-4a0d-a21e-4041fe358521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:18.157745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f082b-147d-4a0d-a21e-4041fe358521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:18.158187 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f082b-147d-4a0d-a21e-4041fe358521 admin admin] PATH_INFO: `/v3/users/06f950c835b045a290343f4cec9b506b` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:18.159542 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f082b-147d-4a0d-a21e-4041fe358521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06f950c835b045a290343f4cec9b506b)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:18.161629 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f082b-147d-4a0d-a21e-4041fe358521 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:18.251969 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 845/1668] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:17 2022] POST /identity/v3/users => generated 299 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:18.253732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5309a-858d-47d1-b373-2e9767973d7d admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:18.262877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e1b5309a-858d-47d1-b373-2e9767973d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:18.391642 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:18.421976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-5a7f082b-147d-4a0d-a21e-4041fe358521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06f950c835b045a290343f4cec9b506b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:18.438531 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-5a7f082b-147d-4a0d-a21e-4041fe358521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06f950c835b045a290343f4cec9b506b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:18.453492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-5a7f082b-147d-4a0d-a21e-4041fe358521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06f950c835b045a290343f4cec9b506b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:18.455528 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-5a7f082b-147d-4a0d-a21e-4041fe358521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06f950c835b045a290343f4cec9b506b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:18.484326 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5309a-858d-47d1-b373-2e9767973d7d admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:18.491374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43c64a-4116-4d32-be37-2ddfdbea2a62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:18.492751 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43c64a-4116-4d32-be37-2ddfdbea2a62 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:18.493171 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43c64a-4116-4d32-be37-2ddfdbea2a62 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:18.493824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43c64a-4116-4d32-be37-2ddfdbea2a62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:18.496880 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8e43c64a-4116-4d32-be37-2ddfdbea2a62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:18.560513 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-5a7f082b-147d-4a0d-a21e-4041fe358521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06f950c835b045a290343f4cec9b506b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:18.568714 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 824/1669] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:28:18 2022] DELETE /identity/v3/users/06f950c835b045a290343f4cec9b506b => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:18.570399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d5009-45f7-41ef-8143-58c7dce32fe3 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:18.571377 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d5009-45f7-41ef-8143-58c7dce32fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:18.574509 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d5009-45f7-41ef-8143-58c7dce32fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:18.645654 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-e44d5009-45f7-41ef-8143-58c7dce32fe3 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:18.650208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e44d5009-45f7-41ef-8143-58c7dce32fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:18.674280 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43c64a-4116-4d32-be37-2ddfdbea2a62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:18.675929 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43c64a-4116-4d32-be37-2ddfdbea2a62 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:18.732056 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 846/1670] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:18.733106 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43c64a-4116-4d32-be37-2ddfdbea2a62 service nova] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:18.744543 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8e43c64a-4116-4d32-be37-2ddfdbea2a62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:18.772823 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43c64a-4116-4d32-be37-2ddfdbea2a62 service nova] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:18.865396 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73780adc-9602-45ea-af09-d69708ce5029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:18.867477 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73780adc-9602-45ea-af09-d69708ce5029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:18.867892 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73780adc-9602-45ea-af09-d69708ce5029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:18.868296 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73780adc-9602-45ea-af09-d69708ce5029 admin admin] PATH_INFO: `/v3/projects/e6ee5ca64787453ba9c8cddb30b7b33d` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:18.869654 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73780adc-9602-45ea-af09-d69708ce5029 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6ee5ca64787453ba9c8cddb30b7b33d)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:18.873373 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73780adc-9602-45ea-af09-d69708ce5029 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:18.877406 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 825/1671] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:18.878349 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d5009-45f7-41ef-8143-58c7dce32fe3 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:18.886343 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e44d5009-45f7-41ef-8143-58c7dce32fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:18.919061 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d5009-45f7-41ef-8143-58c7dce32fe3 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:18.927308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aed0be-1939-4dff-8a84-85f6789fa918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:18.928115 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aed0be-1939-4dff-8a84-85f6789fa918 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:18.928610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aed0be-1939-4dff-8a84-85f6789fa918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:18.929017 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aed0be-1939-4dff-8a84-85f6789fa918 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:18.929907 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aed0be-1939-4dff-8a84-85f6789fa918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:18.931716 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aed0be-1939-4dff-8a84-85f6789fa918 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:18.945122 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:18.954107 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 826/1672] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:18.955841 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0269724-f3c7-4ada-8606-e758b56ae382 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:18.956387 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0269724-f3c7-4ada-8606-e758b56ae382 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:18.956892 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0269724-f3c7-4ada-8606-e758b56ae382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:19.010373 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-c0269724-f3c7-4ada-8606-e758b56ae382 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:19.012848 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c0269724-f3c7-4ada-8606-e758b56ae382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:19.014156 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-73780adc-9602-45ea-af09-d69708ce5029 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6ee5ca64787453ba9c8cddb30b7b33d', 'request_id': 'req-73780adc-9602-45ea-af09-d69708ce5029'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:19.109564 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 827/1673] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:19.111180 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458f834-7319-47d1-98ea-7374d60cc2e7 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:19.111632 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458f834-7319-47d1-98ea-7374d60cc2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:19.112012 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458f834-7319-47d1-98ea-7374d60cc2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:19.134522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d458f834-7319-47d1-98ea-7374d60cc2e7 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:19.136291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d458f834-7319-47d1-98ea-7374d60cc2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:19.149954 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 828/1674] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:19.152564 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458f834-7319-47d1-98ea-7374d60cc2e7 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:19.154389 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-73780adc-9602-45ea-af09-d69708ce5029 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6ee5ca64787453ba9c8cddb30b7b33d', 'request_id': 'req-73780adc-9602-45ea-af09-d69708ce5029'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:19.164664 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-73780adc-9602-45ea-af09-d69708ce5029 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6ee5ca64787453ba9c8cddb30b7b33d', 'request_id': 'req-73780adc-9602-45ea-af09-d69708ce5029'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:19.171050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458f834-7319-47d1-98ea-7374d60cc2e7 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:19.177681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bff9c1-83f8-4da1-9bca-2718caafc7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:19.178817 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bff9c1-83f8-4da1-9bca-2718caafc7d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:19.179158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bff9c1-83f8-4da1-9bca-2718caafc7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:19.179511 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bff9c1-83f8-4da1-9bca-2718caafc7d9 admin admin] PATH_INFO: `/v3/projects/c62ad09cb7c740f8a34086c0e2d43b14/users/3f0d45982de54fee8c87231cfce66bea/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:19.198813 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-73780adc-9602-45ea-af09-d69708ce5029 admin admin] The token cache is being invalidate because project e6ee5ca64787453ba9c8cddb30b7b33d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:28:19.199498 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-73780adc-9602-45ea-af09-d69708ce5029 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:19.202696 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bff9c1-83f8-4da1-9bca-2718caafc7d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c62ad09cb7c740f8a34086c0e2d43b14, user_id=3f0d45982de54fee8c87231cfce66bea, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:19.204143 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-73780adc-9602-45ea-af09-d69708ce5029 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:19.205881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bff9c1-83f8-4da1-9bca-2718caafc7d9 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:19.210861 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 847/1675] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:28:18 2022] DELETE /identity/v3/projects/e6ee5ca64787453ba9c8cddb30b7b33d => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:19.210861 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73780adc-9602-45ea-af09-d69708ce5029 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:19.210861 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-73780adc-9602-45ea-af09-d69708ce5029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:19.317246 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 829/1676] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:19 2022] PUT /identity/v3/projects/c62ad09cb7c740f8a34086c0e2d43b14/users/3f0d45982de54fee8c87231cfce66bea/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:19.322716 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bff9c1-83f8-4da1-9bca-2718caafc7d9 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:19.327079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-84bff9c1-83f8-4da1-9bca-2718caafc7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:19.328983 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73780adc-9602-45ea-af09-d69708ce5029 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:19.410419 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7f847-13fa-46ad-adce-7c286f4d8bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:19.411628 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7f847-13fa-46ad-adce-7c286f4d8bda service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:19.412018 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7f847-13fa-46ad-adce-7c286f4d8bda service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:19.412439 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7f847-13fa-46ad-adce-7c286f4d8bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:19.414728 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2be7f847-13fa-46ad-adce-7c286f4d8bda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:19.513235 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bff9c1-83f8-4da1-9bca-2718caafc7d9 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:19.532566 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41987be5-d493-4309-a42c-e8bcae9448c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:19.533056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41987be5-d493-4309-a42c-e8bcae9448c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:19.533340 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41987be5-d493-4309-a42c-e8bcae9448c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:19.533610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41987be5-d493-4309-a42c-e8bcae9448c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:19.534377 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41987be5-d493-4309-a42c-e8bcae9448c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:19.534735 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41987be5-d493-4309-a42c-e8bcae9448c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:19.536483 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41987be5-d493-4309-a42c-e8bcae9448c2 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:19.569428 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 830/1677] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:19.573320 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc9cd6-a0d2-4055-a2dd-d97512cd8c4d None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:19.573606 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc9cd6-a0d2-4055-a2dd-d97512cd8c4d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:19.575150 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc9cd6-a0d2-4055-a2dd-d97512cd8c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:19.607690 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7f847-13fa-46ad-adce-7c286f4d8bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:19.612607 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7f847-13fa-46ad-adce-7c286f4d8bda service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:19.629516 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 848/1678] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:19.630741 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7f847-13fa-46ad-adce-7c286f4d8bda service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:19.632348 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2be7f847-13fa-46ad-adce-7c286f4d8bda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:19.641379 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:19.658697 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-74fc9cd6-a0d2-4055-a2dd-d97512cd8c4d None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:19.659217 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-74fc9cd6-a0d2-4055-a2dd-d97512cd8c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:19.662440 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7f847-13fa-46ad-adce-7c286f4d8bda service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:19.681605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484f0a3-86d1-458a-bc0c-7d61854d28cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:19.683156 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484f0a3-86d1-458a-bc0c-7d61854d28cc admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:19.686624 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484f0a3-86d1-458a-bc0c-7d61854d28cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:19.686624 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484f0a3-86d1-458a-bc0c-7d61854d28cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:19.686624 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484f0a3-86d1-458a-bc0c-7d61854d28cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:19.688025 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 831/1679] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:19.688287 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484f0a3-86d1-458a-bc0c-7d61854d28cc admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:19.688996 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc9cd6-a0d2-4055-a2dd-d97512cd8c4d None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:19.701335 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 849/1680] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:19.703166 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fc30d-f833-4bfe-b247-dbec343e6938 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:19.703581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fc30d-f833-4bfe-b247-dbec343e6938 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:19.704170 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fc30d-f833-4bfe-b247-dbec343e6938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:19.710587 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc9cd6-a0d2-4055-a2dd-d97512cd8c4d None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:19.733561 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d92fc30d-f833-4bfe-b247-dbec343e6938 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:19.734511 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b75ac7-3bf0-4427-83e7-ba83a103220a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:19.735186 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b75ac7-3bf0-4427-83e7-ba83a103220a admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:19.735475 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b75ac7-3bf0-4427-83e7-ba83a103220a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:19.735764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b75ac7-3bf0-4427-83e7-ba83a103220a admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:19.736469 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b75ac7-3bf0-4427-83e7-ba83a103220a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:19.738466 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b75ac7-3bf0-4427-83e7-ba83a103220a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:19.741307 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d92fc30d-f833-4bfe-b247-dbec343e6938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:19.752573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 850/1681] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:19.754226 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fc30d-f833-4bfe-b247-dbec343e6938 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:19.766470 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fc30d-f833-4bfe-b247-dbec343e6938 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:19.771935 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bd013-ba76-45e4-bc87-9ad6929c4722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:19.773073 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bd013-ba76-45e4-bc87-9ad6929c4722 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:19.773678 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bd013-ba76-45e4-bc87-9ad6929c4722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:19.774140 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bd013-ba76-45e4-bc87-9ad6929c4722 admin admin] PATH_INFO: `/v3/projects/c62ad09cb7c740f8a34086c0e2d43b14/users/3f0d45982de54fee8c87231cfce66bea/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:19.776592 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bd013-ba76-45e4-bc87-9ad6929c4722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c62ad09cb7c740f8a34086c0e2d43b14, user_id=3f0d45982de54fee8c87231cfce66bea, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:19.788875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bd013-ba76-45e4-bc87-9ad6929c4722 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:19.802581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 851/1682] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:19 2022] PUT /identity/v3/projects/c62ad09cb7c740f8a34086c0e2d43b14/users/3f0d45982de54fee8c87231cfce66bea/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:19.803674 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bd013-ba76-45e4-bc87-9ad6929c4722 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:19.924917 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 832/1683] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:19 2022] POST /identity/v3/projects => generated 379 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:19.939838 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af90cc6-7191-4883-8751-ceb96ede6db3 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:19.940168 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af90cc6-7191-4883-8751-ceb96ede6db3 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:19.940473 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af90cc6-7191-4883-8751-ceb96ede6db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:19.974522 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bd013-ba76-45e4-bc87-9ad6929c4722 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:19.997221 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-9af90cc6-7191-4883-8751-ceb96ede6db3 None None] MFA Rules not processed for user `3f0d45982de54fee8c87231cfce66bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:19.998810 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9af90cc6-7191-4883-8751-ceb96ede6db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:20.025051 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:20.117383 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cef8f-ac18-4e6c-b564-2dea1a27b99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:20.118050 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cef8f-ac18-4e6c-b564-2dea1a27b99e admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:20.123415 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cef8f-ac18-4e6c-b564-2dea1a27b99e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:20.124428 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cef8f-ac18-4e6c-b564-2dea1a27b99e admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:20.131662 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59cef8f-ac18-4e6c-b564-2dea1a27b99e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:20.131992 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59cef8f-ac18-4e6c-b564-2dea1a27b99e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:20.144479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59cef8f-ac18-4e6c-b564-2dea1a27b99e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:20.163556 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 833/1684] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:20.167128 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af90cc6-7191-4883-8751-ceb96ede6db3 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:20.174236 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 852/1685] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:20.178544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cef8f-ac18-4e6c-b564-2dea1a27b99e admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:20.191655 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cef8f-ac18-4e6c-b564-2dea1a27b99e admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:20.195239 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af90cc6-7191-4883-8751-ceb96ede6db3 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:20.198182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10036016-ddb5-4dad-8e89-6d9ebad9819b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:20.199049 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10036016-ddb5-4dad-8e89-6d9ebad9819b admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:20.199897 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10036016-ddb5-4dad-8e89-6d9ebad9819b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:20.200226 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10036016-ddb5-4dad-8e89-6d9ebad9819b admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:20.200992 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10036016-ddb5-4dad-8e89-6d9ebad9819b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:20.203835 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10036016-ddb5-4dad-8e89-6d9ebad9819b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:20.205468 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62d71c-946e-4d3d-9341-ee71ec74fd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:20.206263 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62d71c-946e-4d3d-9341-ee71ec74fd47 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:20.206614 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62d71c-946e-4d3d-9341-ee71ec74fd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:20.207028 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62d71c-946e-4d3d-9341-ee71ec74fd47 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:20.212412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c62d71c-946e-4d3d-9341-ee71ec74fd47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:20.212412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c62d71c-946e-4d3d-9341-ee71ec74fd47 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:20.343804 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 853/1686] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:20 2022] POST /identity/v3/projects => generated 363 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:28:20.345012 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10036016-ddb5-4dad-8e89-6d9ebad9819b admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:20.347573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-10036016-ddb5-4dad-8e89-6d9ebad9819b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:20.388341 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 834/1687] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:20 2022] POST /identity/v3/users => generated 290 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:20.390607 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62d71c-946e-4d3d-9341-ee71ec74fd47 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:20.407661 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62d71c-946e-4d3d-9341-ee71ec74fd47 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:20.484256 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10036016-ddb5-4dad-8e89-6d9ebad9819b admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:20.497582 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c7a48-f022-42ec-a970-98637834084d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:20.498344 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c7a48-f022-42ec-a970-98637834084d service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:20.498631 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c7a48-f022-42ec-a970-98637834084d service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:20.498912 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c7a48-f022-42ec-a970-98637834084d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:20.540000 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db062186-a16c-48c0-9635-ae3f33e7d2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:20.541083 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db062186-a16c-48c0-9635-ae3f33e7d2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:20.541552 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db062186-a16c-48c0-9635-ae3f33e7d2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:20.542039 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db062186-a16c-48c0-9635-ae3f33e7d2c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:20.543130 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db062186-a16c-48c0-9635-ae3f33e7d2c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:20.546979 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db062186-a16c-48c0-9635-ae3f33e7d2c4 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:20.624836 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c7a48-f022-42ec-a970-98637834084d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:20.626884 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c7a48-f022-42ec-a970-98637834084d service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:20.648976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 854/1688] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:20.650011 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c7a48-f022-42ec-a970-98637834084d service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:20.672542 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c7a48-f022-42ec-a970-98637834084d service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:20.686336 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 835/1689] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:20 2022] POST /identity/v3/users => generated 282 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:20.686946 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ab159-8b60-48ff-9ef5-31230e3cbbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:20.688059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ab159-8b60-48ff-9ef5-31230e3cbbac admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:20.688426 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ab159-8b60-48ff-9ef5-31230e3cbbac admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:20.688925 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ab159-8b60-48ff-9ef5-31230e3cbbac admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:20.690103 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ab159-8b60-48ff-9ef5-31230e3cbbac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:20.690910 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e36bc9-7e7f-468c-8ec6-68820db977b9 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:20.691205 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e36bc9-7e7f-468c-8ec6-68820db977b9 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:20.691494 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e36bc9-7e7f-468c-8ec6-68820db977b9 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:20.692671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ab159-8b60-48ff-9ef5-31230e3cbbac admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:20.692835 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 836/1690] 10.222.0.13 () {54 vars in 912 bytes} [Tue Jul 5 21:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:28:20.696671 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e36bc9-7e7f-468c-8ec6-68820db977b9 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:20.711293 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 855/1691] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:20.715291 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386ce3b-c4c6-444f-ba57-e994b0d85c9f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:20.715601 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386ce3b-c4c6-444f-ba57-e994b0d85c9f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:20.718551 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386ce3b-c4c6-444f-ba57-e994b0d85c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:20.743301 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e36bc9-7e7f-468c-8ec6-68820db977b9 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:20.764824 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5faee3-45c7-4840-9324-e5a9b4f7f556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:20.765742 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5faee3-45c7-4840-9324-e5a9b4f7f556 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:20.767108 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5faee3-45c7-4840-9324-e5a9b4f7f556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:20.768121 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5faee3-45c7-4840-9324-e5a9b4f7f556 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:20.773065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5faee3-45c7-4840-9324-e5a9b4f7f556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:20.775846 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5faee3-45c7-4840-9324-e5a9b4f7f556 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:20.824083 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 837/1692] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:20.827574 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5faee3-45c7-4840-9324-e5a9b4f7f556 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:20.866484 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-5386ce3b-c4c6-444f-ba57-e994b0d85c9f None None] MFA Rules not processed for user `97b6b7c15770400cad4e2b52b13ad354`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:20.868263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5386ce3b-c4c6-444f-ba57-e994b0d85c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:20.872907 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5faee3-45c7-4840-9324-e5a9b4f7f556 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:20.888213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b4d15-0a58-4fe4-9d0b-ef342e69c66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:20.889619 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b4d15-0a58-4fe4-9d0b-ef342e69c66d admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:20.890108 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b4d15-0a58-4fe4-9d0b-ef342e69c66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:20.890620 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b4d15-0a58-4fe4-9d0b-ef342e69c66d admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:20.894592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b4d15-0a58-4fe4-9d0b-ef342e69c66d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:20.906376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b4d15-0a58-4fe4-9d0b-ef342e69c66d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:20.935553 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 838/1693] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:20.939432 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b4d15-0a58-4fe4-9d0b-ef342e69c66d admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:20.958738 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b4d15-0a58-4fe4-9d0b-ef342e69c66d admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:20.965500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b7c4d-647d-491a-a315-8ad676b5028b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:20.967213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b7c4d-647d-491a-a315-8ad676b5028b admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:20.967978 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b7c4d-647d-491a-a315-8ad676b5028b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:20.969777 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b7c4d-647d-491a-a315-8ad676b5028b admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:20.970807 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b7c4d-647d-491a-a315-8ad676b5028b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:20.973715 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b7c4d-647d-491a-a315-8ad676b5028b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:21.012878 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 839/1694] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:21.014587 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b7c4d-647d-491a-a315-8ad676b5028b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:21.034282 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 856/1695] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Jul 5 21:28:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:21.035235 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386ce3b-c4c6-444f-ba57-e994b0d85c9f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:21.050271 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b7c4d-647d-491a-a315-8ad676b5028b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:21.066993 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea833919-9f51-42f8-8152-9e8c5ae5c109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:21.068939 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea833919-9f51-42f8-8152-9e8c5ae5c109 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:21.070382 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea833919-9f51-42f8-8152-9e8c5ae5c109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:21.071416 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea833919-9f51-42f8-8152-9e8c5ae5c109 admin admin] PATH_INFO: `/v3/projects/3c52da8da47440379aaae733859036e2/users/7dedaa72cc904a4482fdfe2c0934d82e/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:21.076142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386ce3b-c4c6-444f-ba57-e994b0d85c9f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:21.089505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e8e8c-196e-45ea-a0c2-607e43105f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:21.094276 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e8e8c-196e-45ea-a0c2-607e43105f8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:21.094661 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e8e8c-196e-45ea-a0c2-607e43105f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:21.095047 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e8e8c-196e-45ea-a0c2-607e43105f8c admin admin] PATH_INFO: `/v3/projects/cf10474b73974256943c2b089fad4aa1/users/b776b20f52374de4bfa245544e3f3b61/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:21.095157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea833919-9f51-42f8-8152-9e8c5ae5c109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c52da8da47440379aaae733859036e2, user_id=7dedaa72cc904a4482fdfe2c0934d82e, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:21.099368 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea833919-9f51-42f8-8152-9e8c5ae5c109 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:21.128654 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e8e8c-196e-45ea-a0c2-607e43105f8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf10474b73974256943c2b089fad4aa1, user_id=b776b20f52374de4bfa245544e3f3b61, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:21.133185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e8e8c-196e-45ea-a0c2-607e43105f8c admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:21.237455 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 857/1696] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:21 2022] PUT /identity/v3/projects/cf10474b73974256943c2b089fad4aa1/users/b776b20f52374de4bfa245544e3f3b61/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:21.242199 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e8e8c-196e-45ea-a0c2-607e43105f8c admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:21.242313 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 840/1697] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:21 2022] PUT /identity/v3/projects/3c52da8da47440379aaae733859036e2/users/7dedaa72cc904a4482fdfe2c0934d82e/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:21.249505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5471d6f-171a-4a93-a6b1-220a8b8dff5a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:21.249801 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5471d6f-171a-4a93-a6b1-220a8b8dff5a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:21.250471 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5471d6f-171a-4a93-a6b1-220a8b8dff5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:21.257264 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-463e8e8c-196e-45ea-a0c2-607e43105f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:21.320748 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:21.325272 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-c5471d6f-171a-4a93-a6b1-220a8b8dff5a None None] MFA Rules not processed for user `b776b20f52374de4bfa245544e3f3b61`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:21.334002 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c5471d6f-171a-4a93-a6b1-220a8b8dff5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:21.445258 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:21.508653 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e8e8c-196e-45ea-a0c2-607e43105f8c admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:21.526148 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fe7a7-15d6-4c45-8b12-901c2d87cdd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:21.530750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fe7a7-15d6-4c45-8b12-901c2d87cdd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:21.531042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fe7a7-15d6-4c45-8b12-901c2d87cdd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:21.531321 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fe7a7-15d6-4c45-8b12-901c2d87cdd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:21.556066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 841/1698] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:21 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:28:21.569431 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10bb6e-ea72-4652-b8da-111286a0651f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:21.570041 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10bb6e-ea72-4652-b8da-111286a0651f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:21.586030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10bb6e-ea72-4652-b8da-111286a0651f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:21.587255 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133fe7a7-15d6-4c45-8b12-901c2d87cdd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:21.594598 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133fe7a7-15d6-4c45-8b12-901c2d87cdd7 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:21.641657 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 858/1699] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:21.642379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fe7a7-15d6-4c45-8b12-901c2d87cdd7 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:21.719250 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-2b10bb6e-ea72-4652-b8da-111286a0651f None None] MFA Rules not processed for user `7dedaa72cc904a4482fdfe2c0934d82e`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:21.721122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2b10bb6e-ea72-4652-b8da-111286a0651f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:21.915759 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fe7a7-15d6-4c45-8b12-901c2d87cdd7 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:21.922508 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 842/1700] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:21.923486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10bb6e-ea72-4652-b8da-111286a0651f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:21.925293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2b10bb6e-ea72-4652-b8da-111286a0651f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:21.935815 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbaf816-2a7a-4fc7-858f-21f4ab805f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:21.937218 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaf816-2a7a-4fc7-858f-21f4ab805f3a admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:21.937218 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaf816-2a7a-4fc7-858f-21f4ab805f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:21.937218 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaf816-2a7a-4fc7-858f-21f4ab805f3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:21.937980 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbaf816-2a7a-4fc7-858f-21f4ab805f3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:21.940646 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbaf816-2a7a-4fc7-858f-21f4ab805f3a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:21.944349 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10bb6e-ea72-4652-b8da-111286a0651f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:21.963018 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37b051-0086-4061-8054-4976d708c278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:21.966167 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37b051-0086-4061-8054-4976d708c278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:21.966442 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37b051-0086-4061-8054-4976d708c278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:21.970699 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37b051-0086-4061-8054-4976d708c278 admin admin] PATH_INFO: `/v3/projects/d4714768c4d74b6399d830e422738458` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:21.974688 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37b051-0086-4061-8054-4976d708c278 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4714768c4d74b6399d830e422738458)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:21.976702 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37b051-0086-4061-8054-4976d708c278 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:22.125281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 859/1701] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:21 2022] POST /identity/v3/projects => generated 365 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:22.128590 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbaf816-2a7a-4fc7-858f-21f4ab805f3a admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:22.205668 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ba37b051-0086-4061-8054-4976d708c278 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4714768c4d74b6399d830e422738458', 'request_id': 'req-ba37b051-0086-4061-8054-4976d708c278'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:22.232363 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ba37b051-0086-4061-8054-4976d708c278 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4714768c4d74b6399d830e422738458', 'request_id': 'req-ba37b051-0086-4061-8054-4976d708c278'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:22.316299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbaf816-2a7a-4fc7-858f-21f4ab805f3a admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:22.325893 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ba37b051-0086-4061-8054-4976d708c278 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4714768c4d74b6399d830e422738458', 'request_id': 'req-ba37b051-0086-4061-8054-4976d708c278'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:22.358534 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ba37b051-0086-4061-8054-4976d708c278 admin admin] The token cache is being invalidate because project d4714768c4d74b6399d830e422738458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:28:22.359186 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ba37b051-0086-4061-8054-4976d708c278 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:22.360080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ba37b051-0086-4061-8054-4976d708c278 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:22.363314 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 843/1702] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:28:21 2022] DELETE /identity/v3/projects/d4714768c4d74b6399d830e422738458 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:22.364891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948df22-43be-498c-a2e6-1bbfe2a3a460 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:22.365388 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948df22-43be-498c-a2e6-1bbfe2a3a460 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:22.366317 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948df22-43be-498c-a2e6-1bbfe2a3a460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:22.468961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4be6c-eee6-473a-adfc-997262a6bcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:22.469962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4be6c-eee6-473a-adfc-997262a6bcfa admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:22.470641 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4be6c-eee6-473a-adfc-997262a6bcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:22.471642 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4be6c-eee6-473a-adfc-997262a6bcfa admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:22.472571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4be6c-eee6-473a-adfc-997262a6bcfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:22.475231 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4be6c-eee6-473a-adfc-997262a6bcfa admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:22.489383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-6948df22-43be-498c-a2e6-1bbfe2a3a460 None None] MFA Rules not processed for user `bf8ba3e86672440aa22ed3fae5d90721`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:22.495114 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6948df22-43be-498c-a2e6-1bbfe2a3a460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:22.659626 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 860/1703] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:22 2022] POST /identity/v3/projects => generated 381 bytes in 532 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:22.661735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4be6c-eee6-473a-adfc-997262a6bcfa admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:22.667825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8ac4be6c-eee6-473a-adfc-997262a6bcfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:22.675009 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 844/1704] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:22.680376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92457777-6b93-4ffa-aedd-de7f86825dbb None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:22.680690 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92457777-6b93-4ffa-aedd-de7f86825dbb None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:22.682034 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92457777-6b93-4ffa-aedd-de7f86825dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:22.710639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-92457777-6b93-4ffa-aedd-de7f86825dbb None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:22.718692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-92457777-6b93-4ffa-aedd-de7f86825dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:22.838678 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4be6c-eee6-473a-adfc-997262a6bcfa admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:22.859366 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 845/1705] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:22.859556 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83ea50-854d-407d-ab7c-992654a2efd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:22.860266 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83ea50-854d-407d-ab7c-992654a2efd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:22.860553 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83ea50-854d-407d-ab7c-992654a2efd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:22.860837 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83ea50-854d-407d-ab7c-992654a2efd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:22.861543 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83ea50-854d-407d-ab7c-992654a2efd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:22.861825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1655a06-928e-430e-90e3-2ce985cbc98b None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:22.862319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1655a06-928e-430e-90e3-2ce985cbc98b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:22.862765 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1655a06-928e-430e-90e3-2ce985cbc98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:22.863517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83ea50-854d-407d-ab7c-992654a2efd5 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:22.875762 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:22.932576 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d1655a06-928e-430e-90e3-2ce985cbc98b None None] MFA Rules not processed for user `0e1b6f5fa3df4b829f521e1154a1f304`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:22.934425 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d1655a06-928e-430e-90e3-2ce985cbc98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:23.010991 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 846/1706] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:23.012039 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1655a06-928e-430e-90e3-2ce985cbc98b None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:23.013382 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d1655a06-928e-430e-90e3-2ce985cbc98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:23.028022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 861/1707] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:22 2022] POST /identity/v3/users => generated 289 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:23.028780 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83ea50-854d-407d-ab7c-992654a2efd5 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:23.040291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1655a06-928e-430e-90e3-2ce985cbc98b None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:23.043927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-dd83ea50-854d-407d-ab7c-992654a2efd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:23.068324 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ce70f-6678-4f65-84ef-66bd93be13bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:23.069078 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ce70f-6678-4f65-84ef-66bd93be13bf admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:23.069381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ce70f-6678-4f65-84ef-66bd93be13bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:23.069657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ce70f-6678-4f65-84ef-66bd93be13bf admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:23.070387 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ce70f-6678-4f65-84ef-66bd93be13bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:23.078047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ce70f-6678-4f65-84ef-66bd93be13bf admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:23.173829 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 847/1708] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:23 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:23.174999 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ce70f-6678-4f65-84ef-66bd93be13bf admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:23.180512 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-148ce70f-6678-4f65-84ef-66bd93be13bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:23.255953 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83ea50-854d-407d-ab7c-992654a2efd5 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:23.270226 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda6971-ae83-4721-82c2-a9f70c301c16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:23.270931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda6971-ae83-4721-82c2-a9f70c301c16 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:23.271218 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda6971-ae83-4721-82c2-a9f70c301c16 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:23.271507 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda6971-ae83-4721-82c2-a9f70c301c16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:23.363436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ce70f-6678-4f65-84ef-66bd93be13bf admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:23.367877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:23.375579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d2428-00f6-4173-ace2-dc5ace8d5448 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:23.376306 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d2428-00f6-4173-ace2-dc5ace8d5448 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:23.376555 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d2428-00f6-4173-ace2-dc5ace8d5448 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:23.376834 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d2428-00f6-4173-ace2-dc5ace8d5448 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:23.385307 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-619d2428-00f6-4173-ace2-dc5ace8d5448 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:23.469899 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda6971-ae83-4721-82c2-a9f70c301c16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:23.471756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda6971-ae83-4721-82c2-a9f70c301c16 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:23.492059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 862/1709] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:23.493779 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486835a-a2aa-4d24-8ad4-5572628915ac None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:23.494349 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486835a-a2aa-4d24-8ad4-5572628915ac None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:23.498263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486835a-a2aa-4d24-8ad4-5572628915ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:23.539947 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-4486835a-a2aa-4d24-8ad4-5572628915ac None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:23.542771 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4486835a-a2aa-4d24-8ad4-5572628915ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:23.547203 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d2428-00f6-4173-ace2-dc5ace8d5448 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:23.548728 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d2428-00f6-4173-ace2-dc5ace8d5448 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:23.575966 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 848/1710] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:23.577166 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ef4bc-cceb-4899-8850-2702c96a1912 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:23.579327 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 863/1711] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:23.580255 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486835a-a2aa-4d24-8ad4-5572628915ac None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:23.585063 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ef4bc-cceb-4899-8850-2702c96a1912 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:23.586051 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ef4bc-cceb-4899-8850-2702c96a1912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:23.606739 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486835a-a2aa-4d24-8ad4-5572628915ac None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:23.623463 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040030e-d31e-420f-b32b-dd02f327edf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:23.624430 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040030e-d31e-420f-b32b-dd02f327edf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:23.624917 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040030e-d31e-420f-b32b-dd02f327edf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:23.625391 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040030e-d31e-420f-b32b-dd02f327edf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:23.626369 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040030e-d31e-420f-b32b-dd02f327edf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:23.628221 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040030e-d31e-420f-b32b-dd02f327edf1 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:23.643718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-0e2ef4bc-cceb-4899-8850-2702c96a1912 None None] MFA Rules not processed for user `0e1b6f5fa3df4b829f521e1154a1f304`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:23.646319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0e2ef4bc-cceb-4899-8850-2702c96a1912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:23.658044 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 864/1712] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:23.669150 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040030e-d31e-420f-b32b-dd02f327edf1 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:23.681684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 849/1713] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:23.688252 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c5744-1a1b-4890-83d4-6129c7a036a9 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:23.688588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c5744-1a1b-4890-83d4-6129c7a036a9 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:23.688874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c5744-1a1b-4890-83d4-6129c7a036a9 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:23.703869 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 850/1714] 10.222.0.13 () {54 vars in 960 bytes} [Tue Jul 5 21:28:23 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:28:23.705473 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d262e-6442-47a0-9bb6-d45f9a25fdc1 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:23.706224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d262e-6442-47a0-9bb6-d45f9a25fdc1 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:23.708655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d262e-6442-47a0-9bb6-d45f9a25fdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:23.710615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040030e-d31e-420f-b32b-dd02f327edf1 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:23.726916 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92af81b-e116-4c9e-8e8c-e5d54ffe855a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:23.727611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92af81b-e116-4c9e-8e8c-e5d54ffe855a admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:23.727896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92af81b-e116-4c9e-8e8c-e5d54ffe855a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:23.728176 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92af81b-e116-4c9e-8e8c-e5d54ffe855a admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:23.730684 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92af81b-e116-4c9e-8e8c-e5d54ffe855a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:23.733028 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92af81b-e116-4c9e-8e8c-e5d54ffe855a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:23.755941 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-150d262e-6442-47a0-9bb6-d45f9a25fdc1 None None] MFA Rules not processed for user `1f329dcc462c425c8a9ab50e799e4edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:23.757181 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-150d262e-6442-47a0-9bb6-d45f9a25fdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:23.769313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 865/1715] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:23.775939 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92af81b-e116-4c9e-8e8c-e5d54ffe855a admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:23.803957 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92af81b-e116-4c9e-8e8c-e5d54ffe855a admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:23.822689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40df46-ed2f-4e64-b386-532d97afbff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:23.823384 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40df46-ed2f-4e64-b386-532d97afbff4 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:23.823670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40df46-ed2f-4e64-b386-532d97afbff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:23.824529 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40df46-ed2f-4e64-b386-532d97afbff4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:23.825488 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40df46-ed2f-4e64-b386-532d97afbff4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:23.832687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40df46-ed2f-4e64-b386-532d97afbff4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:23.832687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40df46-ed2f-4e64-b386-532d97afbff4 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:23.872083 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 866/1716] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:23.876583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40df46-ed2f-4e64-b386-532d97afbff4 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:23.911784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40df46-ed2f-4e64-b386-532d97afbff4 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:23.942872 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b44357-a5ce-4450-89b6-de6e45646ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:23.945167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44357-a5ce-4450-89b6-de6e45646ff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:23.945250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44357-a5ce-4450-89b6-de6e45646ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:23.947067 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44357-a5ce-4450-89b6-de6e45646ff3 admin admin] PATH_INFO: `/v3/projects/f61e68ed8067419abc9465062f6ad639/users/48b602cdd7454e69ad99a13ee27ef263/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:23.957271 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 851/1717] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:23.957271 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d262e-6442-47a0-9bb6-d45f9a25fdc1 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:23.961295 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-150d262e-6442-47a0-9bb6-d45f9a25fdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:24.001207 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b44357-a5ce-4450-89b6-de6e45646ff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f61e68ed8067419abc9465062f6ad639, user_id=48b602cdd7454e69ad99a13ee27ef263, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:24.012289 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b44357-a5ce-4450-89b6-de6e45646ff3 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:24.025407 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d262e-6442-47a0-9bb6-d45f9a25fdc1 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:24.038366 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a364b-e42d-4eb2-bb4b-ed805fad74b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:24.039071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a364b-e42d-4eb2-bb4b-ed805fad74b3 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:24.039352 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a364b-e42d-4eb2-bb4b-ed805fad74b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:24.039629 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a364b-e42d-4eb2-bb4b-ed805fad74b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:24.055822 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a364b-e42d-4eb2-bb4b-ed805fad74b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:24.057791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a364b-e42d-4eb2-bb4b-ed805fad74b3 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:24.067532 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:24.087299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 852/1718] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:24.089140 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a970a-8bda-44b8-8737-8916c761faf6 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:24.092939 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a970a-8bda-44b8-8737-8916c761faf6 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:24.093392 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a970a-8bda-44b8-8737-8916c761faf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:24.134687 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-f81a970a-8bda-44b8-8737-8916c761faf6 None None] MFA Rules not processed for user `992db9dab5944769b192a868d6637a02`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:24.136710 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f81a970a-8bda-44b8-8737-8916c761faf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:24.149546 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 867/1719] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:23 2022] PUT /identity/v3/projects/f61e68ed8067419abc9465062f6ad639/users/48b602cdd7454e69ad99a13ee27ef263/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:24.150316 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b44357-a5ce-4450-89b6-de6e45646ff3 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:24.279362 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 853/1720] 10.222.0.13 () {58 vars in 1057 bytes} [Tue Jul 5 21:28:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:24.279936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a970a-8bda-44b8-8737-8916c761faf6 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:24.376294 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b44357-a5ce-4450-89b6-de6e45646ff3 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:24.396870 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4145f-18f4-4d2c-8e0b-9d6e683bc708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:24.396870 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4145f-18f4-4d2c-8e0b-9d6e683bc708 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:24.396870 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4145f-18f4-4d2c-8e0b-9d6e683bc708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:24.396870 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4145f-18f4-4d2c-8e0b-9d6e683bc708 admin admin] PATH_INFO: `/v3/projects/b28764a5e326444299b9eb25863093c7/users/650faf0ceb91455caa7a23641564e3f3/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:24.427420 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4145f-18f4-4d2c-8e0b-9d6e683bc708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28764a5e326444299b9eb25863093c7, user_id=650faf0ceb91455caa7a23641564e3f3, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:24.430925 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4145f-18f4-4d2c-8e0b-9d6e683bc708 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:24.447467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a970a-8bda-44b8-8737-8916c761faf6 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:24.454155 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8871bbc-8e4d-442f-a924-3e2dba609607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:24.454840 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8871bbc-8e4d-442f-a924-3e2dba609607 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:24.455222 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8871bbc-8e4d-442f-a924-3e2dba609607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:24.455667 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8871bbc-8e4d-442f-a924-3e2dba609607 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:24.456527 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8871bbc-8e4d-442f-a924-3e2dba609607 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:24.462094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8871bbc-8e4d-442f-a924-3e2dba609607 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:24.573580 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 868/1721] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:24 2022] PUT /identity/v3/projects/b28764a5e326444299b9eb25863093c7/users/650faf0ceb91455caa7a23641564e3f3/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:24.573580 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed588b26-2875-44c4-9dc9-9d11b9858bc5 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:24.576140 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed588b26-2875-44c4-9dc9-9d11b9858bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:24.576522 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed588b26-2875-44c4-9dc9-9d11b9858bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:24.621375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 854/1722] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:24 2022] POST /identity/v3/projects => generated 365 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:24.622900 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8871bbc-8e4d-442f-a924-3e2dba609607 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:24.642935 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-ed588b26-2875-44c4-9dc9-9d11b9858bc5 None None] MFA Rules not processed for user `db2792db73c24a75a449894faf6fbf73`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:24.648840 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ed588b26-2875-44c4-9dc9-9d11b9858bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:24.672392 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:24.750773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8871bbc-8e4d-442f-a924-3e2dba609607 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:24.776539 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91387ddb-8368-4250-a5b7-08ba07611fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:24.776539 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91387ddb-8368-4250-a5b7-08ba07611fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:24.776539 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91387ddb-8368-4250-a5b7-08ba07611fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:24.776539 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91387ddb-8368-4250-a5b7-08ba07611fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:24.777612 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91387ddb-8368-4250-a5b7-08ba07611fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:24.781382 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91387ddb-8368-4250-a5b7-08ba07611fd0 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:24.812893 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 855/1723] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:24.815468 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91387ddb-8368-4250-a5b7-08ba07611fd0 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:24.829371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 869/1724] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:24.832489 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed588b26-2875-44c4-9dc9-9d11b9858bc5 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:24.860675 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed588b26-2875-44c4-9dc9-9d11b9858bc5 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:24.873927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52fa2c-f7d3-481b-baa4-fca3e1d8f67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:24.874651 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52fa2c-f7d3-481b-baa4-fca3e1d8f67c admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:24.874939 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52fa2c-f7d3-481b-baa4-fca3e1d8f67c admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:24.875213 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52fa2c-f7d3-481b-baa4-fca3e1d8f67c admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:24.876111 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52fa2c-f7d3-481b-baa4-fca3e1d8f67c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:24.878045 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52fa2c-f7d3-481b-baa4-fca3e1d8f67c admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:24.893889 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 870/1725] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:24.894850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52fa2c-f7d3-481b-baa4-fca3e1d8f67c admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:24.907273 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52fa2c-f7d3-481b-baa4-fca3e1d8f67c admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:24.912961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f1931-3f49-4b63-a5f0-0de738a1a687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:24.914587 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f1931-3f49-4b63-a5f0-0de738a1a687 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:24.914699 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f1931-3f49-4b63-a5f0-0de738a1a687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:24.915088 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f1931-3f49-4b63-a5f0-0de738a1a687 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:24.915866 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f1931-3f49-4b63-a5f0-0de738a1a687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:24.918796 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f1931-3f49-4b63-a5f0-0de738a1a687 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:24.975429 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91387ddb-8368-4250-a5b7-08ba07611fd0 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:24.994059 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90745c5-d2d0-473b-a46d-4721b50b863c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992db9dab5944769b192a868d6637a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:24.994800 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90745c5-d2d0-473b-a46d-4721b50b863c service placement] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:24.995089 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90745c5-d2d0-473b-a46d-4721b50b863c service placement] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:24.995650 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90745c5-d2d0-473b-a46d-4721b50b863c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:24.999416 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a90745c5-d2d0-473b-a46d-4721b50b863c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:25.013681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90745c5-d2d0-473b-a46d-4721b50b863c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:25.018154 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90745c5-d2d0-473b-a46d-4721b50b863c service placement] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:25.034940 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 856/1726] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:25.036242 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90745c5-d2d0-473b-a46d-4721b50b863c service placement] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:25.085359 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 871/1727] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:24 2022] POST /identity/v3/users => generated 283 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:25.087835 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90745c5-d2d0-473b-a46d-4721b50b863c service placement] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:25.090136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f1931-3f49-4b63-a5f0-0de738a1a687 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:25.096018 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcba2d9-42e4-45b3-822b-088605d8642b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:25.097164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcba2d9-42e4-45b3-822b-088605d8642b admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:25.098319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcba2d9-42e4-45b3-822b-088605d8642b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:25.099629 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcba2d9-42e4-45b3-822b-088605d8642b admin admin] PATH_INFO: `/v3/projects/f61e68ed8067419abc9465062f6ad639/users/48b602cdd7454e69ad99a13ee27ef263/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:25.103747 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcba2d9-42e4-45b3-822b-088605d8642b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f61e68ed8067419abc9465062f6ad639, user_id=48b602cdd7454e69ad99a13ee27ef263, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:25.108993 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcba2d9-42e4-45b3-822b-088605d8642b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:25.131731 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f1931-3f49-4b63-a5f0-0de738a1a687 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:25.158949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 857/1728] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:25 2022] PUT /identity/v3/projects/f61e68ed8067419abc9465062f6ad639/users/48b602cdd7454e69ad99a13ee27ef263/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:25.160925 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c557c9-a52a-4656-9b32-303a0631961d None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:25.161215 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c557c9-a52a-4656-9b32-303a0631961d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:25.161515 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c557c9-a52a-4656-9b32-303a0631961d None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:25.169310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 858/1729] 10.222.0.13 () {54 vars in 912 bytes} [Tue Jul 5 21:28:25 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:28:25.170554 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c557c9-a52a-4656-9b32-303a0631961d None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:25.331059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1be76-d0b7-45c6-821f-d85a62e5934d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:25.333803 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1be76-d0b7-45c6-821f-d85a62e5934d admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:25.336535 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1be76-d0b7-45c6-821f-d85a62e5934d admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:25.336964 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1be76-d0b7-45c6-821f-d85a62e5934d admin admin] PATH_INFO: `/v3/projects/b28764a5e326444299b9eb25863093c7/users/650faf0ceb91455caa7a23641564e3f3/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:25.342104 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1be76-d0b7-45c6-821f-d85a62e5934d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28764a5e326444299b9eb25863093c7, user_id=650faf0ceb91455caa7a23641564e3f3, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:25.351842 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1be76-d0b7-45c6-821f-d85a62e5934d admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:25.388563 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c557c9-a52a-4656-9b32-303a0631961d None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:25.390766 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 872/1730] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:25 2022] PUT /identity/v3/projects/b28764a5e326444299b9eb25863093c7/users/650faf0ceb91455caa7a23641564e3f3/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:25.392445 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8468de9-5d69-488a-be8c-5fd2a67574da None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:25.392849 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8468de9-5d69-488a-be8c-5fd2a67574da None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:25.393235 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8468de9-5d69-488a-be8c-5fd2a67574da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:25.445597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b8468de9-5d69-488a-be8c-5fd2a67574da None None] MFA Rules not processed for user `48b602cdd7454e69ad99a13ee27ef263`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:25.447052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b8468de9-5d69-488a-be8c-5fd2a67574da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:25.508900 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680241f1-7f85-41b1-bc21-4508a35f66da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:25.518585 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680241f1-7f85-41b1-bc21-4508a35f66da admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:25.523485 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680241f1-7f85-41b1-bc21-4508a35f66da admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:25.523485 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680241f1-7f85-41b1-bc21-4508a35f66da admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:25.523485 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680241f1-7f85-41b1-bc21-4508a35f66da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:25.525425 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680241f1-7f85-41b1-bc21-4508a35f66da admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:25.561735 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 859/1731] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:25.564645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20663e-41e8-4a5f-8023-9a576a9d9c46 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:25.565784 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20663e-41e8-4a5f-8023-9a576a9d9c46 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:25.567554 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20663e-41e8-4a5f-8023-9a576a9d9c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:25.583216 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 873/1732] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:25 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:25.584927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b214785-598b-4430-a399-b329e0ae7b7c None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:25.585738 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b214785-598b-4430-a399-b329e0ae7b7c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:25.586349 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b214785-598b-4430-a399-b329e0ae7b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:25.613246 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-bd20663e-41e8-4a5f-8023-9a576a9d9c46 None None] MFA Rules not processed for user `97b6b7c15770400cad4e2b52b13ad354`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:25.614504 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-bd20663e-41e8-4a5f-8023-9a576a9d9c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:25.636586 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-3b214785-598b-4430-a399-b329e0ae7b7c None None] MFA Rules not processed for user `650faf0ceb91455caa7a23641564e3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:25.638487 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3b214785-598b-4430-a399-b329e0ae7b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:25.701830 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 860/1733] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Jul 5 21:28:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:25.702615 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20663e-41e8-4a5f-8023-9a576a9d9c46 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:25.778492 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 874/1734] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:25.779545 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b214785-598b-4430-a399-b329e0ae7b7c None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:25.792042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b214785-598b-4430-a399-b329e0ae7b7c None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:25.803830 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa4bc4-15d1-4e01-8384-78f473e3cb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:25.805059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa4bc4-15d1-4e01-8384-78f473e3cb94 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:25.805548 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa4bc4-15d1-4e01-8384-78f473e3cb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:25.806096 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa4bc4-15d1-4e01-8384-78f473e3cb94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:25.807231 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa4bc4-15d1-4e01-8384-78f473e3cb94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:25.815715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa4bc4-15d1-4e01-8384-78f473e3cb94 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:25.818096 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20663e-41e8-4a5f-8023-9a576a9d9c46 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:25.839851 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85eeb3e-bf42-4960-8b8f-6a7d46cf193a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:25.840904 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85eeb3e-bf42-4960-8b8f-6a7d46cf193a service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:25.844835 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85eeb3e-bf42-4960-8b8f-6a7d46cf193a service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:25.845408 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85eeb3e-bf42-4960-8b8f-6a7d46cf193a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:25.859924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 875/1735] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:25.860878 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa4bc4-15d1-4e01-8384-78f473e3cb94 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:25.929705 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85eeb3e-bf42-4960-8b8f-6a7d46cf193a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:25.931594 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85eeb3e-bf42-4960-8b8f-6a7d46cf193a service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:25.943367 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 861/1736] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:25.955223 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85eeb3e-bf42-4960-8b8f-6a7d46cf193a service nova] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:25.960287 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c85eeb3e-bf42-4960-8b8f-6a7d46cf193a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:25.971346 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa4bc4-15d1-4e01-8384-78f473e3cb94 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:25.979055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d20f0-ccdb-491d-87d5-6a793f9ce2aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:25.979887 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d20f0-ccdb-491d-87d5-6a793f9ce2aa service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:25.980445 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d20f0-ccdb-491d-87d5-6a793f9ce2aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:25.981122 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d20f0-ccdb-491d-87d5-6a793f9ce2aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:25.985071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85eeb3e-bf42-4960-8b8f-6a7d46cf193a service nova] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:25.994786 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3ff7a-16ed-43c6-bcdb-e35319c940b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:25.997127 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3ff7a-16ed-43c6-bcdb-e35319c940b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:25.998276 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3ff7a-16ed-43c6-bcdb-e35319c940b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:25.998631 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3ff7a-16ed-43c6-bcdb-e35319c940b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:26.004222 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d20f0-ccdb-491d-87d5-6a793f9ce2aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:26.006598 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d20f0-ccdb-491d-87d5-6a793f9ce2aa service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:26.031019 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3ff7a-16ed-43c6-bcdb-e35319c940b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:26.034857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3ff7a-16ed-43c6-bcdb-e35319c940b7 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:26.060057 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 876/1737] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:25 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:26.060948 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 862/1738] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:26.061331 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d20f0-ccdb-491d-87d5-6a793f9ce2aa service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:26.061417 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3ff7a-16ed-43c6-bcdb-e35319c940b7 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:26.061417 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-23e3ff7a-16ed-43c6-bcdb-e35319c940b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:26.080477 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:26.089828 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3ff7a-16ed-43c6-bcdb-e35319c940b7 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:26.091420 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d20f0-ccdb-491d-87d5-6a793f9ce2aa service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:26.094628 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b27931-83c9-4095-a3a8-68f9b0d9416e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:26.095858 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b27931-83c9-4095-a3a8-68f9b0d9416e service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:26.096387 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b27931-83c9-4095-a3a8-68f9b0d9416e service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:26.096671 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b27931-83c9-4095-a3a8-68f9b0d9416e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:26.100889 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc1f5c-a2bb-413e-a6a0-81074fede401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:26.101789 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc1f5c-a2bb-413e-a6a0-81074fede401 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:26.102077 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc1f5c-a2bb-413e-a6a0-81074fede401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:26.102379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc1f5c-a2bb-413e-a6a0-81074fede401 admin admin] PATH_INFO: `/v3/projects/f484acf43401482ebe091efeb45837c5/users/4e1a259b0bf742bda85b679183526b10/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:26.120757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b27931-83c9-4095-a3a8-68f9b0d9416e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:26.125504 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b27931-83c9-4095-a3a8-68f9b0d9416e service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:26.135887 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc1f5c-a2bb-413e-a6a0-81074fede401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f484acf43401482ebe091efeb45837c5, user_id=4e1a259b0bf742bda85b679183526b10, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:26.142229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc1f5c-a2bb-413e-a6a0-81074fede401 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:26.164689 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:26.190695 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 863/1739] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:26.224795 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 877/1740] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:26 2022] PUT /identity/v3/projects/f484acf43401482ebe091efeb45837c5/users/4e1a259b0bf742bda85b679183526b10/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:26.236926 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bc4f8-6684-4f1f-a9a9-d51490fff574 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:26.237490 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bc4f8-6684-4f1f-a9a9-d51490fff574 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:26.238019 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bc4f8-6684-4f1f-a9a9-d51490fff574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:26.311810 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-2f0bc4f8-6684-4f1f-a9a9-d51490fff574 None None] MFA Rules not processed for user `4e1a259b0bf742bda85b679183526b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:26.313409 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2f0bc4f8-6684-4f1f-a9a9-d51490fff574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:26.484995 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 864/1741] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:26.485743 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc1f5c-a2bb-413e-a6a0-81074fede401 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:26.601836 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc1f5c-a2bb-413e-a6a0-81074fede401 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:26.607369 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f39fb-a402-4f04-ad09-b2fe3313b7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:26.608079 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f39fb-a402-4f04-ad09-b2fe3313b7a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:26.608730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f39fb-a402-4f04-ad09-b2fe3313b7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:26.609016 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f39fb-a402-4f04-ad09-b2fe3313b7a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:26.609741 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f39fb-a402-4f04-ad09-b2fe3313b7a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:26.611753 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f39fb-a402-4f04-ad09-b2fe3313b7a2 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:26.674937 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bc4f8-6684-4f1f-a9a9-d51490fff574 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:26.735086 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 878/1742] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:26 2022] POST /identity/v3/projects => generated 365 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:28:26.743393 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f39fb-a402-4f04-ad09-b2fe3313b7a2 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:26.811533 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bc4f8-6684-4f1f-a9a9-d51490fff574 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:26.835040 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f39fb-a402-4f04-ad09-b2fe3313b7a2 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:26.839661 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bc4d7-4a88-43ba-b5ab-90d44dfcb0fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:26.840438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bc4d7-4a88-43ba-b5ab-90d44dfcb0fd service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:26.840869 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bc4d7-4a88-43ba-b5ab-90d44dfcb0fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:26.841237 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bc4d7-4a88-43ba-b5ab-90d44dfcb0fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:26.846744 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-369bc4d7-4a88-43ba-b5ab-90d44dfcb0fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:26.916710 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9696e-7911-42c0-bad9-bd7439c1f355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:26.917735 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9696e-7911-42c0-bad9-bd7439c1f355 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:26.918294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9696e-7911-42c0-bad9-bd7439c1f355 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:26.918878 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9696e-7911-42c0-bad9-bd7439c1f355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:26.924708 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ada9696e-7911-42c0-bad9-bd7439c1f355 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:26.989585 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369bc4d7-4a88-43ba-b5ab-90d44dfcb0fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:27.013996 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369bc4d7-4a88-43ba-b5ab-90d44dfcb0fd service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:27.043185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 879/1743] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:27.043659 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bc4d7-4a88-43ba-b5ab-90d44dfcb0fd service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:27.198102 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9696e-7911-42c0-bad9-bd7439c1f355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:27.202904 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9696e-7911-42c0-bad9-bd7439c1f355 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:27.262157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 865/1744] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:26 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:28:27.347401 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bc4d7-4a88-43ba-b5ab-90d44dfcb0fd service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:27.359816 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1b7aa-e363-44aa-8262-5fc608a5ac71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:27.361612 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1b7aa-e363-44aa-8262-5fc608a5ac71 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:27.362047 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1b7aa-e363-44aa-8262-5fc608a5ac71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:27.362504 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1b7aa-e363-44aa-8262-5fc608a5ac71 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:27.363357 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1b7aa-e363-44aa-8262-5fc608a5ac71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:27.369333 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1b7aa-e363-44aa-8262-5fc608a5ac71 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:27.552292 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 880/1745] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:27 2022] POST /identity/v3/users => generated 289 bytes in 508 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:27.555593 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9696e-7911-42c0-bad9-bd7439c1f355 service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:27.580125 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:27.601732 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9696e-7911-42c0-bad9-bd7439c1f355 service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:27.636690 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb721c-9dda-435d-b014-46e50f122562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:27.637499 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb721c-9dda-435d-b014-46e50f122562 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:27.637801 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb721c-9dda-435d-b014-46e50f122562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:27.638073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb721c-9dda-435d-b014-46e50f122562 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:27.643074 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb721c-9dda-435d-b014-46e50f122562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:27.644792 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb721c-9dda-435d-b014-46e50f122562 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:27.677248 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 866/1746] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:27.683392 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1b7aa-e363-44aa-8262-5fc608a5ac71 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:27.705275 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1b7aa-e363-44aa-8262-5fc608a5ac71 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:27.725186 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963616cd-3c47-4eae-869f-9b4fb3777cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:27.726591 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963616cd-3c47-4eae-869f-9b4fb3777cb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:27.727021 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963616cd-3c47-4eae-869f-9b4fb3777cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:27.727441 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963616cd-3c47-4eae-869f-9b4fb3777cb1 admin admin] PATH_INFO: `/v3/projects/52387eb10f1a4ff2a7136f3fec04ef18/users/68613b87f9bc48d98426189c4a568c6d/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:27.791777 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963616cd-3c47-4eae-869f-9b4fb3777cb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52387eb10f1a4ff2a7136f3fec04ef18, user_id=68613b87f9bc48d98426189c4a568c6d, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:27.802140 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963616cd-3c47-4eae-869f-9b4fb3777cb1 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:27.967858 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 881/1747] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:27 2022] PUT /identity/v3/projects/52387eb10f1a4ff2a7136f3fec04ef18/users/68613b87f9bc48d98426189c4a568c6d/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:27.985744 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb721c-9dda-435d-b014-46e50f122562 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:28.007862 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb721c-9dda-435d-b014-46e50f122562 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:28.308435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717b436-7f95-4000-b903-d906fe542176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:28.308435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717b436-7f95-4000-b903-d906fe542176 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:28.308435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717b436-7f95-4000-b903-d906fe542176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:28.308435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717b436-7f95-4000-b903-d906fe542176 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:28.309274 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717b436-7f95-4000-b903-d906fe542176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:28.320234 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717b436-7f95-4000-b903-d906fe542176 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:28.360813 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963616cd-3c47-4eae-869f-9b4fb3777cb1 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:28.370178 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 867/1748] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:28.378718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963616cd-3c47-4eae-869f-9b4fb3777cb1 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:28.406042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57181f-7bff-4d2f-96c5-17daf82b9dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:28.410921 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57181f-7bff-4d2f-96c5-17daf82b9dfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:28.412943 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57181f-7bff-4d2f-96c5-17daf82b9dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:28.414490 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57181f-7bff-4d2f-96c5-17daf82b9dfa admin admin] PATH_INFO: `/v3/projects/52387eb10f1a4ff2a7136f3fec04ef18/users/68613b87f9bc48d98426189c4a568c6d/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:28.421465 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57181f-7bff-4d2f-96c5-17daf82b9dfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=52387eb10f1a4ff2a7136f3fec04ef18, user_id=68613b87f9bc48d98426189c4a568c6d, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:28.427218 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57181f-7bff-4d2f-96c5-17daf82b9dfa admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:28.487776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 882/1749] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:28 2022] PUT /identity/v3/projects/52387eb10f1a4ff2a7136f3fec04ef18/users/68613b87f9bc48d98426189c4a568c6d/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:28.489760 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9ba50-72c3-4eda-af82-8c9c0e89faa8 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:28.490471 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9ba50-72c3-4eda-af82-8c9c0e89faa8 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:28.491072 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9ba50-72c3-4eda-af82-8c9c0e89faa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:28.555250 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-dba9ba50-72c3-4eda-af82-8c9c0e89faa8 None None] MFA Rules not processed for user `68613b87f9bc48d98426189c4a568c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:28.557327 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-dba9ba50-72c3-4eda-af82-8c9c0e89faa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:28.742043 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 868/1750] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:28 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:28.747596 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57181f-7bff-4d2f-96c5-17daf82b9dfa admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:29.051052 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042b6bd-ab51-4ffc-a76f-6d5358051a57 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:29.051579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042b6bd-ab51-4ffc-a76f-6d5358051a57 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:29.052188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042b6bd-ab51-4ffc-a76f-6d5358051a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:29.102964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-2042b6bd-ab51-4ffc-a76f-6d5358051a57 None None] MFA Rules not processed for user `bf8ba3e86672440aa22ed3fae5d90721`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:29.104240 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2042b6bd-ab51-4ffc-a76f-6d5358051a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:29.110792 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57181f-7bff-4d2f-96c5-17daf82b9dfa admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:29.163875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538be6a9-391e-4e86-b6fd-4ab40a3caa5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:29.166793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538be6a9-391e-4e86-b6fd-4ab40a3caa5c service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:29.167197 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538be6a9-391e-4e86-b6fd-4ab40a3caa5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:29.168234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538be6a9-391e-4e86-b6fd-4ab40a3caa5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:29.192736 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538be6a9-391e-4e86-b6fd-4ab40a3caa5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:29.199113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538be6a9-391e-4e86-b6fd-4ab40a3caa5c service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:29.232042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 883/1751] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:28 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:29.284332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:29.338770 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 869/1752] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:29.902830 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538be6a9-391e-4e86-b6fd-4ab40a3caa5c service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:29.914720 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538be6a9-391e-4e86-b6fd-4ab40a3caa5c service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:29.934002 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0ddc5-a056-4def-82f8-2705b4b6c230 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:29.937469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0ddc5-a056-4def-82f8-2705b4b6c230 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:29.938604 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0ddc5-a056-4def-82f8-2705b4b6c230 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:29.939058 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0ddc5-a056-4def-82f8-2705b4b6c230 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:30.042658 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:30.109842 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0ddc5-a056-4def-82f8-2705b4b6c230 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:30.113875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0ddc5-a056-4def-82f8-2705b4b6c230 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:30.141843 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 884/1753] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:29 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:31.299629 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9f081-9da1-4b7f-a115-19eee5a297a6 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:31.300203 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9f081-9da1-4b7f-a115-19eee5a297a6 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:31.300622 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9f081-9da1-4b7f-a115-19eee5a297a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:31.385279 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-65b9f081-9da1-4b7f-a115-19eee5a297a6 None None] MFA Rules not processed for user `063ce3b820a74d648d709ab6ac4d7be2`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:31.387667 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-65b9f081-9da1-4b7f-a115-19eee5a297a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:31.417194 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0ddc5-a056-4def-82f8-2705b4b6c230 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:31.432448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0ddc5-a056-4def-82f8-2705b4b6c230 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:31.443867 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801790b-3425-41d8-b065-d5d9f7583fe0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:31.446249 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801790b-3425-41d8-b065-d5d9f7583fe0 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:31.451105 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801790b-3425-41d8-b065-d5d9f7583fe0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:31.451612 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801790b-3425-41d8-b065-d5d9f7583fe0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:31.471224 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5801790b-3425-41d8-b065-d5d9f7583fe0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:31.536070 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 870/1754] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Jul 5 21:28:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:31.549628 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:31.635477 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801790b-3425-41d8-b065-d5d9f7583fe0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:31.650430 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801790b-3425-41d8-b065-d5d9f7583fe0 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:31.676031 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 885/1755] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:32.018390 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6406cc-bbf5-49e7-b883-77cdd05bb1ec None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:32.018724 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6406cc-bbf5-49e7-b883-77cdd05bb1ec None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:32.018952 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6406cc-bbf5-49e7-b883-77cdd05bb1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:32.050979 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-9b6406cc-bbf5-49e7-b883-77cdd05bb1ec None None] MFA Rules not processed for user `db2792db73c24a75a449894faf6fbf73`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:32.052006 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9b6406cc-bbf5-49e7-b883-77cdd05bb1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:32.126497 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801790b-3425-41d8-b065-d5d9f7583fe0 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:32.128288 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5801790b-3425-41d8-b065-d5d9f7583fe0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:32.215621 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 871/1756] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:32.226522 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801790b-3425-41d8-b065-d5d9f7583fe0 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:32.233450 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e82f36-9918-4171-80ff-d521272e3ea8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '441be62a077444b9b9f78714e24a760a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:32.234365 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e82f36-9918-4171-80ff-d521272e3ea8 service swift] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:32.235698 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e82f36-9918-4171-80ff-d521272e3ea8 service swift] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:32.236157 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e82f36-9918-4171-80ff-d521272e3ea8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:32.254960 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e82f36-9918-4171-80ff-d521272e3ea8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:32.256792 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e82f36-9918-4171-80ff-d521272e3ea8 service swift] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:32.303160 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 886/1757] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Jul 5 21:28:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 21:28:32.567443 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:33.201781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d274dfc-6f78-4b63-8665-dbe6f362eb75 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:33.202329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d274dfc-6f78-4b63-8665-dbe6f362eb75 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:33.202405 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d274dfc-6f78-4b63-8665-dbe6f362eb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:33.239327 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-3d274dfc-6f78-4b63-8665-dbe6f362eb75 None None] MFA Rules not processed for user `97b6b7c15770400cad4e2b52b13ad354`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:33.243819 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3d274dfc-6f78-4b63-8665-dbe6f362eb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:33.363710 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 872/1758] 10.222.0.39 () {58 vars in 1015 bytes} [Tue Jul 5 21:28:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:33.395328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e82f36-9918-4171-80ff-d521272e3ea8 service swift] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:33.396752 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-26e82f36-9918-4171-80ff-d521272e3ea8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:33.428744 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e82f36-9918-4171-80ff-d521272e3ea8 service swift] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:33.445962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7166f581-b95a-41f3-b744-9f2f76d8ba3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:33.447323 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166f581-b95a-41f3-b744-9f2f76d8ba3b service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:33.447878 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166f581-b95a-41f3-b744-9f2f76d8ba3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:33.448595 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166f581-b95a-41f3-b744-9f2f76d8ba3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:33.472306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7166f581-b95a-41f3-b744-9f2f76d8ba3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:33.474509 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7166f581-b95a-41f3-b744-9f2f76d8ba3b service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:33.498338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 887/1759] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:34.692299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:35.621339 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d274dfc-6f78-4b63-8665-dbe6f362eb75 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:35.766793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:35.775134 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d274dfc-6f78-4b63-8665-dbe6f362eb75 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:35.794704 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673cddc-ec8c-4dc3-b53b-7317ae86ed7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:35.799703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673cddc-ec8c-4dc3-b53b-7317ae86ed7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:35.800042 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673cddc-ec8c-4dc3-b53b-7317ae86ed7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:35.800327 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673cddc-ec8c-4dc3-b53b-7317ae86ed7c admin admin] PATH_INFO: `/v3/users/b776b20f52374de4bfa245544e3f3b61` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:35.803172 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673cddc-ec8c-4dc3-b53b-7317ae86ed7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b776b20f52374de4bfa245544e3f3b61)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:35.809476 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673cddc-ec8c-4dc3-b53b-7317ae86ed7c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:36.126623 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-7673cddc-ec8c-4dc3-b53b-7317ae86ed7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b776b20f52374de4bfa245544e3f3b61'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:36.145731 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-7673cddc-ec8c-4dc3-b53b-7317ae86ed7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b776b20f52374de4bfa245544e3f3b61'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:36.199877 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-7673cddc-ec8c-4dc3-b53b-7317ae86ed7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b776b20f52374de4bfa245544e3f3b61'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:36.201259 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-7673cddc-ec8c-4dc3-b53b-7317ae86ed7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b776b20f52374de4bfa245544e3f3b61'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:36.346992 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-7673cddc-ec8c-4dc3-b53b-7317ae86ed7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b776b20f52374de4bfa245544e3f3b61'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:36.371234 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 873/1760] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:28:35 2022] DELETE /identity/v3/users/b776b20f52374de4bfa245544e3f3b61 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:36.376236 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48e7cc-0bff-41ca-afa6-c96099314e51 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:36.376535 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48e7cc-0bff-41ca-afa6-c96099314e51 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:36.376859 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48e7cc-0bff-41ca-afa6-c96099314e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:36.431770 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-df48e7cc-0bff-41ca-afa6-c96099314e51 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:36.438464 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-df48e7cc-0bff-41ca-afa6-c96099314e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:36.662390 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 888/1761] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:28:36.710911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5c3ad-02e8-42af-8acd-8e318740835f None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:36.711193 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5c3ad-02e8-42af-8acd-8e318740835f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:36.711716 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5c3ad-02e8-42af-8acd-8e318740835f None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:36.714835 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 874/1762] 10.222.0.13 () {54 vars in 921 bytes} [Tue Jul 5 21:28:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:28:36.776673 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8061a15-ed88-4718-bc31-126704c4d98d None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:36.777973 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8061a15-ed88-4718-bc31-126704c4d98d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:36.779056 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8061a15-ed88-4718-bc31-126704c4d98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:36.800024 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5c3ad-02e8-42af-8acd-8e318740835f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:36.802472 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c3f5c3ad-02e8-42af-8acd-8e318740835f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:36.829537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e8061a15-ed88-4718-bc31-126704c4d98d None None] MFA Rules not processed for user `910cd341df8943f18af2765e2a30b238`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:36.833693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e8061a15-ed88-4718-bc31-126704c4d98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:37.034024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 889/1763] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Jul 5 21:28:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:37.143048 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5c3ad-02e8-42af-8acd-8e318740835f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:37.161511 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1735c-48b3-4cd3-b2c4-8948c2e9b5d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:37.162501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1735c-48b3-4cd3-b2c4-8948c2e9b5d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:37.162949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1735c-48b3-4cd3-b2c4-8948c2e9b5d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:37.163376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1735c-48b3-4cd3-b2c4-8948c2e9b5d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:37.184789 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1735c-48b3-4cd3-b2c4-8948c2e9b5d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:37.188553 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1735c-48b3-4cd3-b2c4-8948c2e9b5d3 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:37.204513 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 875/1764] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:37.286426 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:37.413256 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8061a15-ed88-4718-bc31-126704c4d98d None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:37.414848 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e8061a15-ed88-4718-bc31-126704c4d98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:37.447518 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8061a15-ed88-4718-bc31-126704c4d98d None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:37.466230 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e79949-70b6-4099-b73d-334cac6538a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:37.471038 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e79949-70b6-4099-b73d-334cac6538a9 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:37.471750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e79949-70b6-4099-b73d-334cac6538a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:37.472193 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e79949-70b6-4099-b73d-334cac6538a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:37.521870 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e79949-70b6-4099-b73d-334cac6538a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:37.528730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e79949-70b6-4099-b73d-334cac6538a9 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:37.574301 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 890/1765] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:38.669095 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:38.758949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:38.767779 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1735c-48b3-4cd3-b2c4-8948c2e9b5d3 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:38.770631 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-aba1735c-48b3-4cd3-b2c4-8948c2e9b5d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:38.818522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1735c-48b3-4cd3-b2c4-8948c2e9b5d3 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:38.855564 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd11c34-655a-45cc-8c1b-f53d834e1df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:38.858988 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd11c34-655a-45cc-8c1b-f53d834e1df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:38.866973 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd11c34-655a-45cc-8c1b-f53d834e1df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:38.867676 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd11c34-655a-45cc-8c1b-f53d834e1df7 admin admin] PATH_INFO: `/v3/projects/cf10474b73974256943c2b089fad4aa1` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:38.873592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd11c34-655a-45cc-8c1b-f53d834e1df7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf10474b73974256943c2b089fad4aa1)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:38.883413 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd11c34-655a-45cc-8c1b-f53d834e1df7 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:39.235193 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4dd11c34-655a-45cc-8c1b-f53d834e1df7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf10474b73974256943c2b089fad4aa1', 'request_id': 'req-4dd11c34-655a-45cc-8c1b-f53d834e1df7'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:39.282601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4dd11c34-655a-45cc-8c1b-f53d834e1df7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf10474b73974256943c2b089fad4aa1', 'request_id': 'req-4dd11c34-655a-45cc-8c1b-f53d834e1df7'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:39.455171 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4dd11c34-655a-45cc-8c1b-f53d834e1df7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf10474b73974256943c2b089fad4aa1', 'request_id': 'req-4dd11c34-655a-45cc-8c1b-f53d834e1df7'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:39.472757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4dd11c34-655a-45cc-8c1b-f53d834e1df7 admin admin] The token cache is being invalidate because project cf10474b73974256943c2b089fad4aa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:28:39.473916 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4dd11c34-655a-45cc-8c1b-f53d834e1df7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:39.505724 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4dd11c34-655a-45cc-8c1b-f53d834e1df7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:39.517247 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 876/1766] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:28:38 2022] DELETE /identity/v3/projects/cf10474b73974256943c2b089fad4aa1 => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:39.521347 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e79949-70b6-4099-b73d-334cac6538a9 service nova] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:39.541128 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e79949-70b6-4099-b73d-334cac6538a9 service nova] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:39.713098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654894f-03fe-4765-84e4-d426f4accee6 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:39.713694 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654894f-03fe-4765-84e4-d426f4accee6 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:39.714133 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654894f-03fe-4765-84e4-d426f4accee6 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:39.715965 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 877/1767] 10.222.0.13 () {54 vars in 921 bytes} [Tue Jul 5 21:28:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:28:39.815730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc850c-58cf-4e10-a82b-af001466ce25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:39.819345 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc850c-58cf-4e10-a82b-af001466ce25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:39.823845 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc850c-58cf-4e10-a82b-af001466ce25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:39.825408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc850c-58cf-4e10-a82b-af001466ce25 admin admin] PATH_INFO: `/v3/users/48b602cdd7454e69ad99a13ee27ef263` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:39.835903 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc850c-58cf-4e10-a82b-af001466ce25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48b602cdd7454e69ad99a13ee27ef263)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:39.847246 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc850c-58cf-4e10-a82b-af001466ce25 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:39.877171 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047ff3c-b718-40f7-81e5-63dcd0e0d879 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:39.877778 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047ff3c-b718-40f7-81e5-63dcd0e0d879 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:39.877907 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047ff3c-b718-40f7-81e5-63dcd0e0d879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:39.946215 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-e047ff3c-b718-40f7-81e5-63dcd0e0d879 None None] MFA Rules not processed for user `910cd341df8943f18af2765e2a30b238`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:39.959477 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e047ff3c-b718-40f7-81e5-63dcd0e0d879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:40.023083 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:40.224513 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-78bc850c-58cf-4e10-a82b-af001466ce25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48b602cdd7454e69ad99a13ee27ef263'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:40.272769 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 878/1768] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Jul 5 21:28:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:28:40.275964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047ff3c-b718-40f7-81e5-63dcd0e0d879 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:40.285843 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e047ff3c-b718-40f7-81e5-63dcd0e0d879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:40.340625 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047ff3c-b718-40f7-81e5-63dcd0e0d879 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:40.341133 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-78bc850c-58cf-4e10-a82b-af001466ce25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48b602cdd7454e69ad99a13ee27ef263'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:40.365744 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c88e76-d200-4cce-95d6-900b66296e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:40.370886 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-78bc850c-58cf-4e10-a82b-af001466ce25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48b602cdd7454e69ad99a13ee27ef263'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:40.372972 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c88e76-d200-4cce-95d6-900b66296e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:40.373307 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c88e76-d200-4cce-95d6-900b66296e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:40.375841 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c88e76-d200-4cce-95d6-900b66296e18 admin admin] PATH_INFO: `/v3/users/b0bd65910d9b4b8a9f65930fa78acdbe` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:40.379401 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c88e76-d200-4cce-95d6-900b66296e18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0bd65910d9b4b8a9f65930fa78acdbe)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:40.392253 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c88e76-d200-4cce-95d6-900b66296e18 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:40.413216 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-78bc850c-58cf-4e10-a82b-af001466ce25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48b602cdd7454e69ad99a13ee27ef263'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:40.414597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-78bc850c-58cf-4e10-a82b-af001466ce25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48b602cdd7454e69ad99a13ee27ef263'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:40.449758 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 891/1769] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:28:39 2022] DELETE /identity/v3/users/48b602cdd7454e69ad99a13ee27ef263 => generated 0 bytes in 929 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:40.707582 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c2c88e76-d200-4cce-95d6-900b66296e18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0bd65910d9b4b8a9f65930fa78acdbe'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:40.718827 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c2c88e76-d200-4cce-95d6-900b66296e18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0bd65910d9b4b8a9f65930fa78acdbe'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:40.760733 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c2c88e76-d200-4cce-95d6-900b66296e18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0bd65910d9b4b8a9f65930fa78acdbe'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:40.761759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c2c88e76-d200-4cce-95d6-900b66296e18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0bd65910d9b4b8a9f65930fa78acdbe'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:40.823744 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc850c-58cf-4e10-a82b-af001466ce25 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:40.827779 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-78bc850c-58cf-4e10-a82b-af001466ce25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:40.918834 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:40.954052 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c2c88e76-d200-4cce-95d6-900b66296e18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0bd65910d9b4b8a9f65930fa78acdbe'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:40.963532 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 879/1770] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:28:40 2022] DELETE /identity/v3/users/b0bd65910d9b4b8a9f65930fa78acdbe => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:40.976765 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1aa31-c49f-47f3-a7ce-3b823f372d3e None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:40.977062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1aa31-c49f-47f3-a7ce-3b823f372d3e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:40.977536 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1aa31-c49f-47f3-a7ce-3b823f372d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:41.032401 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:41.059850 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-9bb1aa31-c49f-47f3-a7ce-3b823f372d3e None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:41.070857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9bb1aa31-c49f-47f3-a7ce-3b823f372d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:41.125114 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc850c-58cf-4e10-a82b-af001466ce25 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:41.386235 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 880/1771] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:28:41.411409 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505a7b6-12b6-4c01-8fc6-34613261d0dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:41.412077 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505a7b6-12b6-4c01-8fc6-34613261d0dc service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:41.412368 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505a7b6-12b6-4c01-8fc6-34613261d0dc service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:41.412640 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505a7b6-12b6-4c01-8fc6-34613261d0dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:41.421722 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2505a7b6-12b6-4c01-8fc6-34613261d0dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:41.465234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505a7b6-12b6-4c01-8fc6-34613261d0dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:41.473179 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505a7b6-12b6-4c01-8fc6-34613261d0dc service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:41.503520 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 892/1772] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:41.675025 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1aa31-c49f-47f3-a7ce-3b823f372d3e None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:41.676487 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9bb1aa31-c49f-47f3-a7ce-3b823f372d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:41.816867 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1aa31-c49f-47f3-a7ce-3b823f372d3e None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:41.822772 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba49425-4d45-4456-9a1b-e80514a96ea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:41.823464 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba49425-4d45-4456-9a1b-e80514a96ea5 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:41.824491 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba49425-4d45-4456-9a1b-e80514a96ea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:41.825480 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba49425-4d45-4456-9a1b-e80514a96ea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:41.855299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba49425-4d45-4456-9a1b-e80514a96ea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:41.861450 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba49425-4d45-4456-9a1b-e80514a96ea5 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:41.887309 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 881/1773] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:42.101245 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505a7b6-12b6-4c01-8fc6-34613261d0dc service nova] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:42.102768 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2505a7b6-12b6-4c01-8fc6-34613261d0dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:42.148463 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505a7b6-12b6-4c01-8fc6-34613261d0dc service nova] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:42.154493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04bae98-b91f-43f5-84e6-e4bc371bbda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:42.155771 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bae98-b91f-43f5-84e6-e4bc371bbda3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:42.156309 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bae98-b91f-43f5-84e6-e4bc371bbda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:42.156784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bae98-b91f-43f5-84e6-e4bc371bbda3 admin admin] PATH_INFO: `/v3/projects/f61e68ed8067419abc9465062f6ad639` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:42.158685 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04bae98-b91f-43f5-84e6-e4bc371bbda3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f61e68ed8067419abc9465062f6ad639)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:42.161065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04bae98-b91f-43f5-84e6-e4bc371bbda3 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:42.352385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f04bae98-b91f-43f5-84e6-e4bc371bbda3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f61e68ed8067419abc9465062f6ad639', 'request_id': 'req-f04bae98-b91f-43f5-84e6-e4bc371bbda3'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:42.457508 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f04bae98-b91f-43f5-84e6-e4bc371bbda3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f61e68ed8067419abc9465062f6ad639', 'request_id': 'req-f04bae98-b91f-43f5-84e6-e4bc371bbda3'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:42.464117 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f04bae98-b91f-43f5-84e6-e4bc371bbda3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f61e68ed8067419abc9465062f6ad639', 'request_id': 'req-f04bae98-b91f-43f5-84e6-e4bc371bbda3'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:42.499277 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f04bae98-b91f-43f5-84e6-e4bc371bbda3 admin admin] The token cache is being invalidate because project f61e68ed8067419abc9465062f6ad639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:28:42.499574 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f04bae98-b91f-43f5-84e6-e4bc371bbda3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:42.507591 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f04bae98-b91f-43f5-84e6-e4bc371bbda3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:42.516605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e1e4a-2055-4e58-9e81-9ba78758f37d None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:42.517595 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e1e4a-2055-4e58-9e81-9ba78758f37d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:42.518037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e1e4a-2055-4e58-9e81-9ba78758f37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:42.519554 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 893/1774] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:28:42 2022] DELETE /identity/v3/projects/f61e68ed8067419abc9465062f6ad639 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:42.538506 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-1c7e1e4a-2055-4e58-9e81-9ba78758f37d None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:42.540084 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1c7e1e4a-2055-4e58-9e81-9ba78758f37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:42.560497 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:42.660795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 882/1775] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:42.669073 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691aa8ff-af9e-4096-82a6-af3246af4553 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:42.669393 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691aa8ff-af9e-4096-82a6-af3246af4553 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:42.669648 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691aa8ff-af9e-4096-82a6-af3246af4553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:42.695838 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-691aa8ff-af9e-4096-82a6-af3246af4553 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:42.697280 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-691aa8ff-af9e-4096-82a6-af3246af4553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:42.730977 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e1e4a-2055-4e58-9e81-9ba78758f37d None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:42.746228 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e1e4a-2055-4e58-9e81-9ba78758f37d None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:42.747557 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 894/1776] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:42.768051 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36d777-2917-48db-b56e-d3cf9a8c4ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:42.768739 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36d777-2917-48db-b56e-d3cf9a8c4ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:42.769029 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36d777-2917-48db-b56e-d3cf9a8c4ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:42.769311 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36d777-2917-48db-b56e-d3cf9a8c4ed6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:42.770054 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36d777-2917-48db-b56e-d3cf9a8c4ed6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:42.770399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36d777-2917-48db-b56e-d3cf9a8c4ed6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:42.772203 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36d777-2917-48db-b56e-d3cf9a8c4ed6 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:42.778959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691aa8ff-af9e-4096-82a6-af3246af4553 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:42.780638 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-691aa8ff-af9e-4096-82a6-af3246af4553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:42.800024 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 883/1777] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:42.804232 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36d777-2917-48db-b56e-d3cf9a8c4ed6 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:42.806240 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691aa8ff-af9e-4096-82a6-af3246af4553 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:42.818355 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36d777-2917-48db-b56e-d3cf9a8c4ed6 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:42.822827 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9c651-0dd6-4462-b968-fc53839ab8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:42.822827 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9c651-0dd6-4462-b968-fc53839ab8e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:42.822827 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9c651-0dd6-4462-b968-fc53839ab8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:42.822827 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9c651-0dd6-4462-b968-fc53839ab8e0 admin admin] PATH_INFO: `/v3/users/7dedaa72cc904a4482fdfe2c0934d82e` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:42.823192 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9c651-0dd6-4462-b968-fc53839ab8e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dedaa72cc904a4482fdfe2c0934d82e)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:42.828839 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9c651-0dd6-4462-b968-fc53839ab8e0 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:42.830964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2395c-0a2b-4004-8944-82a7523f8664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:42.831856 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2395c-0a2b-4004-8944-82a7523f8664 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:42.832492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2395c-0a2b-4004-8944-82a7523f8664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:42.832893 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2395c-0a2b-4004-8944-82a7523f8664 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:42.833721 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2395c-0a2b-4004-8944-82a7523f8664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:42.842241 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2395c-0a2b-4004-8944-82a7523f8664 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:42.931451 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 884/1778] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:42 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:42.935522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2395c-0a2b-4004-8944-82a7523f8664 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:43.105771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2395c-0a2b-4004-8944-82a7523f8664 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:43.114194 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b43563-d223-4ca0-b2da-afeaaab95a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:43.114915 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b43563-d223-4ca0-b2da-afeaaab95a2b admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:43.115200 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b43563-d223-4ca0-b2da-afeaaab95a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:43.120681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b43563-d223-4ca0-b2da-afeaaab95a2b admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:43.120681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b43563-d223-4ca0-b2da-afeaaab95a2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:43.120681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b43563-d223-4ca0-b2da-afeaaab95a2b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:43.122280 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-79c9c651-0dd6-4462-b968-fc53839ab8e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dedaa72cc904a4482fdfe2c0934d82e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:43.203701 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-79c9c651-0dd6-4462-b968-fc53839ab8e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dedaa72cc904a4482fdfe2c0934d82e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:43.208234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:43.211362 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 885/1779] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:42 2022] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:28:43.219212 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b43563-d223-4ca0-b2da-afeaaab95a2b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:43.233550 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b43563-d223-4ca0-b2da-afeaaab95a2b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:43.238841 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb5929-6308-405d-8d42-33fd2dfbf31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:43.239516 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb5929-6308-405d-8d42-33fd2dfbf31e admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:43.239799 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb5929-6308-405d-8d42-33fd2dfbf31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:43.240101 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb5929-6308-405d-8d42-33fd2dfbf31e admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:43.240796 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb5929-6308-405d-8d42-33fd2dfbf31e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:43.242437 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb5929-6308-405d-8d42-33fd2dfbf31e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:43.251568 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-79c9c651-0dd6-4462-b968-fc53839ab8e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dedaa72cc904a4482fdfe2c0934d82e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:43.262764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 886/1780] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:43.264862 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb5929-6308-405d-8d42-33fd2dfbf31e admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:43.270474 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-79c9c651-0dd6-4462-b968-fc53839ab8e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dedaa72cc904a4482fdfe2c0934d82e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:43.271710 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-79c9c651-0dd6-4462-b968-fc53839ab8e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dedaa72cc904a4482fdfe2c0934d82e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:43.286208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 895/1781] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:28:42 2022] DELETE /identity/v3/users/7dedaa72cc904a4482fdfe2c0934d82e => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:28:43.289395 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb5929-6308-405d-8d42-33fd2dfbf31e admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:43.291580 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1c246-07c5-46d6-b7cc-75408ee1115f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:43.292113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1c246-07c5-46d6-b7cc-75408ee1115f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:43.292633 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1c246-07c5-46d6-b7cc-75408ee1115f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:43.325480 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:43.332821 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-72e1c246-07c5-46d6-b7cc-75408ee1115f None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:43.334069 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-72e1c246-07c5-46d6-b7cc-75408ee1115f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:43.436962 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efd4f0-4d21-4ed9-8121-edda35db615a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:43.437808 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efd4f0-4d21-4ed9-8121-edda35db615a admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:43.438155 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efd4f0-4d21-4ed9-8121-edda35db615a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:43.438600 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efd4f0-4d21-4ed9-8121-edda35db615a admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:43.440161 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9efd4f0-4d21-4ed9-8121-edda35db615a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:43.441257 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9efd4f0-4d21-4ed9-8121-edda35db615a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:43.456854 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 896/1782] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:28:43.461622 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 887/1783] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:43.466381 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1c246-07c5-46d6-b7cc-75408ee1115f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:43.468889 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-72e1c246-07c5-46d6-b7cc-75408ee1115f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:43.472881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efd4f0-4d21-4ed9-8121-edda35db615a admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:43.490344 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d9efd4f0-4d21-4ed9-8121-edda35db615a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:43.513636 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1c246-07c5-46d6-b7cc-75408ee1115f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:43.523717 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33721e5e-9af7-4bc7-bb8a-f53bb44e63d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:43.524675 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33721e5e-9af7-4bc7-bb8a-f53bb44e63d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:43.525029 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33721e5e-9af7-4bc7-bb8a-f53bb44e63d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:43.525350 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33721e5e-9af7-4bc7-bb8a-f53bb44e63d7 admin admin] PATH_INFO: `/v3/projects/afaa6ca2ef4748cd8846e7873daf59c9/users/87caa8524a7d4718bc73de0caf0e65a6/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:43.552070 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33721e5e-9af7-4bc7-bb8a-f53bb44e63d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afaa6ca2ef4748cd8846e7873daf59c9, user_id=87caa8524a7d4718bc73de0caf0e65a6, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:43.555862 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33721e5e-9af7-4bc7-bb8a-f53bb44e63d7 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:43.583849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efd4f0-4d21-4ed9-8121-edda35db615a admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:43.595393 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e5cd7-73a1-417f-ac08-d339b8754265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:43.596586 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e5cd7-73a1-417f-ac08-d339b8754265 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:43.597081 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e5cd7-73a1-417f-ac08-d339b8754265 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:43.598411 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e5cd7-73a1-417f-ac08-d339b8754265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:43.612986 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3e5cd7-73a1-417f-ac08-d339b8754265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:43.615544 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3e5cd7-73a1-417f-ac08-d339b8754265 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:43.642178 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 897/1784] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:43 2022] PUT /identity/v3/projects/afaa6ca2ef4748cd8846e7873daf59c9/users/87caa8524a7d4718bc73de0caf0e65a6/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:28:43.646056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 888/1785] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:43.657045 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4de869-abaa-4f80-85a0-b715f0b9289f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:43.657655 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4de869-abaa-4f80-85a0-b715f0b9289f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:43.657951 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4de869-abaa-4f80-85a0-b715f0b9289f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:43.736348 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0c4de869-abaa-4f80-85a0-b715f0b9289f None None] MFA Rules not processed for user `87caa8524a7d4718bc73de0caf0e65a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:43.737923 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0c4de869-abaa-4f80-85a0-b715f0b9289f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:43.910458 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 898/1786] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:43.915625 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e5cd7-73a1-417f-ac08-d339b8754265 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:43.932572 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e5cd7-73a1-417f-ac08-d339b8754265 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:44.039697 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06c908-7255-4a4d-845a-27a9bd48bb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:44.040670 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06c908-7255-4a4d-845a-27a9bd48bb09 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:44.041811 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06c908-7255-4a4d-845a-27a9bd48bb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:44.042277 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06c908-7255-4a4d-845a-27a9bd48bb09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:44.044121 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06c908-7255-4a4d-845a-27a9bd48bb09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:44.046582 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06c908-7255-4a4d-845a-27a9bd48bb09 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:44.163588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 889/1787] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:43 2022] POST /identity/v3/projects => generated 387 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:44.170484 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4de869-abaa-4f80-85a0-b715f0b9289f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:44.203235 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4de869-abaa-4f80-85a0-b715f0b9289f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:44.217903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06c908-7255-4a4d-845a-27a9bd48bb09 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:44.222155 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-bf06c908-7255-4a4d-845a-27a9bd48bb09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:44.368370 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6553d0-8672-4f91-af63-d52895d86fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:44.369331 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6553d0-8672-4f91-af63-d52895d86fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:44.369737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6553d0-8672-4f91-af63-d52895d86fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:44.370035 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6553d0-8672-4f91-af63-d52895d86fc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:44.371334 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6553d0-8672-4f91-af63-d52895d86fc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:44.374991 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6553d0-8672-4f91-af63-d52895d86fc8 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:44.438462 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06c908-7255-4a4d-845a-27a9bd48bb09 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:44.472025 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329106a-4f7d-413e-829c-1d66f77adc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:44.473011 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329106a-4f7d-413e-829c-1d66f77adc79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:44.473305 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329106a-4f7d-413e-829c-1d66f77adc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:44.473582 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329106a-4f7d-413e-829c-1d66f77adc79 admin admin] PATH_INFO: `/v3/projects/66ae8624ca63408284232815efe988ea` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:44.480640 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329106a-4f7d-413e-829c-1d66f77adc79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66ae8624ca63408284232815efe988ea)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:44.480640 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329106a-4f7d-413e-829c-1d66f77adc79 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:44.515154 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 899/1788] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:44 2022] POST /identity/v3/users => generated 300 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:44.516419 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6553d0-8672-4f91-af63-d52895d86fc8 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:44.518240 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4b6553d0-8672-4f91-af63-d52895d86fc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:44.531191 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6553d0-8672-4f91-af63-d52895d86fc8 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:44.537637 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6c4c0-ddec-441b-87ba-d585b95fc9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:44.539025 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6c4c0-ddec-441b-87ba-d585b95fc9d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:44.539025 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6c4c0-ddec-441b-87ba-d585b95fc9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:44.539230 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6c4c0-ddec-441b-87ba-d585b95fc9d7 admin admin] PATH_INFO: `/v3/projects/3c52da8da47440379aaae733859036e2` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:44.542940 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6c4c0-ddec-441b-87ba-d585b95fc9d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c52da8da47440379aaae733859036e2)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:44.545404 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6c4c0-ddec-441b-87ba-d585b95fc9d7 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:44.642689 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4329106a-4f7d-413e-829c-1d66f77adc79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66ae8624ca63408284232815efe988ea', 'request_id': 'req-4329106a-4f7d-413e-829c-1d66f77adc79'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:44.660309 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4329106a-4f7d-413e-829c-1d66f77adc79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66ae8624ca63408284232815efe988ea', 'request_id': 'req-4329106a-4f7d-413e-829c-1d66f77adc79'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:44.765940 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4329106a-4f7d-413e-829c-1d66f77adc79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66ae8624ca63408284232815efe988ea', 'request_id': 'req-4329106a-4f7d-413e-829c-1d66f77adc79'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:44.788035 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4329106a-4f7d-413e-829c-1d66f77adc79 admin admin] The token cache is being invalidate because project 66ae8624ca63408284232815efe988ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:28:44.788557 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4329106a-4f7d-413e-829c-1d66f77adc79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:44.789599 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4329106a-4f7d-413e-829c-1d66f77adc79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:44.793385 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 890/1789] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:28:44 2022] DELETE /identity/v3/projects/66ae8624ca63408284232815efe988ea => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:28:44.794609 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329106a-4f7d-413e-829c-1d66f77adc79 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:44.797036 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4329106a-4f7d-413e-829c-1d66f77adc79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:44.798879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-42b6c4c0-ddec-441b-87ba-d585b95fc9d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c52da8da47440379aaae733859036e2', 'request_id': 'req-42b6c4c0-ddec-441b-87ba-d585b95fc9d7'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:44.922645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329106a-4f7d-413e-829c-1d66f77adc79 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:44.955258 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-42b6c4c0-ddec-441b-87ba-d585b95fc9d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c52da8da47440379aaae733859036e2', 'request_id': 'req-42b6c4c0-ddec-441b-87ba-d585b95fc9d7'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:44.965130 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-42b6c4c0-ddec-441b-87ba-d585b95fc9d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c52da8da47440379aaae733859036e2', 'request_id': 'req-42b6c4c0-ddec-441b-87ba-d585b95fc9d7'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:44.984770 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-42b6c4c0-ddec-441b-87ba-d585b95fc9d7 admin admin] The token cache is being invalidate because project 3c52da8da47440379aaae733859036e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:28:44.985078 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-42b6c4c0-ddec-441b-87ba-d585b95fc9d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:44.985883 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-42b6c4c0-ddec-441b-87ba-d585b95fc9d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:44.991574 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 900/1790] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:28:44 2022] DELETE /identity/v3/projects/3c52da8da47440379aaae733859036e2 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:44.991574 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6c4c0-ddec-441b-87ba-d585b95fc9d7 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:44.992621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-42b6c4c0-ddec-441b-87ba-d585b95fc9d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:45.067963 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e183471-04d2-4928-a2cf-ff80b006b2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:45.068931 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e183471-04d2-4928-a2cf-ff80b006b2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:45.069371 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e183471-04d2-4928-a2cf-ff80b006b2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:45.070012 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e183471-04d2-4928-a2cf-ff80b006b2a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:45.071861 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e183471-04d2-4928-a2cf-ff80b006b2a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:45.075345 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e183471-04d2-4928-a2cf-ff80b006b2a8 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:45.112043 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 891/1791] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:45.116412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e183471-04d2-4928-a2cf-ff80b006b2a8 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:45.118624 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4e183471-04d2-4928-a2cf-ff80b006b2a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:45.140049 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6c4c0-ddec-441b-87ba-d585b95fc9d7 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:45.146656 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e183471-04d2-4928-a2cf-ff80b006b2a8 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:45.153567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8faa9b5-7e79-48b3-a092-ba3790f348fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:45.154594 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8faa9b5-7e79-48b3-a092-ba3790f348fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:45.154893 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8faa9b5-7e79-48b3-a092-ba3790f348fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:45.155860 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8faa9b5-7e79-48b3-a092-ba3790f348fd admin admin] PATH_INFO: `/v3/users/e231bec492464b3f9ebcbf12d46febd2` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:45.160884 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8faa9b5-7e79-48b3-a092-ba3790f348fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e231bec492464b3f9ebcbf12d46febd2)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:45.162373 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe83d33-0d1b-4219-b8b0-14c903ac03ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:45.172500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe83d33-0d1b-4219-b8b0-14c903ac03ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:45.172683 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe83d33-0d1b-4219-b8b0-14c903ac03ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:45.176720 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8faa9b5-7e79-48b3-a092-ba3790f348fd admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:45.179956 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe83d33-0d1b-4219-b8b0-14c903ac03ce admin admin] PATH_INFO: `/v3/users/4e1a259b0bf742bda85b679183526b10` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:45.186240 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe83d33-0d1b-4219-b8b0-14c903ac03ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e1a259b0bf742bda85b679183526b10)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:45.189126 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe83d33-0d1b-4219-b8b0-14c903ac03ce admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:45.257360 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:45.398347 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:45.480638 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-5fe83d33-0d1b-4219-b8b0-14c903ac03ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e1a259b0bf742bda85b679183526b10'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:45.492451 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-5fe83d33-0d1b-4219-b8b0-14c903ac03ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e1a259b0bf742bda85b679183526b10'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:45.518294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-5fe83d33-0d1b-4219-b8b0-14c903ac03ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e1a259b0bf742bda85b679183526b10'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:45.519245 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-5fe83d33-0d1b-4219-b8b0-14c903ac03ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e1a259b0bf742bda85b679183526b10'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:45.537970 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e8faa9b5-7e79-48b3-a092-ba3790f348fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e231bec492464b3f9ebcbf12d46febd2'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:45.600195 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-5fe83d33-0d1b-4219-b8b0-14c903ac03ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e1a259b0bf742bda85b679183526b10'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:45.608320 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 892/1792] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:28:45 2022] DELETE /identity/v3/users/4e1a259b0bf742bda85b679183526b10 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:45.610092 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe83d33-0d1b-4219-b8b0-14c903ac03ce admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:45.620442 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5fe83d33-0d1b-4219-b8b0-14c903ac03ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:45.663543 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e8faa9b5-7e79-48b3-a092-ba3790f348fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e231bec492464b3f9ebcbf12d46febd2'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:45.679960 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e8faa9b5-7e79-48b3-a092-ba3790f348fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e231bec492464b3f9ebcbf12d46febd2'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:45.691422 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e8faa9b5-7e79-48b3-a092-ba3790f348fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e231bec492464b3f9ebcbf12d46febd2'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:45.692459 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e8faa9b5-7e79-48b3-a092-ba3790f348fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e231bec492464b3f9ebcbf12d46febd2'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:45.704271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 901/1793] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:28:44 2022] DELETE /identity/v3/users/e231bec492464b3f9ebcbf12d46febd2 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:45.711614 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8faa9b5-7e79-48b3-a092-ba3790f348fd admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:45.717266 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e8faa9b5-7e79-48b3-a092-ba3790f348fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:45.735521 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe83d33-0d1b-4219-b8b0-14c903ac03ce admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:45.811672 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8faa9b5-7e79-48b3-a092-ba3790f348fd admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:45.820456 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c30d3-76cc-4379-852d-71a57d0aeecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:45.821503 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c30d3-76cc-4379-852d-71a57d0aeecd admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:45.821926 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c30d3-76cc-4379-852d-71a57d0aeecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:45.822418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c30d3-76cc-4379-852d-71a57d0aeecd admin admin] PATH_INFO: `/v3/projects/9d48e570353a412090d4f06d8d25db93/users/efd9a8eae3de4050875ddcf897936f0a/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:45.843923 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c30d3-76cc-4379-852d-71a57d0aeecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d48e570353a412090d4f06d8d25db93, user_id=efd9a8eae3de4050875ddcf897936f0a, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:45.847652 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c30d3-76cc-4379-852d-71a57d0aeecd admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:45.857608 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418d31e-766f-400f-bd03-9695c675d963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:45.858546 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418d31e-766f-400f-bd03-9695c675d963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:45.858904 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418d31e-766f-400f-bd03-9695c675d963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:45.859190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418d31e-766f-400f-bd03-9695c675d963 admin admin] PATH_INFO: `/v3/users/650faf0ceb91455caa7a23641564e3f3` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:45.860898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418d31e-766f-400f-bd03-9695c675d963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=650faf0ceb91455caa7a23641564e3f3)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:45.863076 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418d31e-766f-400f-bd03-9695c675d963 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:45.950292 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 902/1794] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:45 2022] PUT /identity/v3/projects/9d48e570353a412090d4f06d8d25db93/users/efd9a8eae3de4050875ddcf897936f0a/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:45.951742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d94ed8-7975-4a88-a9da-6071ec712a33 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:45.952111 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d94ed8-7975-4a88-a9da-6071ec712a33 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:45.952399 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d94ed8-7975-4a88-a9da-6071ec712a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:45.973903 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d8d94ed8-7975-4a88-a9da-6071ec712a33 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:45.975152 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d8d94ed8-7975-4a88-a9da-6071ec712a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:46.105538 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 903/1795] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:46.109078 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d94ed8-7975-4a88-a9da-6071ec712a33 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:46.120650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d94ed8-7975-4a88-a9da-6071ec712a33 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:46.126679 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5573a82-11ea-4000-9063-6afd21a69fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:46.128645 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5573a82-11ea-4000-9063-6afd21a69fed admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:46.129177 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5573a82-11ea-4000-9063-6afd21a69fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:46.129666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5573a82-11ea-4000-9063-6afd21a69fed admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:46.130718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5573a82-11ea-4000-9063-6afd21a69fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:46.132682 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5573a82-11ea-4000-9063-6afd21a69fed admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:46.133259 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c418d31e-766f-400f-bd03-9695c675d963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '650faf0ceb91455caa7a23641564e3f3'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:46.142463 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c418d31e-766f-400f-bd03-9695c675d963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '650faf0ceb91455caa7a23641564e3f3'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:46.150735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 904/1796] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:46.150735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5573a82-11ea-4000-9063-6afd21a69fed admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:46.155783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e5573a82-11ea-4000-9063-6afd21a69fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:46.167474 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c418d31e-766f-400f-bd03-9695c675d963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '650faf0ceb91455caa7a23641564e3f3'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:46.172274 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c418d31e-766f-400f-bd03-9695c675d963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '650faf0ceb91455caa7a23641564e3f3'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:46.266179 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5573a82-11ea-4000-9063-6afd21a69fed admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:46.271403 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03830ef5-ca37-4adf-a3f8-cea1bd06cc8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:46.321292 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03830ef5-ca37-4adf-a3f8-cea1bd06cc8d service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:46.321292 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03830ef5-ca37-4adf-a3f8-cea1bd06cc8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:46.321292 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03830ef5-ca37-4adf-a3f8-cea1bd06cc8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:46.321292 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03830ef5-ca37-4adf-a3f8-cea1bd06cc8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:46.321292 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03830ef5-ca37-4adf-a3f8-cea1bd06cc8d service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:46.321292 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 905/1797] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:46.323950 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03830ef5-ca37-4adf-a3f8-cea1bd06cc8d service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:46.323950 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03830ef5-ca37-4adf-a3f8-cea1bd06cc8d service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:46.323950 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139c74e-f899-41b4-bf68-015e01a44d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:46.323950 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139c74e-f899-41b4-bf68-015e01a44d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:46.324813 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139c74e-f899-41b4-bf68-015e01a44d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:46.324813 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139c74e-f899-41b4-bf68-015e01a44d7b admin admin] PATH_INFO: `/v3/projects/9d48e570353a412090d4f06d8d25db93/users/efd9a8eae3de4050875ddcf897936f0a/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:46.324813 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139c74e-f899-41b4-bf68-015e01a44d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d48e570353a412090d4f06d8d25db93, user_id=efd9a8eae3de4050875ddcf897936f0a, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:46.324813 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139c74e-f899-41b4-bf68-015e01a44d7b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:46.343509 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 906/1798] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:46 2022] PUT /identity/v3/projects/9d48e570353a412090d4f06d8d25db93/users/efd9a8eae3de4050875ddcf897936f0a/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:46.362758 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b301c-ef97-44d1-928a-77048e8b049b None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:46.363032 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b301c-ef97-44d1-928a-77048e8b049b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:46.363315 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b301c-ef97-44d1-928a-77048e8b049b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:46.404672 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-327b301c-ef97-44d1-928a-77048e8b049b None None] MFA Rules not processed for user `efd9a8eae3de4050875ddcf897936f0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:46.408299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-327b301c-ef97-44d1-928a-77048e8b049b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:46.419755 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c418d31e-766f-400f-bd03-9695c675d963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '650faf0ceb91455caa7a23641564e3f3'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:46.435610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 893/1799] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:28:45 2022] DELETE /identity/v3/users/650faf0ceb91455caa7a23641564e3f3 => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:46.550716 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 907/1800] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:46.564339 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418d31e-766f-400f-bd03-9695c675d963 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:46.566035 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c418d31e-766f-400f-bd03-9695c675d963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:46.643345 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418d31e-766f-400f-bd03-9695c675d963 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:46.664156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c2dfd-5b37-4033-94d5-91874fcf174c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:46.664156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c2dfd-5b37-4033-94d5-91874fcf174c service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:46.664156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c2dfd-5b37-4033-94d5-91874fcf174c service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:46.664156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c2dfd-5b37-4033-94d5-91874fcf174c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:46.716851 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c2dfd-5b37-4033-94d5-91874fcf174c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:46.718328 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c2dfd-5b37-4033-94d5-91874fcf174c service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:46.729068 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 894/1801] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:46.800756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b301c-ef97-44d1-928a-77048e8b049b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:46.802402 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-327b301c-ef97-44d1-928a-77048e8b049b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:46.890236 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b301c-ef97-44d1-928a-77048e8b049b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:46.968189 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7909c3-fb54-4375-9936-6a0afd48b99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:46.968189 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7909c3-fb54-4375-9936-6a0afd48b99a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:46.968363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7909c3-fb54-4375-9936-6a0afd48b99a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:46.968698 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7909c3-fb54-4375-9936-6a0afd48b99a admin admin] PATH_INFO: `/v3/users/87caa8524a7d4718bc73de0caf0e65a6` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:46.970144 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7909c3-fb54-4375-9936-6a0afd48b99a admin admin] RBAC: Authorizing `identity:delete_user(user_id=87caa8524a7d4718bc73de0caf0e65a6)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:46.979044 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7909c3-fb54-4375-9936-6a0afd48b99a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:47.223750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3c7909c3-fb54-4375-9936-6a0afd48b99a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87caa8524a7d4718bc73de0caf0e65a6'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:47.267694 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c2dfd-5b37-4033-94d5-91874fcf174c service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:47.269760 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-620c2dfd-5b37-4033-94d5-91874fcf174c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:47.290547 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c2dfd-5b37-4033-94d5-91874fcf174c service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:47.300709 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320fef2-10db-4c3d-bda6-9312aaea86f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:47.300709 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320fef2-10db-4c3d-bda6-9312aaea86f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:47.300709 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320fef2-10db-4c3d-bda6-9312aaea86f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:47.301714 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320fef2-10db-4c3d-bda6-9312aaea86f1 admin admin] PATH_INFO: `/v3/projects/f484acf43401482ebe091efeb45837c5` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:47.303267 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320fef2-10db-4c3d-bda6-9312aaea86f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f484acf43401482ebe091efeb45837c5)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:47.305664 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320fef2-10db-4c3d-bda6-9312aaea86f1 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:47.319958 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3c7909c3-fb54-4375-9936-6a0afd48b99a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87caa8524a7d4718bc73de0caf0e65a6'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:47.337111 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3c7909c3-fb54-4375-9936-6a0afd48b99a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87caa8524a7d4718bc73de0caf0e65a6'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:47.358762 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3c7909c3-fb54-4375-9936-6a0afd48b99a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87caa8524a7d4718bc73de0caf0e65a6'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:47.359723 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3c7909c3-fb54-4375-9936-6a0afd48b99a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87caa8524a7d4718bc73de0caf0e65a6'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:47.369389 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 908/1802] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:28:46 2022] DELETE /identity/v3/users/87caa8524a7d4718bc73de0caf0e65a6 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:47.370409 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7909c3-fb54-4375-9936-6a0afd48b99a admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:47.376301 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3c7909c3-fb54-4375-9936-6a0afd48b99a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:47.460758 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4320fef2-10db-4c3d-bda6-9312aaea86f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f484acf43401482ebe091efeb45837c5', 'request_id': 'req-4320fef2-10db-4c3d-bda6-9312aaea86f1'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:47.469743 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4320fef2-10db-4c3d-bda6-9312aaea86f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f484acf43401482ebe091efeb45837c5', 'request_id': 'req-4320fef2-10db-4c3d-bda6-9312aaea86f1'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:47.482405 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7909c3-fb54-4375-9936-6a0afd48b99a admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:47.533862 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4320fef2-10db-4c3d-bda6-9312aaea86f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f484acf43401482ebe091efeb45837c5', 'request_id': 'req-4320fef2-10db-4c3d-bda6-9312aaea86f1'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:47.544294 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c4151-7711-44ad-bc20-db23ed545cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:47.545100 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c4151-7711-44ad-bc20-db23ed545cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:47.545454 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c4151-7711-44ad-bc20-db23ed545cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:47.545828 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c4151-7711-44ad-bc20-db23ed545cd7 admin admin] PATH_INFO: `/v3/projects/b28764a5e326444299b9eb25863093c7` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:47.547072 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c4151-7711-44ad-bc20-db23ed545cd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b28764a5e326444299b9eb25863093c7)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:47.548237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4320fef2-10db-4c3d-bda6-9312aaea86f1 admin admin] The token cache is being invalidate because project f484acf43401482ebe091efeb45837c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:28:47.548636 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4320fef2-10db-4c3d-bda6-9312aaea86f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:47.549228 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c4151-7711-44ad-bc20-db23ed545cd7 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:47.549379 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4320fef2-10db-4c3d-bda6-9312aaea86f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:47.554020 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 895/1803] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:28:47 2022] DELETE /identity/v3/projects/f484acf43401482ebe091efeb45837c5 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:28:47.554020 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1a525-f1ba-40bf-937f-b33e60d7c2af None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:47.554020 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1a525-f1ba-40bf-937f-b33e60d7c2af None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:47.554020 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1a525-f1ba-40bf-937f-b33e60d7c2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:47.573326 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-1aa1a525-f1ba-40bf-937f-b33e60d7c2af None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:47.574736 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1aa1a525-f1ba-40bf-937f-b33e60d7c2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:47.582880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 896/1804] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:47.583865 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1a525-f1ba-40bf-937f-b33e60d7c2af None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:47.585997 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1aa1a525-f1ba-40bf-937f-b33e60d7c2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:47.600352 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1a525-f1ba-40bf-937f-b33e60d7c2af None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:47.605354 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c2320-5784-4ee5-b0a0-f3470a50d36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:47.606288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c2320-5784-4ee5-b0a0-f3470a50d36b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:47.606569 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c2320-5784-4ee5-b0a0-f3470a50d36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:47.606845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c2320-5784-4ee5-b0a0-f3470a50d36b admin admin] PATH_INFO: `/v3/projects/4e6a60863da94f5a88d086c0f525f7e9` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:47.608026 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c2320-5784-4ee5-b0a0-f3470a50d36b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e6a60863da94f5a88d086c0f525f7e9)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:47.609926 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c2320-5784-4ee5-b0a0-f3470a50d36b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:47.661555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-091c4151-7711-44ad-bc20-db23ed545cd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b28764a5e326444299b9eb25863093c7', 'request_id': 'req-091c4151-7711-44ad-bc20-db23ed545cd7'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:47.740740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-490c2320-5784-4ee5-b0a0-f3470a50d36b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e6a60863da94f5a88d086c0f525f7e9', 'request_id': 'req-490c2320-5784-4ee5-b0a0-f3470a50d36b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:47.746377 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-490c2320-5784-4ee5-b0a0-f3470a50d36b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e6a60863da94f5a88d086c0f525f7e9', 'request_id': 'req-490c2320-5784-4ee5-b0a0-f3470a50d36b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:47.768313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-091c4151-7711-44ad-bc20-db23ed545cd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b28764a5e326444299b9eb25863093c7', 'request_id': 'req-091c4151-7711-44ad-bc20-db23ed545cd7'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:47.774523 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-091c4151-7711-44ad-bc20-db23ed545cd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b28764a5e326444299b9eb25863093c7', 'request_id': 'req-091c4151-7711-44ad-bc20-db23ed545cd7'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:47.786788 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-091c4151-7711-44ad-bc20-db23ed545cd7 admin admin] The token cache is being invalidate because project b28764a5e326444299b9eb25863093c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:28:47.787016 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-091c4151-7711-44ad-bc20-db23ed545cd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:47.787683 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-091c4151-7711-44ad-bc20-db23ed545cd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:47.789256 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 909/1805] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:28:47 2022] DELETE /identity/v3/projects/b28764a5e326444299b9eb25863093c7 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:47.790213 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c4151-7711-44ad-bc20-db23ed545cd7 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:47.792291 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-091c4151-7711-44ad-bc20-db23ed545cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:47.862252 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c4151-7711-44ad-bc20-db23ed545cd7 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:47.874799 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-490c2320-5784-4ee5-b0a0-f3470a50d36b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e6a60863da94f5a88d086c0f525f7e9', 'request_id': 'req-490c2320-5784-4ee5-b0a0-f3470a50d36b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:47.888244 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-490c2320-5784-4ee5-b0a0-f3470a50d36b admin admin] The token cache is being invalidate because project 4e6a60863da94f5a88d086c0f525f7e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:28:47.889990 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-490c2320-5784-4ee5-b0a0-f3470a50d36b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:47.889990 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-490c2320-5784-4ee5-b0a0-f3470a50d36b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:47.891336 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 897/1806] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:28:47 2022] DELETE /identity/v3/projects/4e6a60863da94f5a88d086c0f525f7e9 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:47.892309 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c2320-5784-4ee5-b0a0-f3470a50d36b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:47.893743 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-490c2320-5784-4ee5-b0a0-f3470a50d36b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:47.944961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf034d-c440-4ee6-b3ce-72656f3520c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:47.945886 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf034d-c440-4ee6-b3ce-72656f3520c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:47.946196 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf034d-c440-4ee6-b3ce-72656f3520c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:47.946473 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf034d-c440-4ee6-b3ce-72656f3520c6 admin admin] PATH_INFO: `/v3/users/68613b87f9bc48d98426189c4a568c6d` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:47.948552 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf034d-c440-4ee6-b3ce-72656f3520c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68613b87f9bc48d98426189c4a568c6d)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:47.950500 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf034d-c440-4ee6-b3ce-72656f3520c6 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:47.953881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c2320-5784-4ee5-b0a0-f3470a50d36b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:47.957588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba0928-e4cd-4aa3-90c6-923423e9b3c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:47.958326 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba0928-e4cd-4aa3-90c6-923423e9b3c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:47.962135 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba0928-e4cd-4aa3-90c6-923423e9b3c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:47.962135 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba0928-e4cd-4aa3-90c6-923423e9b3c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:47.962135 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4aba0928-e4cd-4aa3-90c6-923423e9b3c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:47.972945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba0928-e4cd-4aa3-90c6-923423e9b3c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:47.974413 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba0928-e4cd-4aa3-90c6-923423e9b3c3 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:47.984062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 898/1807] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:47.985296 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836a533-6de6-4cfe-9dc6-480e1ecd127a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:47.985585 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836a533-6de6-4cfe-9dc6-480e1ecd127a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:47.985867 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836a533-6de6-4cfe-9dc6-480e1ecd127a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:48.005347 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-1836a533-6de6-4cfe-9dc6-480e1ecd127a None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:48.006597 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1836a533-6de6-4cfe-9dc6-480e1ecd127a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:48.024571 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 899/1808] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:48.024571 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836a533-6de6-4cfe-9dc6-480e1ecd127a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:48.024571 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1836a533-6de6-4cfe-9dc6-480e1ecd127a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:48.033169 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836a533-6de6-4cfe-9dc6-480e1ecd127a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:48.038216 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd224b75-a3ba-48f0-989a-79239e2b5848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:48.039045 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd224b75-a3ba-48f0-989a-79239e2b5848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:48.039330 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd224b75-a3ba-48f0-989a-79239e2b5848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:48.039604 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd224b75-a3ba-48f0-989a-79239e2b5848 admin admin] PATH_INFO: `/v3/users/3f0d45982de54fee8c87231cfce66bea` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:48.041354 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd224b75-a3ba-48f0-989a-79239e2b5848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f0d45982de54fee8c87231cfce66bea)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:48.043472 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd224b75-a3ba-48f0-989a-79239e2b5848 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:48.178000 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-abaf034d-c440-4ee6-b3ce-72656f3520c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68613b87f9bc48d98426189c4a568c6d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:48.188334 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:48.308540 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-abaf034d-c440-4ee6-b3ce-72656f3520c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68613b87f9bc48d98426189c4a568c6d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:48.325659 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-fd224b75-a3ba-48f0-989a-79239e2b5848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f0d45982de54fee8c87231cfce66bea'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:48.332055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-abaf034d-c440-4ee6-b3ce-72656f3520c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68613b87f9bc48d98426189c4a568c6d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:48.335689 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-fd224b75-a3ba-48f0-989a-79239e2b5848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f0d45982de54fee8c87231cfce66bea'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:48.340359 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-abaf034d-c440-4ee6-b3ce-72656f3520c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68613b87f9bc48d98426189c4a568c6d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:48.354558 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-abaf034d-c440-4ee6-b3ce-72656f3520c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68613b87f9bc48d98426189c4a568c6d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:48.354558 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 910/1809] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:28:47 2022] DELETE /identity/v3/users/68613b87f9bc48d98426189c4a568c6d => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:48.354558 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bbf11-2e0d-45c9-a5dc-be58a918c0bc None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:48.354558 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bbf11-2e0d-45c9-a5dc-be58a918c0bc None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:48.354558 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bbf11-2e0d-45c9-a5dc-be58a918c0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:48.356386 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-fd224b75-a3ba-48f0-989a-79239e2b5848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f0d45982de54fee8c87231cfce66bea'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:48.357391 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-fd224b75-a3ba-48f0-989a-79239e2b5848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f0d45982de54fee8c87231cfce66bea'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:48.371752 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-515bbf11-2e0d-45c9-a5dc-be58a918c0bc None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:48.373149 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-515bbf11-2e0d-45c9-a5dc-be58a918c0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:48.374667 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:48.432359 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-fd224b75-a3ba-48f0-989a-79239e2b5848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f0d45982de54fee8c87231cfce66bea'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:48.441698 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 911/1810] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:48.443130 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 900/1811] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:28:48 2022] DELETE /identity/v3/users/3f0d45982de54fee8c87231cfce66bea => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:48.448157 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bbf11-2e0d-45c9-a5dc-be58a918c0bc None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:48.458470 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bbf11-2e0d-45c9-a5dc-be58a918c0bc None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:48.529442 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aefc43f-287d-4cf1-b7e8-762399321eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:48.530133 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefc43f-287d-4cf1-b7e8-762399321eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:48.530429 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefc43f-287d-4cf1-b7e8-762399321eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:48.530709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefc43f-287d-4cf1-b7e8-762399321eb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:48.531454 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aefc43f-287d-4cf1-b7e8-762399321eb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:48.531751 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aefc43f-287d-4cf1-b7e8-762399321eb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:48.533722 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aefc43f-287d-4cf1-b7e8-762399321eb9 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:48.546860 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 912/1812] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:48.553675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd224b75-a3ba-48f0-989a-79239e2b5848 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:48.555489 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aefc43f-287d-4cf1-b7e8-762399321eb9 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:48.557793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3aefc43f-287d-4cf1-b7e8-762399321eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:48.569275 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd224b75-a3ba-48f0-989a-79239e2b5848 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:48.576134 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aefc43f-287d-4cf1-b7e8-762399321eb9 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:48.576675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08697edb-cafe-42c0-bdab-3f8db5b360b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:48.577362 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08697edb-cafe-42c0-bdab-3f8db5b360b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:48.577645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08697edb-cafe-42c0-bdab-3f8db5b360b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:48.578371 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08697edb-cafe-42c0-bdab-3f8db5b360b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:48.579234 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08697edb-cafe-42c0-bdab-3f8db5b360b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:48.581746 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08697edb-cafe-42c0-bdab-3f8db5b360b0 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:48.584731 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e1394-52f8-453e-8c02-d0deb49ac6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:48.586321 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e1394-52f8-453e-8c02-d0deb49ac6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:48.590932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e1394-52f8-453e-8c02-d0deb49ac6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:48.590932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e1394-52f8-453e-8c02-d0deb49ac6ba admin admin] PATH_INFO: `/v3/projects/afaa6ca2ef4748cd8846e7873daf59c9` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:48.592410 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e1394-52f8-453e-8c02-d0deb49ac6ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=afaa6ca2ef4748cd8846e7873daf59c9)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:48.595159 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e1394-52f8-453e-8c02-d0deb49ac6ba admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:48.727459 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 901/1813] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:48 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:48.729445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08697edb-cafe-42c0-bdab-3f8db5b360b0 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:48.777148 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c13e1394-52f8-453e-8c02-d0deb49ac6ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afaa6ca2ef4748cd8846e7873daf59c9', 'request_id': 'req-c13e1394-52f8-453e-8c02-d0deb49ac6ba'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:48.800547 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08697edb-cafe-42c0-bdab-3f8db5b360b0 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:48.857902 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540823b3-e450-4713-9626-9db458e50be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:48.858857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540823b3-e450-4713-9626-9db458e50be4 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:48.863920 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540823b3-e450-4713-9626-9db458e50be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:48.863920 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540823b3-e450-4713-9626-9db458e50be4 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:48.864107 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c13e1394-52f8-453e-8c02-d0deb49ac6ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afaa6ca2ef4748cd8846e7873daf59c9', 'request_id': 'req-c13e1394-52f8-453e-8c02-d0deb49ac6ba'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:48.864192 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540823b3-e450-4713-9626-9db458e50be4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:48.864192 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540823b3-e450-4713-9626-9db458e50be4 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:48.867230 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c13e1394-52f8-453e-8c02-d0deb49ac6ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afaa6ca2ef4748cd8846e7873daf59c9', 'request_id': 'req-c13e1394-52f8-453e-8c02-d0deb49ac6ba'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:48.887101 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c13e1394-52f8-453e-8c02-d0deb49ac6ba admin admin] The token cache is being invalidate because project afaa6ca2ef4748cd8846e7873daf59c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:28:48.887101 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c13e1394-52f8-453e-8c02-d0deb49ac6ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:48.901683 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c13e1394-52f8-453e-8c02-d0deb49ac6ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:48.904884 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 913/1814] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:28:48 2022] DELETE /identity/v3/projects/afaa6ca2ef4748cd8846e7873daf59c9 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:28:48.912555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e1394-52f8-453e-8c02-d0deb49ac6ba admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:48.913985 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c13e1394-52f8-453e-8c02-d0deb49ac6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:48.937179 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e1394-52f8-453e-8c02-d0deb49ac6ba admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:48.945024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448405f2-8266-462b-973a-3a0e932e4a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:48.945876 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448405f2-8266-462b-973a-3a0e932e4a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:48.946208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448405f2-8266-462b-973a-3a0e932e4a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:48.946488 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448405f2-8266-462b-973a-3a0e932e4a53 admin admin] PATH_INFO: `/v3/users/efd9a8eae3de4050875ddcf897936f0a` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:48.947856 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448405f2-8266-462b-973a-3a0e932e4a53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efd9a8eae3de4050875ddcf897936f0a)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:48.949777 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448405f2-8266-462b-973a-3a0e932e4a53 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:49.011477 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 902/1815] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:48 2022] POST /identity/v3/users => generated 287 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:28:49.015561 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540823b3-e450-4713-9626-9db458e50be4 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:49.017193 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-540823b3-e450-4713-9626-9db458e50be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:49.029128 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540823b3-e450-4713-9626-9db458e50be4 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:49.039582 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcc339-355c-4262-ae42-6306602aab83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:49.039582 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcc339-355c-4262-ae42-6306602aab83 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:49.039582 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcc339-355c-4262-ae42-6306602aab83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:49.039582 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcc339-355c-4262-ae42-6306602aab83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:49.039927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fcc339-355c-4262-ae42-6306602aab83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:49.041673 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fcc339-355c-4262-ae42-6306602aab83 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:49.057945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 903/1816] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:28:49.057945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcc339-355c-4262-ae42-6306602aab83 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:49.064259 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-54fcc339-355c-4262-ae42-6306602aab83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:49.079184 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcc339-355c-4262-ae42-6306602aab83 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:49.084109 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea595af-85db-443b-869d-a87dab491616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:49.084979 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea595af-85db-443b-869d-a87dab491616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:49.085263 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea595af-85db-443b-869d-a87dab491616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:49.085898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea595af-85db-443b-869d-a87dab491616 admin admin] PATH_INFO: `/v3/projects/52387eb10f1a4ff2a7136f3fec04ef18` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:49.087138 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea595af-85db-443b-869d-a87dab491616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52387eb10f1a4ff2a7136f3fec04ef18)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:49.090049 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea595af-85db-443b-869d-a87dab491616 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:49.131182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-448405f2-8266-462b-973a-3a0e932e4a53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efd9a8eae3de4050875ddcf897936f0a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:49.200214 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-448405f2-8266-462b-973a-3a0e932e4a53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efd9a8eae3de4050875ddcf897936f0a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:49.219150 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-448405f2-8266-462b-973a-3a0e932e4a53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efd9a8eae3de4050875ddcf897936f0a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:49.219905 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9ea595af-85db-443b-869d-a87dab491616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52387eb10f1a4ff2a7136f3fec04ef18', 'request_id': 'req-9ea595af-85db-443b-869d-a87dab491616'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:49.226203 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9ea595af-85db-443b-869d-a87dab491616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52387eb10f1a4ff2a7136f3fec04ef18', 'request_id': 'req-9ea595af-85db-443b-869d-a87dab491616'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:49.227060 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-448405f2-8266-462b-973a-3a0e932e4a53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efd9a8eae3de4050875ddcf897936f0a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:49.227905 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-448405f2-8266-462b-973a-3a0e932e4a53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efd9a8eae3de4050875ddcf897936f0a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:49.234623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 914/1817] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:28:48 2022] DELETE /identity/v3/users/efd9a8eae3de4050875ddcf897936f0a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:28:49.235524 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448405f2-8266-462b-973a-3a0e932e4a53 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:49.236765 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-448405f2-8266-462b-973a-3a0e932e4a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:49.308219 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448405f2-8266-462b-973a-3a0e932e4a53 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:49.317052 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9ea595af-85db-443b-869d-a87dab491616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52387eb10f1a4ff2a7136f3fec04ef18', 'request_id': 'req-9ea595af-85db-443b-869d-a87dab491616'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:49.329010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa701682-8173-492f-a9ea-7003cb2d86e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:49.329985 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa701682-8173-492f-a9ea-7003cb2d86e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:49.330294 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa701682-8173-492f-a9ea-7003cb2d86e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:49.330575 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa701682-8173-492f-a9ea-7003cb2d86e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:49.331424 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa701682-8173-492f-a9ea-7003cb2d86e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:49.333902 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9ea595af-85db-443b-869d-a87dab491616 admin admin] The token cache is being invalidate because project 52387eb10f1a4ff2a7136f3fec04ef18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:28:49.334402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9ea595af-85db-443b-869d-a87dab491616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:49.335084 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9ea595af-85db-443b-869d-a87dab491616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:49.337037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 904/1818] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:28:49 2022] DELETE /identity/v3/projects/52387eb10f1a4ff2a7136f3fec04ef18 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:49.338735 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea595af-85db-443b-869d-a87dab491616 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:49.341125 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9ea595af-85db-443b-869d-a87dab491616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:49.341906 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa701682-8173-492f-a9ea-7003cb2d86e7 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:49.362287 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 915/1819] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:49.367898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb1783-7a90-4be8-b398-8db2f1e101b2 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:49.368186 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb1783-7a90-4be8-b398-8db2f1e101b2 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:49.368534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb1783-7a90-4be8-b398-8db2f1e101b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:49.407455 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f5cb1783-7a90-4be8-b398-8db2f1e101b2 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:49.408825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f5cb1783-7a90-4be8-b398-8db2f1e101b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:49.422272 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 916/1820] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:49.423201 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb1783-7a90-4be8-b398-8db2f1e101b2 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:49.425802 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f5cb1783-7a90-4be8-b398-8db2f1e101b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:49.432891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea595af-85db-443b-869d-a87dab491616 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:49.438486 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb1783-7a90-4be8-b398-8db2f1e101b2 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:49.439527 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80dc34d-61b9-40b5-8c54-5ee2e8de9f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:49.440525 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dc34d-61b9-40b5-8c54-5ee2e8de9f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:49.440909 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dc34d-61b9-40b5-8c54-5ee2e8de9f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:49.441378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dc34d-61b9-40b5-8c54-5ee2e8de9f0d admin admin] PATH_INFO: `/v3/projects/c62ad09cb7c740f8a34086c0e2d43b14` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:49.442688 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80dc34d-61b9-40b5-8c54-5ee2e8de9f0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c62ad09cb7c740f8a34086c0e2d43b14)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:49.443717 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf4c9f-fc55-4031-8c18-cfd19cf5e706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:49.448016 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf4c9f-fc55-4031-8c18-cfd19cf5e706 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:49.448016 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf4c9f-fc55-4031-8c18-cfd19cf5e706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:49.448263 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80dc34d-61b9-40b5-8c54-5ee2e8de9f0d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:49.448341 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf4c9f-fc55-4031-8c18-cfd19cf5e706 admin admin] PATH_INFO: `/v3/projects/228e7e2767064c64a42163fa9ac56983/users/c79981f74bba444495eb23ab9ea0c091/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:49.464738 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf4c9f-fc55-4031-8c18-cfd19cf5e706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=228e7e2767064c64a42163fa9ac56983, user_id=c79981f74bba444495eb23ab9ea0c091, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:49.467809 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf4c9f-fc55-4031-8c18-cfd19cf5e706 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:49.569557 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 917/1821] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:49 2022] PUT /identity/v3/projects/228e7e2767064c64a42163fa9ac56983/users/c79981f74bba444495eb23ab9ea0c091/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:49.569557 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a17804-ae5a-46cd-84cd-dd1c6f3204d1 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:49.569557 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a17804-ae5a-46cd-84cd-dd1c6f3204d1 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:49.569557 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a17804-ae5a-46cd-84cd-dd1c6f3204d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:49.585461 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-22a17804-ae5a-46cd-84cd-dd1c6f3204d1 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:49.586748 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-22a17804-ae5a-46cd-84cd-dd1c6f3204d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:49.599299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-f80dc34d-61b9-40b5-8c54-5ee2e8de9f0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c62ad09cb7c740f8a34086c0e2d43b14', 'request_id': 'req-f80dc34d-61b9-40b5-8c54-5ee2e8de9f0d'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:49.606364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-f80dc34d-61b9-40b5-8c54-5ee2e8de9f0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c62ad09cb7c740f8a34086c0e2d43b14', 'request_id': 'req-f80dc34d-61b9-40b5-8c54-5ee2e8de9f0d'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:49.657756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 918/1822] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:49.657756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2c0a6-2d60-488d-a222-1a93da05e4ad None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:49.657756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2c0a6-2d60-488d-a222-1a93da05e4ad None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:49.657756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2c0a6-2d60-488d-a222-1a93da05e4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:49.665506 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-f80dc34d-61b9-40b5-8c54-5ee2e8de9f0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c62ad09cb7c740f8a34086c0e2d43b14', 'request_id': 'req-f80dc34d-61b9-40b5-8c54-5ee2e8de9f0d'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:49.678766 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-f80dc34d-61b9-40b5-8c54-5ee2e8de9f0d admin admin] The token cache is being invalidate because project c62ad09cb7c740f8a34086c0e2d43b14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:28:49.679281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-f80dc34d-61b9-40b5-8c54-5ee2e8de9f0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:49.680055 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-f80dc34d-61b9-40b5-8c54-5ee2e8de9f0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:49.686965 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 905/1823] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:28:49 2022] DELETE /identity/v3/projects/c62ad09cb7c740f8a34086c0e2d43b14 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:49.686965 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80dc34d-61b9-40b5-8c54-5ee2e8de9f0d admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:49.687186 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-84f2c0a6-2d60-488d-a222-1a93da05e4ad None None] MFA Rules not processed for user `c79981f74bba444495eb23ab9ea0c091`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:49.687264 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f80dc34d-61b9-40b5-8c54-5ee2e8de9f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:49.687366 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-84f2c0a6-2d60-488d-a222-1a93da05e4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:49.702696 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80dc34d-61b9-40b5-8c54-5ee2e8de9f0d admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:49.707767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f73c7-6613-4166-9aeb-1756bf03e35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:49.708507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f73c7-6613-4166-9aeb-1756bf03e35e admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:49.708898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f73c7-6613-4166-9aeb-1756bf03e35e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:49.709247 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f73c7-6613-4166-9aeb-1756bf03e35e admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:49.710045 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f73c7-6613-4166-9aeb-1756bf03e35e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:49.710445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f73c7-6613-4166-9aeb-1756bf03e35e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:49.713028 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f73c7-6613-4166-9aeb-1756bf03e35e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:49.748869 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 906/1824] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:49.750364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75030f25-290b-49c1-a124-f9d10a400d68 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:49.750763 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75030f25-290b-49c1-a124-f9d10a400d68 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:49.751148 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75030f25-290b-49c1-a124-f9d10a400d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:49.764234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 919/1825] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:49.764901 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2c0a6-2d60-488d-a222-1a93da05e4ad None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:49.773892 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-75030f25-290b-49c1-a124-f9d10a400d68 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:49.775888 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-75030f25-290b-49c1-a124-f9d10a400d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:49.780150 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2c0a6-2d60-488d-a222-1a93da05e4ad None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:49.785177 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5188d87-c33b-4978-837f-1a67d7d2375b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:49.785929 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 907/1826] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:49.787375 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5188d87-c33b-4978-837f-1a67d7d2375b admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:49.787375 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5188d87-c33b-4978-837f-1a67d7d2375b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:49.787375 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5188d87-c33b-4978-837f-1a67d7d2375b admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:49.787375 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5188d87-c33b-4978-837f-1a67d7d2375b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:49.789266 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5188d87-c33b-4978-837f-1a67d7d2375b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:49.792318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75030f25-290b-49c1-a124-f9d10a400d68 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:49.796532 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-75030f25-290b-49c1-a124-f9d10a400d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:49.811004 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75030f25-290b-49c1-a124-f9d10a400d68 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:49.815874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf8210-24a3-4332-8541-5c060c000ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:49.816511 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf8210-24a3-4332-8541-5c060c000ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:49.816794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf8210-24a3-4332-8541-5c060c000ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:49.817182 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf8210-24a3-4332-8541-5c060c000ac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:49.817884 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf8210-24a3-4332-8541-5c060c000ac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:49.820202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf8210-24a3-4332-8541-5c060c000ac9 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:49.924143 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 920/1827] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:49 2022] POST /identity/v3/projects => generated 401 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:49.924143 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49071da-e7ac-40b6-83a6-291e108853fb None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:49.924143 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49071da-e7ac-40b6-83a6-291e108853fb None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:49.924143 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49071da-e7ac-40b6-83a6-291e108853fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:49.941638 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 908/1828] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:49 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:49.941638 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf8210-24a3-4332-8541-5c060c000ac9 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:49.942321 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-a49071da-e7ac-40b6-83a6-291e108853fb None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:49.944132 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a49071da-e7ac-40b6-83a6-291e108853fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:50.001356 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf8210-24a3-4332-8541-5c060c000ac9 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:50.006560 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 921/1829] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:50.006674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063fa4a-abcb-4197-a588-4eed91db5fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:50.007459 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063fa4a-abcb-4197-a588-4eed91db5fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:50.007744 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063fa4a-abcb-4197-a588-4eed91db5fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:50.008066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063fa4a-abcb-4197-a588-4eed91db5fa0 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:50.008481 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49071da-e7ac-40b6-83a6-291e108853fb None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:50.009261 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063fa4a-abcb-4197-a588-4eed91db5fa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:50.011576 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063fa4a-abcb-4197-a588-4eed91db5fa0 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:50.018345 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:50.026710 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49071da-e7ac-40b6-83a6-291e108853fb None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:50.031655 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d665957-938d-489f-a8cc-72f5b673ffce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:50.032338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d665957-938d-489f-a8cc-72f5b673ffce admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:50.032643 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d665957-938d-489f-a8cc-72f5b673ffce admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:50.032915 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d665957-938d-489f-a8cc-72f5b673ffce admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:50.033616 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d665957-938d-489f-a8cc-72f5b673ffce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:50.036269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d665957-938d-489f-a8cc-72f5b673ffce admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:50.102251 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 909/1830] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:49 2022] POST /identity/v3/users => generated 301 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:50.103749 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063fa4a-abcb-4197-a588-4eed91db5fa0 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:50.105835 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4063fa4a-abcb-4197-a588-4eed91db5fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:50.117522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063fa4a-abcb-4197-a588-4eed91db5fa0 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:50.122623 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbc38e-93b5-4f10-84bb-6bcd5ab1f8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:50.123482 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbc38e-93b5-4f10-84bb-6bcd5ab1f8f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:50.129842 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbc38e-93b5-4f10-84bb-6bcd5ab1f8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:50.129842 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbc38e-93b5-4f10-84bb-6bcd5ab1f8f0 admin admin] PATH_INFO: `/v3/projects/9d48e570353a412090d4f06d8d25db93` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:50.129842 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addbc38e-93b5-4f10-84bb-6bcd5ab1f8f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d48e570353a412090d4f06d8d25db93)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:50.130138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 922/1831] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:50 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:50.130138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d665957-938d-489f-a8cc-72f5b673ffce admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:50.130299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addbc38e-93b5-4f10-84bb-6bcd5ab1f8f0 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:50.136120 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d665957-938d-489f-a8cc-72f5b673ffce admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:50.141467 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47af38-d9b0-4968-b955-f44070b9e0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:50.142142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47af38-d9b0-4968-b955-f44070b9e0dc admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:50.142658 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47af38-d9b0-4968-b955-f44070b9e0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:50.142747 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47af38-d9b0-4968-b955-f44070b9e0dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:50.143426 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47af38-d9b0-4968-b955-f44070b9e0dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:50.143739 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47af38-d9b0-4968-b955-f44070b9e0dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:50.145868 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47af38-d9b0-4968-b955-f44070b9e0dc admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:50.163372 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 923/1832] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:50.163372 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47af38-d9b0-4968-b955-f44070b9e0dc admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:50.172021 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47af38-d9b0-4968-b955-f44070b9e0dc admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:50.176792 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002248d-7308-4eb6-bc61-a0a74360b789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:50.177451 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002248d-7308-4eb6-bc61-a0a74360b789 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:50.178796 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002248d-7308-4eb6-bc61-a0a74360b789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:50.178796 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002248d-7308-4eb6-bc61-a0a74360b789 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:50.178796 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002248d-7308-4eb6-bc61-a0a74360b789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:50.180474 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002248d-7308-4eb6-bc61-a0a74360b789 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:50.190660 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 924/1833] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:50.192203 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002248d-7308-4eb6-bc61-a0a74360b789 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:50.201544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002248d-7308-4eb6-bc61-a0a74360b789 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:50.213951 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83812bea-69d7-4ab7-953e-a9ac63ee72af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:50.214591 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83812bea-69d7-4ab7-953e-a9ac63ee72af admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:50.214919 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83812bea-69d7-4ab7-953e-a9ac63ee72af admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:50.215210 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83812bea-69d7-4ab7-953e-a9ac63ee72af admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:50.215941 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83812bea-69d7-4ab7-953e-a9ac63ee72af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:50.217652 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83812bea-69d7-4ab7-953e-a9ac63ee72af admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:50.238792 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 925/1834] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:50.239835 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83812bea-69d7-4ab7-953e-a9ac63ee72af admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:50.248911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-addbc38e-93b5-4f10-84bb-6bcd5ab1f8f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d48e570353a412090d4f06d8d25db93', 'request_id': 'req-addbc38e-93b5-4f10-84bb-6bcd5ab1f8f0'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:50.254180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83812bea-69d7-4ab7-953e-a9ac63ee72af admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:50.259238 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-addbc38e-93b5-4f10-84bb-6bcd5ab1f8f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d48e570353a412090d4f06d8d25db93', 'request_id': 'req-addbc38e-93b5-4f10-84bb-6bcd5ab1f8f0'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:50.325212 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb7ca9-1b0b-41db-8dc9-dd0926961dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:50.325212 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb7ca9-1b0b-41db-8dc9-dd0926961dfc admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:50.325617 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb7ca9-1b0b-41db-8dc9-dd0926961dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:50.325867 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb7ca9-1b0b-41db-8dc9-dd0926961dfc admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:50.326595 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb7ca9-1b0b-41db-8dc9-dd0926961dfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:50.328633 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb7ca9-1b0b-41db-8dc9-dd0926961dfc admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:50.331011 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-addbc38e-93b5-4f10-84bb-6bcd5ab1f8f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d48e570353a412090d4f06d8d25db93', 'request_id': 'req-addbc38e-93b5-4f10-84bb-6bcd5ab1f8f0'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:50.345800 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-addbc38e-93b5-4f10-84bb-6bcd5ab1f8f0 admin admin] The token cache is being invalidate because project 9d48e570353a412090d4f06d8d25db93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:28:50.346517 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-addbc38e-93b5-4f10-84bb-6bcd5ab1f8f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:50.347014 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-addbc38e-93b5-4f10-84bb-6bcd5ab1f8f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:50.349088 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 910/1835] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:28:50 2022] DELETE /identity/v3/projects/9d48e570353a412090d4f06d8d25db93 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:50.355495 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbc38e-93b5-4f10-84bb-6bcd5ab1f8f0 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:50.357157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-addbc38e-93b5-4f10-84bb-6bcd5ab1f8f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:50.370402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbc38e-93b5-4f10-84bb-6bcd5ab1f8f0 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:50.376172 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4704aec-52ba-41dc-af8a-6494800f350d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:50.376882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4704aec-52ba-41dc-af8a-6494800f350d admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:50.377169 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4704aec-52ba-41dc-af8a-6494800f350d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:50.377445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4704aec-52ba-41dc-af8a-6494800f350d admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:50.378474 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4704aec-52ba-41dc-af8a-6494800f350d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:50.382854 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4704aec-52ba-41dc-af8a-6494800f350d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:50.391300 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 911/1836] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:50.392210 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4704aec-52ba-41dc-af8a-6494800f350d admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:50.393863 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e4704aec-52ba-41dc-af8a-6494800f350d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:50.406698 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4704aec-52ba-41dc-af8a-6494800f350d admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:50.411300 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b9943-7774-45d3-8cf3-c772a909b7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:50.412187 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b9943-7774-45d3-8cf3-c772a909b7aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:50.412580 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b9943-7774-45d3-8cf3-c772a909b7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:50.412858 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b9943-7774-45d3-8cf3-c772a909b7aa admin admin] PATH_INFO: `/v3/projects/4e8ba748835647059ee5fcd41f1527fa/users/6d2eb14191e0484e8735c2a967ebbf75/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:50.429958 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b9943-7774-45d3-8cf3-c772a909b7aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e8ba748835647059ee5fcd41f1527fa, user_id=6d2eb14191e0484e8735c2a967ebbf75, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:50.433379 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b9943-7774-45d3-8cf3-c772a909b7aa admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:50.439789 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=79,keystone:INSERT=5,keystone:DELETE=16 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:50.440317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 926/1837] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:50 2022] POST /identity/v3/projects => generated 407 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:50.441659 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df7284-97c8-4d28-84cb-66f43d57ad49 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:50.442176 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df7284-97c8-4d28-84cb-66f43d57ad49 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:50.442469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df7284-97c8-4d28-84cb-66f43d57ad49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:50.460898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-04df7284-97c8-4d28-84cb-66f43d57ad49 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:50.462095 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-04df7284-97c8-4d28-84cb-66f43d57ad49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:50.525813 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 912/1838] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:50 2022] PUT /identity/v3/projects/4e8ba748835647059ee5fcd41f1527fa/users/6d2eb14191e0484e8735c2a967ebbf75/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:50.527060 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b9943-7774-45d3-8cf3-c772a909b7aa admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:50.531597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 927/1839] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:50.532431 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df7284-97c8-4d28-84cb-66f43d57ad49 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:50.534320 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-04df7284-97c8-4d28-84cb-66f43d57ad49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:50.546809 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df7284-97c8-4d28-84cb-66f43d57ad49 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:50.605658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b9943-7774-45d3-8cf3-c772a909b7aa admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:50.612038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ecf83-6a75-4d63-b8fc-4f0dff62bab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:50.612980 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56113e36-04ce-445f-bd65-1567fecc02a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:50.613327 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56113e36-04ce-445f-bd65-1567fecc02a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:50.613614 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56113e36-04ce-445f-bd65-1567fecc02a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:50.613890 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56113e36-04ce-445f-bd65-1567fecc02a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:50.614602 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ecf83-6a75-4d63-b8fc-4f0dff62bab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:50.614711 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56113e36-04ce-445f-bd65-1567fecc02a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:50.615225 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ecf83-6a75-4d63-b8fc-4f0dff62bab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:50.615483 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ecf83-6a75-4d63-b8fc-4f0dff62bab1 admin admin] PATH_INFO: `/v3/projects/b931c39a7eae4773bd48cc144685e0ae/users/b117d7caa1e4471b858be41046c71ef8/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:50.616757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56113e36-04ce-445f-bd65-1567fecc02a7 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:50.633034 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ecf83-6a75-4d63-b8fc-4f0dff62bab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b931c39a7eae4773bd48cc144685e0ae, user_id=b117d7caa1e4471b858be41046c71ef8, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:50.636070 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ecf83-6a75-4d63-b8fc-4f0dff62bab1 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:50.740054 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 928/1840] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:50 2022] POST /identity/v3/users => generated 304 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:50.741036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56113e36-04ce-445f-bd65-1567fecc02a7 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:50.754303 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56113e36-04ce-445f-bd65-1567fecc02a7 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:50.759595 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 913/1841] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:50 2022] PUT /identity/v3/projects/b931c39a7eae4773bd48cc144685e0ae/users/b117d7caa1e4471b858be41046c71ef8/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:50.761177 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b3ec4-4aa6-4e44-9ae6-61d10b98d5a8 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:50.761462 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b3ec4-4aa6-4e44-9ae6-61d10b98d5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:50.761738 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b3ec4-4aa6-4e44-9ae6-61d10b98d5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:50.808247 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-520b3ec4-4aa6-4e44-9ae6-61d10b98d5a8 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:50.809514 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-520b3ec4-4aa6-4e44-9ae6-61d10b98d5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:50.850300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2b006-4c36-43af-b6f1-6ac7a6aa6eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:50.851715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2b006-4c36-43af-b6f1-6ac7a6aa6eaf admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:50.852256 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2b006-4c36-43af-b6f1-6ac7a6aa6eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:50.852949 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2b006-4c36-43af-b6f1-6ac7a6aa6eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:50.854954 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2b006-4c36-43af-b6f1-6ac7a6aa6eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:50.856745 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2b006-4c36-43af-b6f1-6ac7a6aa6eaf admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:50.871008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 929/1842] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:50.871008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2b006-4c36-43af-b6f1-6ac7a6aa6eaf admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:50.881500 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2b006-4c36-43af-b6f1-6ac7a6aa6eaf admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:50.883416 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 914/1843] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:50.885459 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c532911-62fd-439b-b956-b6c437b0dbc4 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:50.885751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c532911-62fd-439b-b956-b6c437b0dbc4 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:50.886022 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c532911-62fd-439b-b956-b6c437b0dbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:50.889621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203030b-0d44-4050-8fb4-e603d16e0f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:50.890324 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203030b-0d44-4050-8fb4-e603d16e0f77 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:50.893955 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203030b-0d44-4050-8fb4-e603d16e0f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:50.893955 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203030b-0d44-4050-8fb4-e603d16e0f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:50.893955 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203030b-0d44-4050-8fb4-e603d16e0f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:50.893955 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203030b-0d44-4050-8fb4-e603d16e0f77 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:50.909374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 930/1844] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:50.909374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203030b-0d44-4050-8fb4-e603d16e0f77 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:50.919705 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203030b-0d44-4050-8fb4-e603d16e0f77 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:50.920358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-8c532911-62fd-439b-b956-b6c437b0dbc4 None None] MFA Rules not processed for user `b117d7caa1e4471b858be41046c71ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:50.921540 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8c532911-62fd-439b-b956-b6c437b0dbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:50.925654 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb3ce0-b957-4659-8481-d6c4592109bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:50.926575 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb3ce0-b957-4659-8481-d6c4592109bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:50.926851 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb3ce0-b957-4659-8481-d6c4592109bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:50.927122 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb3ce0-b957-4659-8481-d6c4592109bf admin admin] PATH_INFO: `/v3/projects/4e8ba748835647059ee5fcd41f1527fa/users/6d2eb14191e0484e8735c2a967ebbf75/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:50.929100 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb3ce0-b957-4659-8481-d6c4592109bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e8ba748835647059ee5fcd41f1527fa, user_id=6d2eb14191e0484e8735c2a967ebbf75, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:50.932843 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb3ce0-b957-4659-8481-d6c4592109bf admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:50.946157 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 931/1845] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:50 2022] PUT /identity/v3/projects/4e8ba748835647059ee5fcd41f1527fa/users/6d2eb14191e0484e8735c2a967ebbf75/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:50.953234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb3ce0-b957-4659-8481-d6c4592109bf admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:50.998406 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 915/1846] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:50.998406 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c532911-62fd-439b-b956-b6c437b0dbc4 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:51.012614 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c532911-62fd-439b-b956-b6c437b0dbc4 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:51.017795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79a683-0a03-4682-bc49-e26c075e3de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:51.018755 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79a683-0a03-4682-bc49-e26c075e3de5 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:51.018867 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79a683-0a03-4682-bc49-e26c075e3de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:51.019091 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79a683-0a03-4682-bc49-e26c075e3de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:51.020049 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79a683-0a03-4682-bc49-e26c075e3de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:51.021698 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79a683-0a03-4682-bc49-e26c075e3de5 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:51.022341 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb3ce0-b957-4659-8481-d6c4592109bf admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:51.028308 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b380a-cf08-4f82-a97e-632f2f5043b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:51.028990 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b380a-cf08-4f82-a97e-632f2f5043b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:51.029273 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b380a-cf08-4f82-a97e-632f2f5043b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:51.029555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b380a-cf08-4f82-a97e-632f2f5043b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:51.030456 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b380a-cf08-4f82-a97e-632f2f5043b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:51.030763 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b380a-cf08-4f82-a97e-632f2f5043b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:51.032525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b380a-cf08-4f82-a97e-632f2f5043b9 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:51.038829 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 916/1847] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:51.038829 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdcb68-fe4e-4909-8223-bbb73f30a882 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:51.038829 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdcb68-fe4e-4909-8223-bbb73f30a882 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:51.038829 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdcb68-fe4e-4909-8223-bbb73f30a882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:51.050647 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 932/1848] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:51.050647 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b380a-cf08-4f82-a97e-632f2f5043b9 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:51.061557 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b380a-cf08-4f82-a97e-632f2f5043b9 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:51.066499 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbc55c-f58d-4905-b4f0-74c9309b8d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:51.067230 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbc55c-f58d-4905-b4f0-74c9309b8d4d admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:51.067515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbc55c-f58d-4905-b4f0-74c9309b8d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:51.067792 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbc55c-f58d-4905-b4f0-74c9309b8d4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:51.068493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbbc55c-f58d-4905-b4f0-74c9309b8d4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:51.070463 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbbc55c-f58d-4905-b4f0-74c9309b8d4d admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:51.071226 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d4bdcb68-fe4e-4909-8223-bbb73f30a882 None None] MFA Rules not processed for user `6d2eb14191e0484e8735c2a967ebbf75`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:51.074112 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d4bdcb68-fe4e-4909-8223-bbb73f30a882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:51.143889 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 933/1849] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:51 2022] POST /identity/v3/projects => generated 401 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:51.144771 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbc55c-f58d-4905-b4f0-74c9309b8d4d admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:51.154609 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 917/1850] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:51.155490 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdcb68-fe4e-4909-8223-bbb73f30a882 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:51.174029 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdcb68-fe4e-4909-8223-bbb73f30a882 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:51.240430 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbc55c-f58d-4905-b4f0-74c9309b8d4d admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:51.241248 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a770159-4612-4432-9615-eaecaa112c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:51.241842 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a770159-4612-4432-9615-eaecaa112c51 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:51.242153 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a770159-4612-4432-9615-eaecaa112c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:51.242577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a770159-4612-4432-9615-eaecaa112c51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:51.243427 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a770159-4612-4432-9615-eaecaa112c51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:51.246195 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a770159-4612-4432-9615-eaecaa112c51 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:51.247817 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae106f2-0693-43bb-b629-94315753ffcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:51.248718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae106f2-0693-43bb-b629-94315753ffcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:51.249002 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae106f2-0693-43bb-b629-94315753ffcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:51.249286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae106f2-0693-43bb-b629-94315753ffcb admin admin] PATH_INFO: `/v3/projects/ce592c24d392483293dc6a9f100e568c/users/13545e448c8b4ac1b31b1636f0cd6d45/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:51.265638 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae106f2-0693-43bb-b629-94315753ffcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce592c24d392483293dc6a9f100e568c, user_id=13545e448c8b4ac1b31b1636f0cd6d45, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:51.268331 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae106f2-0693-43bb-b629-94315753ffcb admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:51.338234 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 918/1851] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:51 2022] POST /identity/v3/projects => generated 373 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:51.340199 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a770159-4612-4432-9615-eaecaa112c51 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:51.354878 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:51.381821 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 934/1852] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:51 2022] PUT /identity/v3/projects/ce592c24d392483293dc6a9f100e568c/users/13545e448c8b4ac1b31b1636f0cd6d45/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:51.385130 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae106f2-0693-43bb-b629-94315753ffcb admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:51.388107 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-eae106f2-0693-43bb-b629-94315753ffcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:51.441274 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a770159-4612-4432-9615-eaecaa112c51 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:51.482925 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae106f2-0693-43bb-b629-94315753ffcb admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:51.487294 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcf9b6-3bef-496e-8ee2-6809cb34217b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:51.488517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcf9b6-3bef-496e-8ee2-6809cb34217b service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:51.488517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcf9b6-3bef-496e-8ee2-6809cb34217b service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:51.488517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcf9b6-3bef-496e-8ee2-6809cb34217b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:51.513525 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41b22a-0835-4b83-9976-d3535ead53c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:51.515402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41b22a-0835-4b83-9976-d3535ead53c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:51.515402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41b22a-0835-4b83-9976-d3535ead53c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:51.515402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41b22a-0835-4b83-9976-d3535ead53c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:51.516204 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41b22a-0835-4b83-9976-d3535ead53c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:51.518387 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41b22a-0835-4b83-9976-d3535ead53c0 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:51.555193 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dcf9b6-3bef-496e-8ee2-6809cb34217b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:51.561384 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dcf9b6-3bef-496e-8ee2-6809cb34217b service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:51.567362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 935/1853] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:51 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:51.568097 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcf9b6-3bef-496e-8ee2-6809cb34217b service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:51.578988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcf9b6-3bef-496e-8ee2-6809cb34217b service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:51.583686 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e6484-d444-4f79-9cfc-bcd4d95c0d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:51.584349 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e6484-d444-4f79-9cfc-bcd4d95c0d19 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:51.584635 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e6484-d444-4f79-9cfc-bcd4d95c0d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:51.584917 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e6484-d444-4f79-9cfc-bcd4d95c0d19 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:51.585615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e6484-d444-4f79-9cfc-bcd4d95c0d19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:51.587655 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e6484-d444-4f79-9cfc-bcd4d95c0d19 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:52.189441 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 919/1854] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:51 2022] POST /identity/v3/users => generated 307 bytes in 848 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:52.189575 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 936/1855] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:51 2022] POST /identity/v3/users => generated 287 bytes in 620 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:52.189575 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e6484-d444-4f79-9cfc-bcd4d95c0d19 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:52.189748 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a165a-f5bd-49b3-a639-4b68ea18a190 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:52.189818 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a165a-f5bd-49b3-a639-4b68ea18a190 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:52.190148 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a165a-f5bd-49b3-a639-4b68ea18a190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:52.203058 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e6484-d444-4f79-9cfc-bcd4d95c0d19 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:52.209431 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f7ba9-7eca-4f34-86e4-3d881d1f31d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:52.210178 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f7ba9-7eca-4f34-86e4-3d881d1f31d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:52.210488 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f7ba9-7eca-4f34-86e4-3d881d1f31d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:52.210806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f7ba9-7eca-4f34-86e4-3d881d1f31d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:52.211679 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f7ba9-7eca-4f34-86e4-3d881d1f31d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:52.213968 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f7ba9-7eca-4f34-86e4-3d881d1f31d1 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:52.232457 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 937/1856] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:52.232457 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f7ba9-7eca-4f34-86e4-3d881d1f31d1 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:52.244532 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-ae8a165a-f5bd-49b3-a639-4b68ea18a190 None None] MFA Rules not processed for user `13545e448c8b4ac1b31b1636f0cd6d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:52.245167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f7ba9-7eca-4f34-86e4-3d881d1f31d1 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:52.246581 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ae8a165a-f5bd-49b3-a639-4b68ea18a190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:52.251503 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826e563-c9b8-4ffb-b271-c1d9004eca67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:52.252493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826e563-c9b8-4ffb-b271-c1d9004eca67 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:52.253143 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826e563-c9b8-4ffb-b271-c1d9004eca67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:52.253602 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826e563-c9b8-4ffb-b271-c1d9004eca67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:52.254600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826e563-c9b8-4ffb-b271-c1d9004eca67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:52.256473 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826e563-c9b8-4ffb-b271-c1d9004eca67 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:52.273806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 938/1857] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:52.273806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826e563-c9b8-4ffb-b271-c1d9004eca67 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:52.287674 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826e563-c9b8-4ffb-b271-c1d9004eca67 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:52.299025 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3b209-8592-4365-9318-19593634d894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:52.300056 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3b209-8592-4365-9318-19593634d894 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:52.300569 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3b209-8592-4365-9318-19593634d894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:52.300971 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3b209-8592-4365-9318-19593634d894 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:52.301816 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3b209-8592-4365-9318-19593634d894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:52.303574 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3b209-8592-4365-9318-19593634d894 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:52.319821 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 939/1858] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:52.321057 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3b209-8592-4365-9318-19593634d894 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:52.333698 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3b209-8592-4365-9318-19593634d894 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:52.343025 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 920/1859] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:52 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:52.343214 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c665dd-3298-4733-89ab-74c57af4b0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:52.343346 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a165a-f5bd-49b3-a639-4b68ea18a190 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:52.343437 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c665dd-3298-4733-89ab-74c57af4b0c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:52.343437 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c665dd-3298-4733-89ab-74c57af4b0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:52.343437 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c665dd-3298-4733-89ab-74c57af4b0c6 admin admin] PATH_INFO: `/v3/projects/3d86f0a044984dfd816554c526f45365/users/8113d4413a02422ba6c8a2edb06a0d05/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:52.360980 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a165a-f5bd-49b3-a639-4b68ea18a190 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:52.363732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c665dd-3298-4733-89ab-74c57af4b0c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d86f0a044984dfd816554c526f45365, user_id=8113d4413a02422ba6c8a2edb06a0d05, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:52.366790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c665dd-3298-4733-89ab-74c57af4b0c6 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:52.369416 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc8ef6-5463-4dfa-8550-20b7a7557b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:52.371372 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc8ef6-5463-4dfa-8550-20b7a7557b41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:52.371839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc8ef6-5463-4dfa-8550-20b7a7557b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:52.372279 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc8ef6-5463-4dfa-8550-20b7a7557b41 admin admin] PATH_INFO: `/v3/projects/cd43d767198a496cabe29b804f3c296d/users/06ea94a9eef94b3db6e5e8bda4f77d63/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:52.390547 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc8ef6-5463-4dfa-8550-20b7a7557b41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd43d767198a496cabe29b804f3c296d, user_id=06ea94a9eef94b3db6e5e8bda4f77d63, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:52.393962 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc8ef6-5463-4dfa-8550-20b7a7557b41 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:52.733444 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 921/1860] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:52 2022] PUT /identity/v3/projects/cd43d767198a496cabe29b804f3c296d/users/06ea94a9eef94b3db6e5e8bda4f77d63/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:52.734837 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc8ef6-5463-4dfa-8550-20b7a7557b41 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:52.738030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 940/1861] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:52 2022] PUT /identity/v3/projects/3d86f0a044984dfd816554c526f45365/users/8113d4413a02422ba6c8a2edb06a0d05/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:52.740043 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:52.742808 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c665dd-3298-4733-89ab-74c57af4b0c6 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:52.810649 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc8ef6-5463-4dfa-8550-20b7a7557b41 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:52.812152 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c665dd-3298-4733-89ab-74c57af4b0c6 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:52.815299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaffb71-1730-490b-88f2-d8ef0cf0449b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:52.815958 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaffb71-1730-490b-88f2-d8ef0cf0449b admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:52.816245 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaffb71-1730-490b-88f2-d8ef0cf0449b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:52.816523 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaffb71-1730-490b-88f2-d8ef0cf0449b admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:52.816717 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa17e7-f207-47f9-ae50-d64e7d0f9c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:52.817242 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaffb71-1730-490b-88f2-d8ef0cf0449b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:52.817379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa17e7-f207-47f9-ae50-d64e7d0f9c12 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:52.817670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa17e7-f207-47f9-ae50-d64e7d0f9c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:52.817949 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa17e7-f207-47f9-ae50-d64e7d0f9c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:52.818795 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa17e7-f207-47f9-ae50-d64e7d0f9c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:52.819250 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaffb71-1730-490b-88f2-d8ef0cf0449b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:52.820375 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa17e7-f207-47f9-ae50-d64e7d0f9c12 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:52.830519 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 941/1862] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:52.831783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e9868-1761-4b3d-902e-6aed8eeff66b None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:52.832077 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e9868-1761-4b3d-902e-6aed8eeff66b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:52.832356 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e9868-1761-4b3d-902e-6aed8eeff66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:52.863596 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-271e9868-1761-4b3d-902e-6aed8eeff66b None None] MFA Rules not processed for user `06ea94a9eef94b3db6e5e8bda4f77d63`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:52.863596 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-271e9868-1761-4b3d-902e-6aed8eeff66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:52.920529 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 922/1863] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:52 2022] POST /identity/v3/projects => generated 409 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:52.920529 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaffb71-1730-490b-88f2-d8ef0cf0449b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:52.937481 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 942/1864] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:52.937481 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e9868-1761-4b3d-902e-6aed8eeff66b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:52.947776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e9868-1761-4b3d-902e-6aed8eeff66b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:52.991071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaffb71-1730-490b-88f2-d8ef0cf0449b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:52.995839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbabd2-cde8-4a88-ae48-12c218f24724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:52.997430 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbabd2-cde8-4a88-ae48-12c218f24724 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:52.997723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbabd2-cde8-4a88-ae48-12c218f24724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:52.998034 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbabd2-cde8-4a88-ae48-12c218f24724 admin admin] PATH_INFO: `/v3/projects/3d86f0a044984dfd816554c526f45365/users/8113d4413a02422ba6c8a2edb06a0d05/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:53.000058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbabd2-cde8-4a88-ae48-12c218f24724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d86f0a044984dfd816554c526f45365, user_id=8113d4413a02422ba6c8a2edb06a0d05, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:53.003287 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbabd2-cde8-4a88-ae48-12c218f24724 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:53.011445 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0bf37-c19a-485a-b79d-415178f47787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:53.012400 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0bf37-c19a-485a-b79d-415178f47787 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:53.012853 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0bf37-c19a-485a-b79d-415178f47787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:53.013403 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0bf37-c19a-485a-b79d-415178f47787 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:53.014722 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0bf37-c19a-485a-b79d-415178f47787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:53.016983 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0bf37-c19a-485a-b79d-415178f47787 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:53.023492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 923/1865] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:52 2022] PUT /identity/v3/projects/3d86f0a044984dfd816554c526f45365/users/8113d4413a02422ba6c8a2edb06a0d05/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:53.025004 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbabd2-cde8-4a88-ae48-12c218f24724 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:53.087595 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbabd2-cde8-4a88-ae48-12c218f24724 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:53.092810 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6d7a1-fbfb-4238-acd2-c94b998d0f2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:53.093664 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6d7a1-fbfb-4238-acd2-c94b998d0f2c service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:53.094047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6d7a1-fbfb-4238-acd2-c94b998d0f2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:53.094509 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6d7a1-fbfb-4238-acd2-c94b998d0f2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:53.120268 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 943/1866] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:52 2022] POST /identity/v3/users => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:53.122007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f29a4a-bb08-48cd-b8f4-3c8a22729cdf None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:53.122614 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f29a4a-bb08-48cd-b8f4-3c8a22729cdf None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:53.123001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f29a4a-bb08-48cd-b8f4-3c8a22729cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:53.157864 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6d7a1-fbfb-4238-acd2-c94b998d0f2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:53.159346 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6d7a1-fbfb-4238-acd2-c94b998d0f2c service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:53.163333 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d6f29a4a-bb08-48cd-b8f4-3c8a22729cdf None None] MFA Rules not processed for user `8113d4413a02422ba6c8a2edb06a0d05`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:53.164717 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d6f29a4a-bb08-48cd-b8f4-3c8a22729cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:53.170071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 924/1867] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:53.171760 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6d7a1-fbfb-4238-acd2-c94b998d0f2c service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:53.246111 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6d7a1-fbfb-4238-acd2-c94b998d0f2c service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:53.255342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7688e5-e246-4d26-9758-c2c4acf8aaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:53.256031 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7688e5-e246-4d26-9758-c2c4acf8aaca admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:53.256299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7688e5-e246-4d26-9758-c2c4acf8aaca admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:53.256568 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7688e5-e246-4d26-9758-c2c4acf8aaca admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:53.257286 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7688e5-e246-4d26-9758-c2c4acf8aaca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:53.259533 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7688e5-e246-4d26-9758-c2c4acf8aaca admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:53.263073 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 944/1868] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:53 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:53.264497 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f29a4a-bb08-48cd-b8f4-3c8a22729cdf None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:53.275151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 925/1869] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:53.275151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7688e5-e246-4d26-9758-c2c4acf8aaca admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:53.292392 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f29a4a-bb08-48cd-b8f4-3c8a22729cdf None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:53.295118 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7688e5-e246-4d26-9758-c2c4acf8aaca admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:53.301675 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bff419-4133-4d67-8596-03540228e775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:53.302777 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bff419-4133-4d67-8596-03540228e775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:53.303127 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bff419-4133-4d67-8596-03540228e775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:53.303493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bff419-4133-4d67-8596-03540228e775 admin admin] PATH_INFO: `/v3/users/06ea94a9eef94b3db6e5e8bda4f77d63` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:53.307868 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bff419-4133-4d67-8596-03540228e775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06ea94a9eef94b3db6e5e8bda4f77d63)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:53.307868 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bff419-4133-4d67-8596-03540228e775 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:53.308314 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a919ed6-70d8-4b46-8fa0-fc58e99611cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:53.308314 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a919ed6-70d8-4b46-8fa0-fc58e99611cd service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:53.308314 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a919ed6-70d8-4b46-8fa0-fc58e99611cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:53.308566 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a919ed6-70d8-4b46-8fa0-fc58e99611cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:53.331355 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a919ed6-70d8-4b46-8fa0-fc58e99611cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:53.339567 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a919ed6-70d8-4b46-8fa0-fc58e99611cd service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:53.358495 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 926/1870] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:53 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:53.359761 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a919ed6-70d8-4b46-8fa0-fc58e99611cd service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:53.374461 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a919ed6-70d8-4b46-8fa0-fc58e99611cd service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:53.381980 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59752998-af35-4389-ba59-4d07879f85d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:53.389190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59752998-af35-4389-ba59-4d07879f85d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:53.389190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59752998-af35-4389-ba59-4d07879f85d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:53.389190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59752998-af35-4389-ba59-4d07879f85d7 admin admin] PATH_INFO: `/v3/projects/339322e7aa664e838c496bbbbeda8185/users/187b3caf204e49119b56aae5f41c70f5/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:53.404538 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59752998-af35-4389-ba59-4d07879f85d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=339322e7aa664e838c496bbbbeda8185, user_id=187b3caf204e49119b56aae5f41c70f5, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:53.407257 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59752998-af35-4389-ba59-4d07879f85d7 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:53.496789 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 927/1871] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:53 2022] PUT /identity/v3/projects/339322e7aa664e838c496bbbbeda8185/users/187b3caf204e49119b56aae5f41c70f5/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:53.502565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59752998-af35-4389-ba59-4d07879f85d7 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:53.574342 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b6bff419-4133-4d67-8596-03540228e775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06ea94a9eef94b3db6e5e8bda4f77d63'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:53.617959 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59752998-af35-4389-ba59-4d07879f85d7 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:53.623335 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72808ed7-25a2-49e6-a1ce-f9c57fdf9b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:53.624017 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72808ed7-25a2-49e6-a1ce-f9c57fdf9b61 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:53.624330 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72808ed7-25a2-49e6-a1ce-f9c57fdf9b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:53.624607 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72808ed7-25a2-49e6-a1ce-f9c57fdf9b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:53.625371 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72808ed7-25a2-49e6-a1ce-f9c57fdf9b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:53.627015 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72808ed7-25a2-49e6-a1ce-f9c57fdf9b61 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:53.638592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 928/1872] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:53.639452 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72808ed7-25a2-49e6-a1ce-f9c57fdf9b61 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:53.685180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b6bff419-4133-4d67-8596-03540228e775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06ea94a9eef94b3db6e5e8bda4f77d63'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:53.708050 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b6bff419-4133-4d67-8596-03540228e775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06ea94a9eef94b3db6e5e8bda4f77d63'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:53.724654 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b6bff419-4133-4d67-8596-03540228e775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06ea94a9eef94b3db6e5e8bda4f77d63'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:53.728463 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b6bff419-4133-4d67-8596-03540228e775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06ea94a9eef94b3db6e5e8bda4f77d63'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:53.731750 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72808ed7-25a2-49e6-a1ce-f9c57fdf9b61 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:53.736568 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f96c75-3d76-4ec1-bfcd-d4db742e4e89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:53.737275 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f96c75-3d76-4ec1-bfcd-d4db742e4e89 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:53.737628 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f96c75-3d76-4ec1-bfcd-d4db742e4e89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:53.737962 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f96c75-3d76-4ec1-bfcd-d4db742e4e89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:53.740634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-37f96c75-3d76-4ec1-bfcd-d4db742e4e89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:53.743647 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 945/1873] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:28:53 2022] DELETE /identity/v3/users/06ea94a9eef94b3db6e5e8bda4f77d63 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:53.748094 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bff419-4133-4d67-8596-03540228e775 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:53.753047 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b6bff419-4133-4d67-8596-03540228e775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:53.823055 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f96c75-3d76-4ec1-bfcd-d4db742e4e89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:53.825127 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f96c75-3d76-4ec1-bfcd-d4db742e4e89 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:53.842699 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bff419-4133-4d67-8596-03540228e775 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:53.845793 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 929/1874] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:53 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:53.846756 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f96c75-3d76-4ec1-bfcd-d4db742e4e89 service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:53.847529 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177bace-977a-484e-8e59-f641e7f031f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:53.848112 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-37f96c75-3d76-4ec1-bfcd-d4db742e4e89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:53.848493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177bace-977a-484e-8e59-f641e7f031f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:53.848752 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177bace-977a-484e-8e59-f641e7f031f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:53.849036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177bace-977a-484e-8e59-f641e7f031f6 admin admin] PATH_INFO: `/v3/projects/339322e7aa664e838c496bbbbeda8185/users/187b3caf204e49119b56aae5f41c70f5/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:53.851066 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177bace-977a-484e-8e59-f641e7f031f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=339322e7aa664e838c496bbbbeda8185, user_id=187b3caf204e49119b56aae5f41c70f5, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:53.854633 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177bace-977a-484e-8e59-f641e7f031f6 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:53.870248 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 946/1875] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:53 2022] PUT /identity/v3/projects/339322e7aa664e838c496bbbbeda8185/users/187b3caf204e49119b56aae5f41c70f5/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:53.871436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f96c75-3d76-4ec1-bfcd-d4db742e4e89 service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:53.871682 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503f984-9f52-4297-b96b-23452378005c None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:53.872250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503f984-9f52-4297-b96b-23452378005c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:53.872601 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503f984-9f52-4297-b96b-23452378005c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:53.897943 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-4503f984-9f52-4297-b96b-23452378005c None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:53.900903 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4503f984-9f52-4297-b96b-23452378005c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:53.976523 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c5f7c-a409-4684-9dcf-064bd42f6d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:53.977559 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c5f7c-a409-4684-9dcf-064bd42f6d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:53.978456 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c5f7c-a409-4684-9dcf-064bd42f6d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:53.978800 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c5f7c-a409-4684-9dcf-064bd42f6d7f admin admin] PATH_INFO: `/v3/users/c79981f74bba444495eb23ab9ea0c091` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:53.980341 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c5f7c-a409-4684-9dcf-064bd42f6d7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c79981f74bba444495eb23ab9ea0c091)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:53.982883 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c5f7c-a409-4684-9dcf-064bd42f6d7f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:54.009650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 947/1876] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:54.011909 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3533f-c227-423c-908a-d43c830962b6 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:54.012058 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3533f-c227-423c-908a-d43c830962b6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:54.012855 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3533f-c227-423c-908a-d43c830962b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:54.048898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-a9d3533f-c227-423c-908a-d43c830962b6 None None] MFA Rules not processed for user `187b3caf204e49119b56aae5f41c70f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:54.050209 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a9d3533f-c227-423c-908a-d43c830962b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:54.119742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 948/1877] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:54 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:54.120635 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3533f-c227-423c-908a-d43c830962b6 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:54.121919 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a9d3533f-c227-423c-908a-d43c830962b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:54.177426 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3533f-c227-423c-908a-d43c830962b6 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:54.181634 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1909beb-57c5-463d-b099-a3007d5c7a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:54.182299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1909beb-57c5-463d-b099-a3007d5c7a05 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:54.182579 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1909beb-57c5-463d-b099-a3007d5c7a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:54.182850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1909beb-57c5-463d-b099-a3007d5c7a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:54.191787 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1909beb-57c5-463d-b099-a3007d5c7a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:54.193202 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1909beb-57c5-463d-b099-a3007d5c7a05 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:54.202574 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 949/1878] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:54.203432 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1909beb-57c5-463d-b099-a3007d5c7a05 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:54.204772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c1909beb-57c5-463d-b099-a3007d5c7a05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:54.243958 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-579c5f7c-a409-4684-9dcf-064bd42f6d7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c79981f74bba444495eb23ab9ea0c091'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:54.253898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-579c5f7c-a409-4684-9dcf-064bd42f6d7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c79981f74bba444495eb23ab9ea0c091'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:54.278837 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1909beb-57c5-463d-b099-a3007d5c7a05 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:54.278837 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c368e27-823f-424e-aa18-c32d89f15191 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:54.278837 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c368e27-823f-424e-aa18-c32d89f15191 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:54.278837 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c368e27-823f-424e-aa18-c32d89f15191 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:54.279167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c368e27-823f-424e-aa18-c32d89f15191 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:54.279270 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-579c5f7c-a409-4684-9dcf-064bd42f6d7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c79981f74bba444495eb23ab9ea0c091'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:54.279270 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-579c5f7c-a409-4684-9dcf-064bd42f6d7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c79981f74bba444495eb23ab9ea0c091'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:54.290722 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c368e27-823f-424e-aa18-c32d89f15191 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:54.292351 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c368e27-823f-424e-aa18-c32d89f15191 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:54.319985 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 950/1879] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:54 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:54.365485 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:54.393235 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-579c5f7c-a409-4684-9dcf-064bd42f6d7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c79981f74bba444495eb23ab9ea0c091'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:54.401127 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 930/1880] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:28:53 2022] DELETE /identity/v3/users/c79981f74bba444495eb23ab9ea0c091 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:54.406385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f321d1-7ca8-4efc-8bbc-91acbbc7b36b None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:54.406880 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f321d1-7ca8-4efc-8bbc-91acbbc7b36b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:54.407342 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f321d1-7ca8-4efc-8bbc-91acbbc7b36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:54.429445 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-08f321d1-7ca8-4efc-8bbc-91acbbc7b36b None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:54.431826 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-08f321d1-7ca8-4efc-8bbc-91acbbc7b36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:54.511701 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 951/1881] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:54.522015 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c5f7c-a409-4684-9dcf-064bd42f6d7f admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:54.524020 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-579c5f7c-a409-4684-9dcf-064bd42f6d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:54.598512 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c5f7c-a409-4684-9dcf-064bd42f6d7f admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:54.602330 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2451f4-d21f-4fb0-ab12-fdbe81763617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:54.603566 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2451f4-d21f-4fb0-ab12-fdbe81763617 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:54.611552 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2451f4-d21f-4fb0-ab12-fdbe81763617 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:54.611552 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2451f4-d21f-4fb0-ab12-fdbe81763617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:54.614138 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2451f4-d21f-4fb0-ab12-fdbe81763617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:54.615654 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2451f4-d21f-4fb0-ab12-fdbe81763617 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:54.625589 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 931/1882] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:54.736875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f321d1-7ca8-4efc-8bbc-91acbbc7b36b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:54.738429 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-08f321d1-7ca8-4efc-8bbc-91acbbc7b36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:54.756073 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f321d1-7ca8-4efc-8bbc-91acbbc7b36b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:54.760836 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e095add-76fa-4b8c-9ac4-415989ef2795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:54.766609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e095add-76fa-4b8c-9ac4-415989ef2795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:54.766609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e095add-76fa-4b8c-9ac4-415989ef2795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:54.766609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e095add-76fa-4b8c-9ac4-415989ef2795 admin admin] PATH_INFO: `/v3/projects/cd43d767198a496cabe29b804f3c296d` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:54.766609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e095add-76fa-4b8c-9ac4-415989ef2795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd43d767198a496cabe29b804f3c296d)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:54.766609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e095add-76fa-4b8c-9ac4-415989ef2795 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:54.821829 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2451f4-d21f-4fb0-ab12-fdbe81763617 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:54.823297 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2d2451f4-d21f-4fb0-ab12-fdbe81763617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:54.881384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2451f4-d21f-4fb0-ab12-fdbe81763617 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:54.885698 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9d694-8b35-4cf4-b128-3d13becb87e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:54.886367 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9d694-8b35-4cf4-b128-3d13becb87e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:54.886648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9d694-8b35-4cf4-b128-3d13becb87e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:54.886920 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9d694-8b35-4cf4-b128-3d13becb87e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:54.888724 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-cdd9d694-8b35-4cf4-b128-3d13becb87e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:54.908071 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:54.947993 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9d694-8b35-4cf4-b128-3d13becb87e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:54.949438 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9d694-8b35-4cf4-b128-3d13becb87e7 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:54.960225 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 932/1883] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:54 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:28:54.980611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2e095add-76fa-4b8c-9ac4-415989ef2795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd43d767198a496cabe29b804f3c296d', 'request_id': 'req-2e095add-76fa-4b8c-9ac4-415989ef2795'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:55.164185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2e095add-76fa-4b8c-9ac4-415989ef2795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd43d767198a496cabe29b804f3c296d', 'request_id': 'req-2e095add-76fa-4b8c-9ac4-415989ef2795'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:55.171912 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2e095add-76fa-4b8c-9ac4-415989ef2795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd43d767198a496cabe29b804f3c296d', 'request_id': 'req-2e095add-76fa-4b8c-9ac4-415989ef2795'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:55.184245 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2e095add-76fa-4b8c-9ac4-415989ef2795 admin admin] The token cache is being invalidate because project cd43d767198a496cabe29b804f3c296d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:28:55.185475 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2e095add-76fa-4b8c-9ac4-415989ef2795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:55.186171 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-2e095add-76fa-4b8c-9ac4-415989ef2795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:55.188132 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 952/1884] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:28:54 2022] DELETE /identity/v3/projects/cd43d767198a496cabe29b804f3c296d => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:55.192599 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a42c4-622b-4f80-8bde-c0daa8996075 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:55.192890 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a42c4-622b-4f80-8bde-c0daa8996075 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:55.193175 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a42c4-622b-4f80-8bde-c0daa8996075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:55.212361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-1d7a42c4-622b-4f80-8bde-c0daa8996075 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:55.213742 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1d7a42c4-622b-4f80-8bde-c0daa8996075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:55.288143 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 933/1885] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:55.292394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37c095-738d-4aa8-913b-c3f0e08f4dfb None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:55.292858 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37c095-738d-4aa8-913b-c3f0e08f4dfb None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:55.293223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37c095-738d-4aa8-913b-c3f0e08f4dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:55.312834 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-fc37c095-738d-4aa8-913b-c3f0e08f4dfb None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:55.314414 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-fc37c095-738d-4aa8-913b-c3f0e08f4dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:55.322808 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 953/1886] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:55.327310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a42c4-622b-4f80-8bde-c0daa8996075 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:55.339862 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a42c4-622b-4f80-8bde-c0daa8996075 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:55.344916 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4af268-b3a4-4732-84ff-e4f104f8bb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:55.345571 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4af268-b3a4-4732-84ff-e4f104f8bb9b admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:55.345854 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4af268-b3a4-4732-84ff-e4f104f8bb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:55.346157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4af268-b3a4-4732-84ff-e4f104f8bb9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:55.347117 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4af268-b3a4-4732-84ff-e4f104f8bb9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:55.347552 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4af268-b3a4-4732-84ff-e4f104f8bb9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:55.349335 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4af268-b3a4-4732-84ff-e4f104f8bb9b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:55.363383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 934/1887] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:28:55.367726 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37c095-738d-4aa8-913b-c3f0e08f4dfb None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:55.378101 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37c095-738d-4aa8-913b-c3f0e08f4dfb None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:55.383152 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c4269-2bbb-4468-84c3-65e14ec82b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:55.383875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c4269-2bbb-4468-84c3-65e14ec82b81 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:55.384255 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c4269-2bbb-4468-84c3-65e14ec82b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:55.384538 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c4269-2bbb-4468-84c3-65e14ec82b81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:55.385286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c4269-2bbb-4468-84c3-65e14ec82b81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:55.387218 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c4269-2bbb-4468-84c3-65e14ec82b81 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:55.428711 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4af268-b3a4-4732-84ff-e4f104f8bb9b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:55.430569 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8c4af268-b3a4-4732-84ff-e4f104f8bb9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:55.443893 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4af268-b3a4-4732-84ff-e4f104f8bb9b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:55.449111 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bc300-13f2-44d8-9671-17d14c622f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:55.450044 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bc300-13f2-44d8-9671-17d14c622f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:55.450424 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bc300-13f2-44d8-9671-17d14c622f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:55.450764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bc300-13f2-44d8-9671-17d14c622f9a admin admin] PATH_INFO: `/v3/projects/228e7e2767064c64a42163fa9ac56983` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:55.452158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bc300-13f2-44d8-9671-17d14c622f9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=228e7e2767064c64a42163fa9ac56983)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:55.454042 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bc300-13f2-44d8-9671-17d14c622f9a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:55.503409 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 954/1888] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:55 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:55.507388 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c4269-2bbb-4468-84c3-65e14ec82b81 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:55.583986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c4269-2bbb-4468-84c3-65e14ec82b81 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:55.606091 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-971bc300-13f2-44d8-9671-17d14c622f9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '228e7e2767064c64a42163fa9ac56983', 'request_id': 'req-971bc300-13f2-44d8-9671-17d14c622f9a'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:55.614204 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-971bc300-13f2-44d8-9671-17d14c622f9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '228e7e2767064c64a42163fa9ac56983', 'request_id': 'req-971bc300-13f2-44d8-9671-17d14c622f9a'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:55.678596 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f2f54-6fe0-45ef-96a8-2ac53f11f3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:55.679471 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f2f54-6fe0-45ef-96a8-2ac53f11f3e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:55.680004 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f2f54-6fe0-45ef-96a8-2ac53f11f3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:55.680379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f2f54-6fe0-45ef-96a8-2ac53f11f3e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:55.681214 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f2f54-6fe0-45ef-96a8-2ac53f11f3e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:55.683337 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f2f54-6fe0-45ef-96a8-2ac53f11f3e8 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:55.699456 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-971bc300-13f2-44d8-9671-17d14c622f9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '228e7e2767064c64a42163fa9ac56983', 'request_id': 'req-971bc300-13f2-44d8-9671-17d14c622f9a'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:55.715535 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-971bc300-13f2-44d8-9671-17d14c622f9a admin admin] The token cache is being invalidate because project 228e7e2767064c64a42163fa9ac56983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:28:55.715947 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-971bc300-13f2-44d8-9671-17d14c622f9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:55.716984 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-971bc300-13f2-44d8-9671-17d14c622f9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:55.722406 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 935/1889] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:28:55 2022] DELETE /identity/v3/projects/228e7e2767064c64a42163fa9ac56983 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:28:55.725962 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bc300-13f2-44d8-9671-17d14c622f9a admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:55.733112 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-971bc300-13f2-44d8-9671-17d14c622f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:55.760604 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bc300-13f2-44d8-9671-17d14c622f9a admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:55.769796 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712f4bc-919c-4c84-886e-9c9cacf00de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:55.770666 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712f4bc-919c-4c84-886e-9c9cacf00de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:55.771270 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712f4bc-919c-4c84-886e-9c9cacf00de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:55.772174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712f4bc-919c-4c84-886e-9c9cacf00de1 admin admin] PATH_INFO: `/v3/users/6d2eb14191e0484e8735c2a967ebbf75` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:55.773770 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712f4bc-919c-4c84-886e-9c9cacf00de1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d2eb14191e0484e8735c2a967ebbf75)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:55.778259 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712f4bc-919c-4c84-886e-9c9cacf00de1 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:55.829692 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 955/1890] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:55 2022] POST /identity/v3/users => generated 289 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:28:55.834865 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f2f54-6fe0-45ef-96a8-2ac53f11f3e8 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:55.837584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-008f2f54-6fe0-45ef-96a8-2ac53f11f3e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:55.869389 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f2f54-6fe0-45ef-96a8-2ac53f11f3e8 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:55.874952 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb75959-4f06-45e6-a23d-806c06a5825c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:55.875820 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb75959-4f06-45e6-a23d-806c06a5825c admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:55.876182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb75959-4f06-45e6-a23d-806c06a5825c admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:55.876528 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb75959-4f06-45e6-a23d-806c06a5825c admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:55.877438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb75959-4f06-45e6-a23d-806c06a5825c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:55.879379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb75959-4f06-45e6-a23d-806c06a5825c admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:55.891888 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 956/1891] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:28:55.895595 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb75959-4f06-45e6-a23d-806c06a5825c admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:55.910751 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb75959-4f06-45e6-a23d-806c06a5825c admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:55.916097 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e314a-188e-4a46-a5e8-b074f8cf635a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:55.916763 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e314a-188e-4a46-a5e8-b074f8cf635a admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:55.917474 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e314a-188e-4a46-a5e8-b074f8cf635a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:55.917474 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e314a-188e-4a46-a5e8-b074f8cf635a admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:55.918022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e314a-188e-4a46-a5e8-b074f8cf635a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:55.919755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e314a-188e-4a46-a5e8-b074f8cf635a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:55.932917 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 957/1892] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:55.937048 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e314a-188e-4a46-a5e8-b074f8cf635a admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:55.950344 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e314a-188e-4a46-a5e8-b074f8cf635a admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:55.955981 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae3fc8-5ef3-4b7e-becc-5a995d111245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:55.956870 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae3fc8-5ef3-4b7e-becc-5a995d111245 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:55.957203 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae3fc8-5ef3-4b7e-becc-5a995d111245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:55.957493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae3fc8-5ef3-4b7e-becc-5a995d111245 admin admin] PATH_INFO: `/v3/projects/d21a71e2b24b4ead881eef96b1636782/users/0daa5f6bc29d402ab08440c024d7bbae/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:55.979517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ae3fc8-5ef3-4b7e-becc-5a995d111245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d21a71e2b24b4ead881eef96b1636782, user_id=0daa5f6bc29d402ab08440c024d7bbae, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:55.982241 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ae3fc8-5ef3-4b7e-becc-5a995d111245 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:55.984241 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c712f4bc-919c-4c84-886e-9c9cacf00de1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d2eb14191e0484e8735c2a967ebbf75'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:55.991584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c712f4bc-919c-4c84-886e-9c9cacf00de1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d2eb14191e0484e8735c2a967ebbf75'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:56.004510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c712f4bc-919c-4c84-886e-9c9cacf00de1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d2eb14191e0484e8735c2a967ebbf75'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:56.005241 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c712f4bc-919c-4c84-886e-9c9cacf00de1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d2eb14191e0484e8735c2a967ebbf75'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:56.078705 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 958/1893] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:55 2022] PUT /identity/v3/projects/d21a71e2b24b4ead881eef96b1636782/users/0daa5f6bc29d402ab08440c024d7bbae/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:56.089310 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977afa8c-61c2-4f0f-ad16-f04a6fbf4c69 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:56.089597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977afa8c-61c2-4f0f-ad16-f04a6fbf4c69 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:56.089874 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977afa8c-61c2-4f0f-ad16-f04a6fbf4c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:56.116262 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-977afa8c-61c2-4f0f-ad16-f04a6fbf4c69 None None] MFA Rules not processed for user `0daa5f6bc29d402ab08440c024d7bbae`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:56.117633 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-977afa8c-61c2-4f0f-ad16-f04a6fbf4c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:56.156557 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c712f4bc-919c-4c84-886e-9c9cacf00de1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d2eb14191e0484e8735c2a967ebbf75'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:56.163714 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 936/1894] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:28:55 2022] DELETE /identity/v3/users/6d2eb14191e0484e8735c2a967ebbf75 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:56.192442 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 959/1895] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:28:56.200776 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712f4bc-919c-4c84-886e-9c9cacf00de1 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:56.202712 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c712f4bc-919c-4c84-886e-9c9cacf00de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:56.207799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27395d46-0643-4358-b5db-06b8833cc146 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:56.208093 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27395d46-0643-4358-b5db-06b8833cc146 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:56.208419 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27395d46-0643-4358-b5db-06b8833cc146 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:56.209814 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 960/1896] 10.222.0.13 () {54 vars in 921 bytes} [Tue Jul 5 21:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:28:56.224216 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb555ede-bbb1-4481-9bee-758996ced0df None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:56.225367 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb555ede-bbb1-4481-9bee-758996ced0df None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:56.225849 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb555ede-bbb1-4481-9bee-758996ced0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:56.253529 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-cb555ede-bbb1-4481-9bee-758996ced0df None None] MFA Rules not processed for user `910cd341df8943f18af2765e2a30b238`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:56.254880 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-cb555ede-bbb1-4481-9bee-758996ced0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:56.290894 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712f4bc-919c-4c84-886e-9c9cacf00de1 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:56.298701 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461700c3-4fe0-4f63-92ac-a1f6daa5c1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:56.299978 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461700c3-4fe0-4f63-92ac-a1f6daa5c1c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:56.300430 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461700c3-4fe0-4f63-92ac-a1f6daa5c1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:56.300706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461700c3-4fe0-4f63-92ac-a1f6daa5c1c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:56.301421 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461700c3-4fe0-4f63-92ac-a1f6daa5c1c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:56.304741 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461700c3-4fe0-4f63-92ac-a1f6daa5c1c2 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:56.343096 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 961/1897] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Jul 5 21:28:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:28:56.364804 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb555ede-bbb1-4481-9bee-758996ced0df None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:56.366544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-cb555ede-bbb1-4481-9bee-758996ced0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:56.385557 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb555ede-bbb1-4481-9bee-758996ced0df None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:56.391503 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e588c06-3ced-429d-b98a-58ec0cccc0d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:56.392365 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e588c06-3ced-429d-b98a-58ec0cccc0d7 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:56.392458 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e588c06-3ced-429d-b98a-58ec0cccc0d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:56.392890 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e588c06-3ced-429d-b98a-58ec0cccc0d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:56.406357 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e588c06-3ced-429d-b98a-58ec0cccc0d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:56.409721 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e588c06-3ced-429d-b98a-58ec0cccc0d7 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:56.439745 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 962/1898] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:56.452464 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 937/1899] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:56 2022] POST /identity/v3/projects => generated 373 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:56.454260 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e588c06-3ced-429d-b98a-58ec0cccc0d7 service nova] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:56.479340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e588c06-3ced-429d-b98a-58ec0cccc0d7 service nova] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:56.494439 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:56.596157 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf1b57-67e7-44e2-ad47-6a18d204e136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:56.598362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf1b57-67e7-44e2-ad47-6a18d204e136 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:56.599704 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf1b57-67e7-44e2-ad47-6a18d204e136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:56.599704 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf1b57-67e7-44e2-ad47-6a18d204e136 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:56.613924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf1b57-67e7-44e2-ad47-6a18d204e136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:56.620957 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf1b57-67e7-44e2-ad47-6a18d204e136 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:56.698711 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461700c3-4fe0-4f63-92ac-a1f6daa5c1c2 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:56.700706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-461700c3-4fe0-4f63-92ac-a1f6daa5c1c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:56.736949 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 963/1900] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:56 2022] POST /identity/v3/users => generated 287 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:28:56.741563 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf1b57-67e7-44e2-ad47-6a18d204e136 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:56.744497 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461700c3-4fe0-4f63-92ac-a1f6daa5c1c2 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:56.752007 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536c96c-8c66-4ace-aa6b-09ec8ba092ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:56.753297 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536c96c-8c66-4ace-aa6b-09ec8ba092ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:56.753658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536c96c-8c66-4ace-aa6b-09ec8ba092ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:56.754040 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536c96c-8c66-4ace-aa6b-09ec8ba092ca admin admin] PATH_INFO: `/v3/projects/4e8ba748835647059ee5fcd41f1527fa` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:56.755671 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536c96c-8c66-4ace-aa6b-09ec8ba092ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e8ba748835647059ee5fcd41f1527fa)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:56.756033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf1b57-67e7-44e2-ad47-6a18d204e136 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:56.758764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536c96c-8c66-4ace-aa6b-09ec8ba092ca admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:56.764644 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec6764-daa6-401b-90b8-37db9308aa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:56.765328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec6764-daa6-401b-90b8-37db9308aa40 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:56.765614 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec6764-daa6-401b-90b8-37db9308aa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:56.765891 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec6764-daa6-401b-90b8-37db9308aa40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:56.767793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec6764-daa6-401b-90b8-37db9308aa40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:56.769210 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec6764-daa6-401b-90b8-37db9308aa40 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:56.787099 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 964/1901] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:56.792667 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec6764-daa6-401b-90b8-37db9308aa40 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:56.806946 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec6764-daa6-401b-90b8-37db9308aa40 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:56.824681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b0600-8f43-4b8d-a0a8-22d270640c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:56.826936 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b0600-8f43-4b8d-a0a8-22d270640c0d admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:56.827223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b0600-8f43-4b8d-a0a8-22d270640c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:56.827504 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b0600-8f43-4b8d-a0a8-22d270640c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:56.828245 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b0600-8f43-4b8d-a0a8-22d270640c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:56.830379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b0600-8f43-4b8d-a0a8-22d270640c0d admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:56.855355 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 965/1902] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:56.859707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b0600-8f43-4b8d-a0a8-22d270640c0d admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:56.870898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b0600-8f43-4b8d-a0a8-22d270640c0d admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:56.879355 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d4688-bc91-4f97-8ca5-d024b7bd6db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:56.880677 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d4688-bc91-4f97-8ca5-d024b7bd6db8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:56.881213 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d4688-bc91-4f97-8ca5-d024b7bd6db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:56.883657 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d4688-bc91-4f97-8ca5-d024b7bd6db8 admin admin] PATH_INFO: `/v3/projects/cf3b316acb2344488e48f5bc04e815dc/users/9590cf43c93f439d89ff8034d931d617/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:56.907464 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d4688-bc91-4f97-8ca5-d024b7bd6db8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf3b316acb2344488e48f5bc04e815dc, user_id=9590cf43c93f439d89ff8034d931d617, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:56.911027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d4688-bc91-4f97-8ca5-d024b7bd6db8 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:56.923845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-3536c96c-8c66-4ace-aa6b-09ec8ba092ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e8ba748835647059ee5fcd41f1527fa', 'request_id': 'req-3536c96c-8c66-4ace-aa6b-09ec8ba092ca'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:56.930616 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-3536c96c-8c66-4ace-aa6b-09ec8ba092ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e8ba748835647059ee5fcd41f1527fa', 'request_id': 'req-3536c96c-8c66-4ace-aa6b-09ec8ba092ca'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:56.994940 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 966/1903] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:56 2022] PUT /identity/v3/projects/cf3b316acb2344488e48f5bc04e815dc/users/9590cf43c93f439d89ff8034d931d617/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:57.006510 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585a876-5580-4108-b731-9958abfca4bd None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:57.006805 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585a876-5580-4108-b731-9958abfca4bd None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:57.007111 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585a876-5580-4108-b731-9958abfca4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:57.034926 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0585a876-5580-4108-b731-9958abfca4bd None None] MFA Rules not processed for user `9590cf43c93f439d89ff8034d931d617`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:57.036149 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0585a876-5580-4108-b731-9958abfca4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:57.050200 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-3536c96c-8c66-4ace-aa6b-09ec8ba092ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e8ba748835647059ee5fcd41f1527fa', 'request_id': 'req-3536c96c-8c66-4ace-aa6b-09ec8ba092ca'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:57.067428 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-3536c96c-8c66-4ace-aa6b-09ec8ba092ca admin admin] The token cache is being invalidate because project 4e8ba748835647059ee5fcd41f1527fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:28:57.067627 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-3536c96c-8c66-4ace-aa6b-09ec8ba092ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:57.068432 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-3536c96c-8c66-4ace-aa6b-09ec8ba092ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:28:57.070362 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 938/1904] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:28:56 2022] DELETE /identity/v3/projects/4e8ba748835647059ee5fcd41f1527fa => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:57.113856 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b5c4b-9d6c-4b67-87fa-5f2e2fa14381 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:57.113856 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b5c4b-9d6c-4b67-87fa-5f2e2fa14381 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:57.113856 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b5c4b-9d6c-4b67-87fa-5f2e2fa14381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:57.133709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 967/1905] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:28:57.134926 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585a876-5580-4108-b731-9958abfca4bd None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:57.136552 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0585a876-5580-4108-b731-9958abfca4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:57.165588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-222b5c4b-9d6c-4b67-87fa-5f2e2fa14381 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:57.167713 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-222b5c4b-9d6c-4b67-87fa-5f2e2fa14381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:57.174307 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:57.221935 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585a876-5580-4108-b731-9958abfca4bd None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:57.227454 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e478e6-b556-4313-9fc1-e13c7e8c0f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:57.228336 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e478e6-b556-4313-9fc1-e13c7e8c0f1f admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:57.228673 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e478e6-b556-4313-9fc1-e13c7e8c0f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:57.228957 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e478e6-b556-4313-9fc1-e13c7e8c0f1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:57.229784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e478e6-b556-4313-9fc1-e13c7e8c0f1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:57.231950 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e478e6-b556-4313-9fc1-e13c7e8c0f1f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:57.256919 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 939/1906] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:57.265331 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e3c56-a333-4857-aa85-8c373dd17045 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:57.266266 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e3c56-a333-4857-aa85-8c373dd17045 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:57.266550 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e3c56-a333-4857-aa85-8c373dd17045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:57.286585 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-952e3c56-a333-4857-aa85-8c373dd17045 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:57.288035 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-952e3c56-a333-4857-aa85-8c373dd17045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:57.296890 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 940/1907] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:28:57.301107 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e3c56-a333-4857-aa85-8c373dd17045 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:57.310622 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e3c56-a333-4857-aa85-8c373dd17045 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:57.315419 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e41c8b-a074-4e33-806d-d906f064b661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:57.316072 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e41c8b-a074-4e33-806d-d906f064b661 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:57.316663 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e41c8b-a074-4e33-806d-d906f064b661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:57.316663 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e41c8b-a074-4e33-806d-d906f064b661 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:57.317368 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e41c8b-a074-4e33-806d-d906f064b661 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:57.317730 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e41c8b-a074-4e33-806d-d906f064b661 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:57.319355 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e41c8b-a074-4e33-806d-d906f064b661 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:57.336406 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 941/1908] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:28:57.338305 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e41c8b-a074-4e33-806d-d906f064b661 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:57.348158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e41c8b-a074-4e33-806d-d906f064b661 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:57.353162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c39c5-eb13-44ef-a619-88d47b2c70d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:57.353820 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c39c5-eb13-44ef-a619-88d47b2c70d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:57.354105 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c39c5-eb13-44ef-a619-88d47b2c70d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:57.354430 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c39c5-eb13-44ef-a619-88d47b2c70d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:57.355125 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c39c5-eb13-44ef-a619-88d47b2c70d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:57.357031 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c39c5-eb13-44ef-a619-88d47b2c70d8 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:57.372438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 968/1909] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:57 2022] POST /identity/v3/projects => generated 377 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:57.376078 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e478e6-b556-4313-9fc1-e13c7e8c0f1f admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:57.443275 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e478e6-b556-4313-9fc1-e13c7e8c0f1f admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:57.449320 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06d3cd-10e0-41cb-bdf8-2f22489a07c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:57.450038 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06d3cd-10e0-41cb-bdf8-2f22489a07c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:57.450315 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06d3cd-10e0-41cb-bdf8-2f22489a07c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:57.450597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06d3cd-10e0-41cb-bdf8-2f22489a07c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:57.451322 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06d3cd-10e0-41cb-bdf8-2f22489a07c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:57.453277 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06d3cd-10e0-41cb-bdf8-2f22489a07c9 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:57.493627 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 942/1910] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:57 2022] POST /identity/v3/projects => generated 369 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:57.494712 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c39c5-eb13-44ef-a619-88d47b2c70d8 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:57.560631 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 969/1911] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:57 2022] POST /identity/v3/users => generated 295 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:28:57.564657 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06d3cd-10e0-41cb-bdf8-2f22489a07c9 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:57.575610 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06d3cd-10e0-41cb-bdf8-2f22489a07c9 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:57.580894 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27f1f2-a75f-4ef8-90b0-49b273cf4f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:57.581567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27f1f2-a75f-4ef8-90b0-49b273cf4f0b admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:57.581847 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27f1f2-a75f-4ef8-90b0-49b273cf4f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:57.582313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27f1f2-a75f-4ef8-90b0-49b273cf4f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:57.583059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b27f1f2-a75f-4ef8-90b0-49b273cf4f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:57.585086 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b27f1f2-a75f-4ef8-90b0-49b273cf4f0b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:57.588039 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c39c5-eb13-44ef-a619-88d47b2c70d8 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:57.596020 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa25ae3-ada9-4fd2-ac7f-a65a364c524a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:57.596709 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa25ae3-ada9-4fd2-ac7f-a65a364c524a admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:57.601220 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa25ae3-ada9-4fd2-ac7f-a65a364c524a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:57.601220 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa25ae3-ada9-4fd2-ac7f-a65a364c524a admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:57.601220 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa25ae3-ada9-4fd2-ac7f-a65a364c524a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:57.601220 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa25ae3-ada9-4fd2-ac7f-a65a364c524a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:57.602041 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 970/1912] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:28:57.604513 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27f1f2-a75f-4ef8-90b0-49b273cf4f0b admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:57.616452 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27f1f2-a75f-4ef8-90b0-49b273cf4f0b admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:57.621949 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea46b4e-62f7-4441-857d-fe89837644d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:57.622908 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea46b4e-62f7-4441-857d-fe89837644d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:57.623190 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea46b4e-62f7-4441-857d-fe89837644d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:57.623470 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea46b4e-62f7-4441-857d-fe89837644d4 admin admin] PATH_INFO: `/v3/projects/36dff46d0cae4a7a871f3815f9e4e220/users/da1e2ac2cc4e40d09d70730162ce57b4/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:57.641819 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea46b4e-62f7-4441-857d-fe89837644d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36dff46d0cae4a7a871f3815f9e4e220, user_id=da1e2ac2cc4e40d09d70730162ce57b4, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:57.644858 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea46b4e-62f7-4441-857d-fe89837644d4 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:57.676816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 943/1913] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:57 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:57.681796 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa25ae3-ada9-4fd2-ac7f-a65a364c524a admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:57.691736 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa25ae3-ada9-4fd2-ac7f-a65a364c524a admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:57.697130 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709f70c-c8c4-4b35-a022-b0a1e3682ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:57.697782 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709f70c-c8c4-4b35-a022-b0a1e3682ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:57.698099 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709f70c-c8c4-4b35-a022-b0a1e3682ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:57.698419 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709f70c-c8c4-4b35-a022-b0a1e3682ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:57.699181 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709f70c-c8c4-4b35-a022-b0a1e3682ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:57.710352 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709f70c-c8c4-4b35-a022-b0a1e3682ea2 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:57.710998 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 944/1914] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:28:57.715970 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709f70c-c8c4-4b35-a022-b0a1e3682ea2 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:57.725735 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709f70c-c8c4-4b35-a022-b0a1e3682ea2 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:57.731315 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696ca6a-20d2-4599-94dd-65681d0fc1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:57.732025 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696ca6a-20d2-4599-94dd-65681d0fc1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:57.732335 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696ca6a-20d2-4599-94dd-65681d0fc1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:57.732608 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696ca6a-20d2-4599-94dd-65681d0fc1f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:57.733613 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3696ca6a-20d2-4599-94dd-65681d0fc1f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:57.734915 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3696ca6a-20d2-4599-94dd-65681d0fc1f8 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:57.746662 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 945/1915] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:28:57.750755 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696ca6a-20d2-4599-94dd-65681d0fc1f8 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:57.761644 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696ca6a-20d2-4599-94dd-65681d0fc1f8 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:57.766705 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e074a6f-7696-41cb-86e9-45a2b25b5108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:57.767575 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e074a6f-7696-41cb-86e9-45a2b25b5108 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:57.767847 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e074a6f-7696-41cb-86e9-45a2b25b5108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:57.768114 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e074a6f-7696-41cb-86e9-45a2b25b5108 admin admin] PATH_INFO: `/v3/projects/6b5d28a265584778997b5912750c43f6/users/bdf5fe65b11b43c68908cc8b1f80ff80/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:57.783453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e074a6f-7696-41cb-86e9-45a2b25b5108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b5d28a265584778997b5912750c43f6, user_id=bdf5fe65b11b43c68908cc8b1f80ff80, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:57.786223 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e074a6f-7696-41cb-86e9-45a2b25b5108 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:57.795174 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 971/1916] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:57 2022] PUT /identity/v3/projects/36dff46d0cae4a7a871f3815f9e4e220/users/da1e2ac2cc4e40d09d70730162ce57b4/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:28:57.798952 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea46b4e-62f7-4441-857d-fe89837644d4 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:57.893095 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea46b4e-62f7-4441-857d-fe89837644d4 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:57.898640 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72b379-6dbc-49c7-9380-283aeeb299e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:57.899259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72b379-6dbc-49c7-9380-283aeeb299e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:57.899544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72b379-6dbc-49c7-9380-283aeeb299e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:57.899824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72b379-6dbc-49c7-9380-283aeeb299e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:57.900559 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72b379-6dbc-49c7-9380-283aeeb299e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:57.902264 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72b379-6dbc-49c7-9380-283aeeb299e0 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:57.914501 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 972/1917] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:57.922758 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72b379-6dbc-49c7-9380-283aeeb299e0 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:57.925343 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 946/1918] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:57 2022] PUT /identity/v3/projects/6b5d28a265584778997b5912750c43f6/users/bdf5fe65b11b43c68908cc8b1f80ff80/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:28:57.936597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72b379-6dbc-49c7-9380-283aeeb299e0 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:57.940030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76111d-37ae-42e0-96c6-bcf4d6bbac95 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:57.940389 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76111d-37ae-42e0-96c6-bcf4d6bbac95 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:57.940871 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76111d-37ae-42e0-96c6-bcf4d6bbac95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:57.998714 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-aa76111d-37ae-42e0-96c6-bcf4d6bbac95 None None] MFA Rules not processed for user `bdf5fe65b11b43c68908cc8b1f80ff80`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:58.000786 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-aa76111d-37ae-42e0-96c6-bcf4d6bbac95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:58.016623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b8467-7cf0-4f9a-836a-a8885005adbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:58.017348 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b8467-7cf0-4f9a-836a-a8885005adbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:58.017638 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b8467-7cf0-4f9a-836a-a8885005adbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:58.017918 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b8467-7cf0-4f9a-836a-a8885005adbd admin admin] PATH_INFO: `/v3/projects/36dff46d0cae4a7a871f3815f9e4e220/users/da1e2ac2cc4e40d09d70730162ce57b4/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:58.020116 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b8467-7cf0-4f9a-836a-a8885005adbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=36dff46d0cae4a7a871f3815f9e4e220, user_id=da1e2ac2cc4e40d09d70730162ce57b4, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:58.022804 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b8467-7cf0-4f9a-836a-a8885005adbd admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:58.034162 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 973/1919] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:57 2022] PUT /identity/v3/projects/36dff46d0cae4a7a871f3815f9e4e220/users/da1e2ac2cc4e40d09d70730162ce57b4/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:58.046479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ab8a6-9355-4c7e-85a7-58c391fff4dd None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:58.046881 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ab8a6-9355-4c7e-85a7-58c391fff4dd None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:58.047116 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ab8a6-9355-4c7e-85a7-58c391fff4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:58.072552 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 947/1920] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:28:58.074217 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e61ab8a6-9355-4c7e-85a7-58c391fff4dd None None] MFA Rules not processed for user `da1e2ac2cc4e40d09d70730162ce57b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:58.075534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e61ab8a6-9355-4c7e-85a7-58c391fff4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:58.077287 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76111d-37ae-42e0-96c6-bcf4d6bbac95 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:58.087577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76111d-37ae-42e0-96c6-bcf4d6bbac95 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:58.143603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 974/1921] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:28:58.147234 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5e9f6-c364-44d2-b8da-7eb5522e6413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:58.147905 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5e9f6-c364-44d2-b8da-7eb5522e6413 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:58.148191 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5e9f6-c364-44d2-b8da-7eb5522e6413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:58.148466 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5e9f6-c364-44d2-b8da-7eb5522e6413 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:58.149195 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5e9f6-c364-44d2-b8da-7eb5522e6413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:58.151880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5e9f6-c364-44d2-b8da-7eb5522e6413 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:58.157945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ab8a6-9355-4c7e-85a7-58c391fff4dd None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:58.159348 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e61ab8a6-9355-4c7e-85a7-58c391fff4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:58.217603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ab8a6-9355-4c7e-85a7-58c391fff4dd None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:58.221352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb9751-d72d-44fd-bbd2-e93c5598f355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:58.222009 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb9751-d72d-44fd-bbd2-e93c5598f355 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:58.222331 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb9751-d72d-44fd-bbd2-e93c5598f355 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:58.222617 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb9751-d72d-44fd-bbd2-e93c5598f355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:58.224741 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-31eb9751-d72d-44fd-bbd2-e93c5598f355 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:58.262348 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 948/1922] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:28:58 2022] POST /identity/v3/projects => generated 369 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:28:58.266561 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5e9f6-c364-44d2-b8da-7eb5522e6413 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:58.311593 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb9751-d72d-44fd-bbd2-e93c5598f355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:58.313819 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb9751-d72d-44fd-bbd2-e93c5598f355 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:58.333301 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 975/1923] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:28:58.351901 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5e9f6-c364-44d2-b8da-7eb5522e6413 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:58.358211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513cbaf-bb1f-4159-9506-d3256d7f5ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:58.358896 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513cbaf-bb1f-4159-9506-d3256d7f5ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:58.359184 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513cbaf-bb1f-4159-9506-d3256d7f5ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:58.359466 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513cbaf-bb1f-4159-9506-d3256d7f5ad3 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:58.360164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513cbaf-bb1f-4159-9506-d3256d7f5ad3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:58.362101 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513cbaf-bb1f-4159-9506-d3256d7f5ad3 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:58.485994 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 949/1924] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:28:58 2022] POST /identity/v3/users => generated 291 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:28:58.487292 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb9751-d72d-44fd-bbd2-e93c5598f355 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:58.497889 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb9751-d72d-44fd-bbd2-e93c5598f355 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:58.503050 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46dc35d-b768-4ea5-9011-83d285be8be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:58.503713 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dc35d-b768-4ea5-9011-83d285be8be8 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:58.503994 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dc35d-b768-4ea5-9011-83d285be8be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:58.504269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dc35d-b768-4ea5-9011-83d285be8be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:58.504986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46dc35d-b768-4ea5-9011-83d285be8be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:58.510248 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46dc35d-b768-4ea5-9011-83d285be8be8 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:58.516732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 976/1925] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:58.520829 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513cbaf-bb1f-4159-9506-d3256d7f5ad3 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:58.531835 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513cbaf-bb1f-4159-9506-d3256d7f5ad3 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:58.536615 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858a4e2-5803-4316-90f0-bb3712023e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:58.537563 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858a4e2-5803-4316-90f0-bb3712023e2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:58.537912 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858a4e2-5803-4316-90f0-bb3712023e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:58.538288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858a4e2-5803-4316-90f0-bb3712023e2d admin admin] PATH_INFO: `/v3/projects/47c0c5d51690429a9fcf20af9fa200df/users/5b7d5fd9f197432fb5624a4813f95407/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:58.554443 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858a4e2-5803-4316-90f0-bb3712023e2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=47c0c5d51690429a9fcf20af9fa200df, user_id=5b7d5fd9f197432fb5624a4813f95407, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:58.559724 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858a4e2-5803-4316-90f0-bb3712023e2d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:58.651656 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 950/1926] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:58 2022] PUT /identity/v3/projects/47c0c5d51690429a9fcf20af9fa200df/users/5b7d5fd9f197432fb5624a4813f95407/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:58.655534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46dc35d-b768-4ea5-9011-83d285be8be8 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:58.666660 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46dc35d-b768-4ea5-9011-83d285be8be8 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:58.729616 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97df7f-7e02-42dc-8d87-54ddfc122d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:58.730314 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97df7f-7e02-42dc-8d87-54ddfc122d31 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:58.730597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97df7f-7e02-42dc-8d87-54ddfc122d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:58.730872 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97df7f-7e02-42dc-8d87-54ddfc122d31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:58.731638 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97df7f-7e02-42dc-8d87-54ddfc122d31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:58.733302 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97df7f-7e02-42dc-8d87-54ddfc122d31 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:58.743162 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 977/1927] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:28:58.747517 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858a4e2-5803-4316-90f0-bb3712023e2d admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:58.758286 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858a4e2-5803-4316-90f0-bb3712023e2d admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:58.763622 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9345fb-b6e6-40ce-b297-d1fe15d64959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:58.764529 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9345fb-b6e6-40ce-b297-d1fe15d64959 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:58.764807 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9345fb-b6e6-40ce-b297-d1fe15d64959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:58.765099 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9345fb-b6e6-40ce-b297-d1fe15d64959 admin admin] PATH_INFO: `/v3/projects/47c0c5d51690429a9fcf20af9fa200df/users/5b7d5fd9f197432fb5624a4813f95407/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:58.767125 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9345fb-b6e6-40ce-b297-d1fe15d64959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47c0c5d51690429a9fcf20af9fa200df, user_id=5b7d5fd9f197432fb5624a4813f95407, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:58.769824 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9345fb-b6e6-40ce-b297-d1fe15d64959 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:58.781061 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 951/1928] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:28:58 2022] PUT /identity/v3/projects/47c0c5d51690429a9fcf20af9fa200df/users/5b7d5fd9f197432fb5624a4813f95407/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:58.798762 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b111dc4-dbad-44b2-943d-f208db2fc3f6 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:58.802760 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b111dc4-dbad-44b2-943d-f208db2fc3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:58.802760 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b111dc4-dbad-44b2-943d-f208db2fc3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:58.823301 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:58.842554 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-3b111dc4-dbad-44b2-943d-f208db2fc3f6 None None] MFA Rules not processed for user `5b7d5fd9f197432fb5624a4813f95407`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:58.843786 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3b111dc4-dbad-44b2-943d-f208db2fc3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:58.917059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 978/1929] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:28:58 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:28:58.991249 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9345fb-b6e6-40ce-b297-d1fe15d64959 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:59.061281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9345fb-b6e6-40ce-b297-d1fe15d64959 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:59.066670 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31430a53-57e1-41ea-94e0-35c5f4600a94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:59.067602 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31430a53-57e1-41ea-94e0-35c5f4600a94 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:59.068124 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31430a53-57e1-41ea-94e0-35c5f4600a94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:59.068607 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31430a53-57e1-41ea-94e0-35c5f4600a94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:59.080142 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31430a53-57e1-41ea-94e0-35c5f4600a94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:59.081742 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31430a53-57e1-41ea-94e0-35c5f4600a94 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:59.093428 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 952/1930] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:28:58 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:28:59.398926 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:59.726819 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b111dc4-dbad-44b2-943d-f208db2fc3f6 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:59.728909 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3b111dc4-dbad-44b2-943d-f208db2fc3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:59.797665 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b111dc4-dbad-44b2-943d-f208db2fc3f6 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:59.802487 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efcc77f-cf98-4282-9fe5-1fc3c2440d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:59.803438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcc77f-cf98-4282-9fe5-1fc3c2440d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:59.803745 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcc77f-cf98-4282-9fe5-1fc3c2440d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:59.804024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcc77f-cf98-4282-9fe5-1fc3c2440d4b admin admin] PATH_INFO: `/v3/users/b117d7caa1e4471b858be41046c71ef8` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:59.805795 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efcc77f-cf98-4282-9fe5-1fc3c2440d4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b117d7caa1e4471b858be41046c71ef8)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:59.808935 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efcc77f-cf98-4282-9fe5-1fc3c2440d4b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:00.089437 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-1efcc77f-cf98-4282-9fe5-1fc3c2440d4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b117d7caa1e4471b858be41046c71ef8'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:00.215610 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-1efcc77f-cf98-4282-9fe5-1fc3c2440d4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b117d7caa1e4471b858be41046c71ef8'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:00.239251 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-1efcc77f-cf98-4282-9fe5-1fc3c2440d4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b117d7caa1e4471b858be41046c71ef8'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:00.253783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-1efcc77f-cf98-4282-9fe5-1fc3c2440d4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b117d7caa1e4471b858be41046c71ef8'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:00.254632 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-1efcc77f-cf98-4282-9fe5-1fc3c2440d4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b117d7caa1e4471b858be41046c71ef8'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:00.262324 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 979/1931] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:28:59 2022] DELETE /identity/v3/users/b117d7caa1e4471b858be41046c71ef8 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:00.269259 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba3940-fe69-47a1-a11f-032aeb2566e4 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:00.269964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba3940-fe69-47a1-a11f-032aeb2566e4 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:00.270240 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba3940-fe69-47a1-a11f-032aeb2566e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:00.321488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-daba3940-fe69-47a1-a11f-032aeb2566e4 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:00.326664 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-daba3940-fe69-47a1-a11f-032aeb2566e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:00.405886 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 953/1932] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:00.415757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efcc77f-cf98-4282-9fe5-1fc3c2440d4b admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:00.417232 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-1efcc77f-cf98-4282-9fe5-1fc3c2440d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:00.490500 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efcc77f-cf98-4282-9fe5-1fc3c2440d4b admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:00.495387 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804e0cd-c5a1-4084-a2f5-a9f5965d8a38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:00.496366 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804e0cd-c5a1-4084-a2f5-a9f5965d8a38 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:00.500248 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804e0cd-c5a1-4084-a2f5-a9f5965d8a38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:00.500715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804e0cd-c5a1-4084-a2f5-a9f5965d8a38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:00.517333 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804e0cd-c5a1-4084-a2f5-a9f5965d8a38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:00.519116 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804e0cd-c5a1-4084-a2f5-a9f5965d8a38 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:00.545517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 980/1933] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:00.843606 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:00.999817 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba3940-fe69-47a1-a11f-032aeb2566e4 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:01.001284 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-daba3940-fe69-47a1-a11f-032aeb2566e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:01.065698 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba3940-fe69-47a1-a11f-032aeb2566e4 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:01.069291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cbc8d-aa5b-45e1-97c9-3b451e309c18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:01.070096 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cbc8d-aa5b-45e1-97c9-3b451e309c18 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:01.070520 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cbc8d-aa5b-45e1-97c9-3b451e309c18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:01.071383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cbc8d-aa5b-45e1-97c9-3b451e309c18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:01.073227 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-cc0cbc8d-aa5b-45e1-97c9-3b451e309c18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:01.135894 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0cbc8d-aa5b-45e1-97c9-3b451e309c18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:01.136463 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804e0cd-c5a1-4084-a2f5-a9f5965d8a38 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:01.137528 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0cbc8d-aa5b-45e1-97c9-3b451e309c18 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:01.138434 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4804e0cd-c5a1-4084-a2f5-a9f5965d8a38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:01.148531 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 954/1934] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:01.162683 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804e0cd-c5a1-4084-a2f5-a9f5965d8a38 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:01.162683 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669a0d5-1ef0-495b-862e-c1cbd09369ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:01.163766 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669a0d5-1ef0-495b-862e-c1cbd09369ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:01.164053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669a0d5-1ef0-495b-862e-c1cbd09369ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:01.164337 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669a0d5-1ef0-495b-862e-c1cbd09369ce admin admin] PATH_INFO: `/v3/projects/b931c39a7eae4773bd48cc144685e0ae` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:01.165709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669a0d5-1ef0-495b-862e-c1cbd09369ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=b931c39a7eae4773bd48cc144685e0ae)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:01.169118 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669a0d5-1ef0-495b-862e-c1cbd09369ce admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:01.250048 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:01.298894 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-9669a0d5-1ef0-495b-862e-c1cbd09369ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b931c39a7eae4773bd48cc144685e0ae', 'request_id': 'req-9669a0d5-1ef0-495b-862e-c1cbd09369ce'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:01.384991 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-9669a0d5-1ef0-495b-862e-c1cbd09369ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b931c39a7eae4773bd48cc144685e0ae', 'request_id': 'req-9669a0d5-1ef0-495b-862e-c1cbd09369ce'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:01.391222 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-9669a0d5-1ef0-495b-862e-c1cbd09369ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b931c39a7eae4773bd48cc144685e0ae', 'request_id': 'req-9669a0d5-1ef0-495b-862e-c1cbd09369ce'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:01.403089 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-9669a0d5-1ef0-495b-862e-c1cbd09369ce admin admin] The token cache is being invalidate because project b931c39a7eae4773bd48cc144685e0ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:29:01.403381 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-9669a0d5-1ef0-495b-862e-c1cbd09369ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:01.404027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-9669a0d5-1ef0-495b-862e-c1cbd09369ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:01.405562 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 981/1935] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:29:01 2022] DELETE /identity/v3/projects/b931c39a7eae4773bd48cc144685e0ae => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:01.409712 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cbc8d-aa5b-45e1-97c9-3b451e309c18 service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:01.420862 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cbc8d-aa5b-45e1-97c9-3b451e309c18 service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:01.476088 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec037f-1655-4471-b13d-d851ed390271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:01.477598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec037f-1655-4471-b13d-d851ed390271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:01.477889 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec037f-1655-4471-b13d-d851ed390271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:01.478200 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec037f-1655-4471-b13d-d851ed390271 admin admin] PATH_INFO: `/v3/users/8113d4413a02422ba6c8a2edb06a0d05` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:01.479448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec037f-1655-4471-b13d-d851ed390271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8113d4413a02422ba6c8a2edb06a0d05)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:01.481363 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec037f-1655-4471-b13d-d851ed390271 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:01.709679 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-77ec037f-1655-4471-b13d-d851ed390271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8113d4413a02422ba6c8a2edb06a0d05'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:01.718278 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-77ec037f-1655-4471-b13d-d851ed390271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8113d4413a02422ba6c8a2edb06a0d05'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:01.731348 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-77ec037f-1655-4471-b13d-d851ed390271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8113d4413a02422ba6c8a2edb06a0d05'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:01.732157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-77ec037f-1655-4471-b13d-d851ed390271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8113d4413a02422ba6c8a2edb06a0d05'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:01.808233 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-77ec037f-1655-4471-b13d-d851ed390271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8113d4413a02422ba6c8a2edb06a0d05'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:01.815841 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 955/1936] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:29:01 2022] DELETE /identity/v3/users/8113d4413a02422ba6c8a2edb06a0d05 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:02.614720 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669a0d5-1ef0-495b-862e-c1cbd09369ce admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:02.620294 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-9669a0d5-1ef0-495b-862e-c1cbd09369ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:02.652866 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669a0d5-1ef0-495b-862e-c1cbd09369ce admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:02.697917 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec037f-1655-4471-b13d-d851ed390271 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:02.700301 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-77ec037f-1655-4471-b13d-d851ed390271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:02.827000 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cec93-a003-4370-82e1-ce3709c8f380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:02.828182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cec93-a003-4370-82e1-ce3709c8f380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:02.828615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cec93-a003-4370-82e1-ce3709c8f380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:02.829032 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cec93-a003-4370-82e1-ce3709c8f380 admin admin] PATH_INFO: `/v3/users/13545e448c8b4ac1b31b1636f0cd6d45` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:02.830648 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516cec93-a003-4370-82e1-ce3709c8f380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13545e448c8b4ac1b31b1636f0cd6d45)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:02.832973 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516cec93-a003-4370-82e1-ce3709c8f380 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:02.861683 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec037f-1655-4471-b13d-d851ed390271 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:02.867354 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986d2c3-73fa-4cfa-a6c1-cda76859274a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:02.868758 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986d2c3-73fa-4cfa-a6c1-cda76859274a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:02.869027 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986d2c3-73fa-4cfa-a6c1-cda76859274a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:02.869310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986d2c3-73fa-4cfa-a6c1-cda76859274a admin admin] PATH_INFO: `/v3/projects/3d86f0a044984dfd816554c526f45365` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:02.870609 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986d2c3-73fa-4cfa-a6c1-cda76859274a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d86f0a044984dfd816554c526f45365)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:02.872734 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986d2c3-73fa-4cfa-a6c1-cda76859274a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:03.039294 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-516cec93-a003-4370-82e1-ce3709c8f380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13545e448c8b4ac1b31b1636f0cd6d45'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:03.046106 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2986d2c3-73fa-4cfa-a6c1-cda76859274a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d86f0a044984dfd816554c526f45365', 'request_id': 'req-2986d2c3-73fa-4cfa-a6c1-cda76859274a'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:03.050880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:03.058145 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2986d2c3-73fa-4cfa-a6c1-cda76859274a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d86f0a044984dfd816554c526f45365', 'request_id': 'req-2986d2c3-73fa-4cfa-a6c1-cda76859274a'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:03.123752 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-516cec93-a003-4370-82e1-ce3709c8f380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13545e448c8b4ac1b31b1636f0cd6d45'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:03.142665 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-516cec93-a003-4370-82e1-ce3709c8f380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13545e448c8b4ac1b31b1636f0cd6d45'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:03.155717 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-516cec93-a003-4370-82e1-ce3709c8f380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13545e448c8b4ac1b31b1636f0cd6d45'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:03.158052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-516cec93-a003-4370-82e1-ce3709c8f380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13545e448c8b4ac1b31b1636f0cd6d45'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:03.165426 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 982/1937] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:29:02 2022] DELETE /identity/v3/users/13545e448c8b4ac1b31b1636f0cd6d45 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:03.166536 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cec93-a003-4370-82e1-ce3709c8f380 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:03.168152 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-516cec93-a003-4370-82e1-ce3709c8f380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:03.184806 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2986d2c3-73fa-4cfa-a6c1-cda76859274a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d86f0a044984dfd816554c526f45365', 'request_id': 'req-2986d2c3-73fa-4cfa-a6c1-cda76859274a'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:03.216036 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2986d2c3-73fa-4cfa-a6c1-cda76859274a admin admin] The token cache is being invalidate because project 3d86f0a044984dfd816554c526f45365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:29:03.216625 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2986d2c3-73fa-4cfa-a6c1-cda76859274a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:03.217570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2986d2c3-73fa-4cfa-a6c1-cda76859274a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:03.220411 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 956/1938] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:29:02 2022] DELETE /identity/v3/projects/3d86f0a044984dfd816554c526f45365 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:03.222235 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22944c-1038-48f4-8d1e-c23c7d5d13b2 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:03.222842 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22944c-1038-48f4-8d1e-c23c7d5d13b2 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:03.223515 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22944c-1038-48f4-8d1e-c23c7d5d13b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:03.252161 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-7e22944c-1038-48f4-8d1e-c23c7d5d13b2 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:03.253877 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7e22944c-1038-48f4-8d1e-c23c7d5d13b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:03.254099 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cec93-a003-4370-82e1-ce3709c8f380 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:03.257926 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68974651-be45-4f69-ae6c-82e251774986 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:03.258785 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68974651-be45-4f69-ae6c-82e251774986 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:03.259146 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68974651-be45-4f69-ae6c-82e251774986 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:03.259506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68974651-be45-4f69-ae6c-82e251774986 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:03.262010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-68974651-be45-4f69-ae6c-82e251774986 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:03.323678 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 957/1939] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:03.326994 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414600dd-c4bb-4d55-b04b-18ea8854ad85 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:03.326994 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414600dd-c4bb-4d55-b04b-18ea8854ad85 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:03.326994 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414600dd-c4bb-4d55-b04b-18ea8854ad85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:03.345787 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-414600dd-c4bb-4d55-b04b-18ea8854ad85 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:03.347028 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-414600dd-c4bb-4d55-b04b-18ea8854ad85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:03.355395 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68974651-be45-4f69-ae6c-82e251774986 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:03.356931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68974651-be45-4f69-ae6c-82e251774986 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:03.358834 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 958/1940] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:03.360041 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414600dd-c4bb-4d55-b04b-18ea8854ad85 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:03.368876 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 983/1941] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:03.369887 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-414600dd-c4bb-4d55-b04b-18ea8854ad85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:03.370614 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe34e4b-13f6-4f56-96f9-031548b0815f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:03.371056 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe34e4b-13f6-4f56-96f9-031548b0815f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:03.371487 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe34e4b-13f6-4f56-96f9-031548b0815f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:03.401882 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-7fe34e4b-13f6-4f56-96f9-031548b0815f None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:03.403181 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7fe34e4b-13f6-4f56-96f9-031548b0815f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:03.412639 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 984/1942] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:03.417663 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe34e4b-13f6-4f56-96f9-031548b0815f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:03.427368 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe34e4b-13f6-4f56-96f9-031548b0815f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:03.432361 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51036e33-5d06-423a-8306-c7f9c02d0eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:03.433013 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51036e33-5d06-423a-8306-c7f9c02d0eaa admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:03.433292 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51036e33-5d06-423a-8306-c7f9c02d0eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:03.442229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51036e33-5d06-423a-8306-c7f9c02d0eaa admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:03.442229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51036e33-5d06-423a-8306-c7f9c02d0eaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:29:03.442229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51036e33-5d06-423a-8306-c7f9c02d0eaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:03.442229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51036e33-5d06-423a-8306-c7f9c02d0eaa admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:03.442526 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414600dd-c4bb-4d55-b04b-18ea8854ad85 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:03.442526 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b30d1-c858-44bd-b784-cb2c257b0645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:03.442737 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b30d1-c858-44bd-b784-cb2c257b0645 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:03.443018 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b30d1-c858-44bd-b784-cb2c257b0645 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:03.443298 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b30d1-c858-44bd-b784-cb2c257b0645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:03.447785 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 985/1943] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:29:03.451995 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51036e33-5d06-423a-8306-c7f9c02d0eaa admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:03.453056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b30d1-c858-44bd-b784-cb2c257b0645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:03.454640 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b30d1-c858-44bd-b784-cb2c257b0645 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:03.462326 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51036e33-5d06-423a-8306-c7f9c02d0eaa admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:03.465488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 959/1944] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:03.470862 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04dc88-c72e-4566-a8ca-45ed0fb99cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:03.470862 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04dc88-c72e-4566-a8ca-45ed0fb99cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:03.470862 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04dc88-c72e-4566-a8ca-45ed0fb99cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:03.470862 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04dc88-c72e-4566-a8ca-45ed0fb99cc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:03.471237 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04dc88-c72e-4566-a8ca-45ed0fb99cc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:03.471237 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04dc88-c72e-4566-a8ca-45ed0fb99cc8 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:03.501630 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:03.574575 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 986/1945] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:29:03 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:29:03.578566 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b30d1-c858-44bd-b784-cb2c257b0645 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:03.588688 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b30d1-c858-44bd-b784-cb2c257b0645 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:03.711303 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e8db3-87db-402b-9971-1728b773b832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:03.716087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e8db3-87db-402b-9971-1728b773b832 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:03.716087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e8db3-87db-402b-9971-1728b773b832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:03.716087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e8db3-87db-402b-9971-1728b773b832 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:03.716608 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e8db3-87db-402b-9971-1728b773b832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:03.721935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e8db3-87db-402b-9971-1728b773b832 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:03.834542 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04dc88-c72e-4566-a8ca-45ed0fb99cc8 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:03.837531 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8d04dc88-c72e-4566-a8ca-45ed0fb99cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:03.850416 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 960/1946] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:29:03 2022] POST /identity/v3/users => generated 290 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:03.856900 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e8db3-87db-402b-9971-1728b773b832 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:03.866811 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04dc88-c72e-4566-a8ca-45ed0fb99cc8 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:03.872945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e360d21-442a-4c56-a4c5-fa7b47e8410f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:03.874172 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e360d21-442a-4c56-a4c5-fa7b47e8410f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:03.874464 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e360d21-442a-4c56-a4c5-fa7b47e8410f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:03.874897 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e360d21-442a-4c56-a4c5-fa7b47e8410f admin admin] PATH_INFO: `/v3/users/bdf5fe65b11b43c68908cc8b1f80ff80` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:03.876411 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e360d21-442a-4c56-a4c5-fa7b47e8410f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdf5fe65b11b43c68908cc8b1f80ff80)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:03.877657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e8db3-87db-402b-9971-1728b773b832 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:03.882695 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e360d21-442a-4c56-a4c5-fa7b47e8410f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:03.890856 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b995b-defb-4126-b90f-3767299584ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:03.892119 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b995b-defb-4126-b90f-3767299584ed admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:03.892615 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b995b-defb-4126-b90f-3767299584ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:03.892897 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b995b-defb-4126-b90f-3767299584ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:03.897125 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b995b-defb-4126-b90f-3767299584ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:03.899741 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b995b-defb-4126-b90f-3767299584ed admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:03.912507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 961/1947] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:29:03.916820 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b995b-defb-4126-b90f-3767299584ed admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:03.926427 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b995b-defb-4126-b90f-3767299584ed admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:03.932063 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8270ccd-15f5-4226-bdb1-220fe3a67cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:03.932714 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8270ccd-15f5-4226-bdb1-220fe3a67cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:03.932996 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8270ccd-15f5-4226-bdb1-220fe3a67cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:03.933291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8270ccd-15f5-4226-bdb1-220fe3a67cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:03.933997 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8270ccd-15f5-4226-bdb1-220fe3a67cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:03.935634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8270ccd-15f5-4226-bdb1-220fe3a67cc4 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:03.946474 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 962/1948] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:29:03.950503 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8270ccd-15f5-4226-bdb1-220fe3a67cc4 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:03.961128 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8270ccd-15f5-4226-bdb1-220fe3a67cc4 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:03.973109 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f05f6-7397-4d3c-aed7-d75a132cec50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:03.973109 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f05f6-7397-4d3c-aed7-d75a132cec50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:03.973109 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f05f6-7397-4d3c-aed7-d75a132cec50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:03.973109 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f05f6-7397-4d3c-aed7-d75a132cec50 admin admin] PATH_INFO: `/v3/projects/a3aacb1e996b4187a29e0d4d9477d078/users/e96565d429934cdaaee549bebb071fb6/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:03.984030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f05f6-7397-4d3c-aed7-d75a132cec50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3aacb1e996b4187a29e0d4d9477d078, user_id=e96565d429934cdaaee549bebb071fb6, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:03.986871 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f05f6-7397-4d3c-aed7-d75a132cec50 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:04.083120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 963/1949] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:03 2022] PUT /identity/v3/projects/a3aacb1e996b4187a29e0d4d9477d078/users/e96565d429934cdaaee549bebb071fb6/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:29:04.084143 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f05f6-7397-4d3c-aed7-d75a132cec50 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:04.085737 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ee0f05f6-7397-4d3c-aed7-d75a132cec50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:04.099243 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-1e360d21-442a-4c56-a4c5-fa7b47e8410f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdf5fe65b11b43c68908cc8b1f80ff80'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:04.151924 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f05f6-7397-4d3c-aed7-d75a132cec50 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:04.155982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e1009-be03-4a2b-8396-ba5df658c43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:04.156846 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e1009-be03-4a2b-8396-ba5df658c43a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:04.157127 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e1009-be03-4a2b-8396-ba5df658c43a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:04.157405 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e1009-be03-4a2b-8396-ba5df658c43a admin admin] PATH_INFO: `/v3/projects/ce592c24d392483293dc6a9f100e568c` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:04.158620 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e1009-be03-4a2b-8396-ba5df658c43a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce592c24d392483293dc6a9f100e568c)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:04.160528 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e1009-be03-4a2b-8396-ba5df658c43a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:04.198451 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-1e360d21-442a-4c56-a4c5-fa7b47e8410f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdf5fe65b11b43c68908cc8b1f80ff80'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:04.212587 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-1e360d21-442a-4c56-a4c5-fa7b47e8410f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdf5fe65b11b43c68908cc8b1f80ff80'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:04.220939 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-1e360d21-442a-4c56-a4c5-fa7b47e8410f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdf5fe65b11b43c68908cc8b1f80ff80'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:04.222103 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-1e360d21-442a-4c56-a4c5-fa7b47e8410f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdf5fe65b11b43c68908cc8b1f80ff80'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:04.241344 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 987/1950] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:29:03 2022] DELETE /identity/v3/users/bdf5fe65b11b43c68908cc8b1f80ff80 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:29:04.241344 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99c869-2ead-4dcf-92f4-30d7e1d59cc6 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:04.241344 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99c869-2ead-4dcf-92f4-30d7e1d59cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:04.241344 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99c869-2ead-4dcf-92f4-30d7e1d59cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:04.261248 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-dd99c869-2ead-4dcf-92f4-30d7e1d59cc6 None None] MFA Rules not processed for user `e96565d429934cdaaee549bebb071fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:04.262502 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-dd99c869-2ead-4dcf-92f4-30d7e1d59cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:04.316160 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-a40e1009-be03-4a2b-8396-ba5df658c43a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce592c24d392483293dc6a9f100e568c', 'request_id': 'req-a40e1009-be03-4a2b-8396-ba5df658c43a'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:04.322928 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-a40e1009-be03-4a2b-8396-ba5df658c43a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce592c24d392483293dc6a9f100e568c', 'request_id': 'req-a40e1009-be03-4a2b-8396-ba5df658c43a'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:04.338200 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 988/1951] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:04.338200 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d300d7-15e1-48b9-b98a-8c61e5de5bb8 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:04.338200 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d300d7-15e1-48b9-b98a-8c61e5de5bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:04.338200 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d300d7-15e1-48b9-b98a-8c61e5de5bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:04.355419 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e1d300d7-15e1-48b9-b98a-8c61e5de5bb8 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:04.356610 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e1d300d7-15e1-48b9-b98a-8c61e5de5bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:04.422049 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 989/1952] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:04.425550 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d300d7-15e1-48b9-b98a-8c61e5de5bb8 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:04.425550 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e1d300d7-15e1-48b9-b98a-8c61e5de5bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:04.436501 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d300d7-15e1-48b9-b98a-8c61e5de5bb8 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:04.438544 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-a40e1009-be03-4a2b-8396-ba5df658c43a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce592c24d392483293dc6a9f100e568c', 'request_id': 'req-a40e1009-be03-4a2b-8396-ba5df658c43a'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:04.451552 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-a40e1009-be03-4a2b-8396-ba5df658c43a admin admin] The token cache is being invalidate because project ce592c24d392483293dc6a9f100e568c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:29:04.451873 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-a40e1009-be03-4a2b-8396-ba5df658c43a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:04.452267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9997607-d270-432f-881e-55e98e42aa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:04.452490 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-a40e1009-be03-4a2b-8396-ba5df658c43a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:04.452974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9997607-d270-432f-881e-55e98e42aa87 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:04.453906 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9997607-d270-432f-881e-55e98e42aa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:04.454221 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9997607-d270-432f-881e-55e98e42aa87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:04.455059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9997607-d270-432f-881e-55e98e42aa87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:04.457174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 964/1953] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:29:04 2022] DELETE /identity/v3/projects/ce592c24d392483293dc6a9f100e568c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:04.457391 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9997607-d270-432f-881e-55e98e42aa87 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:04.458296 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e1009-be03-4a2b-8396-ba5df658c43a admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:04.459942 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a40e1009-be03-4a2b-8396-ba5df658c43a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:04.537369 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e1009-be03-4a2b-8396-ba5df658c43a admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:04.543465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1764b-61a6-4d76-8f63-fb6491fcac66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:04.544151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1764b-61a6-4d76-8f63-fb6491fcac66 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:04.544517 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1764b-61a6-4d76-8f63-fb6491fcac66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:04.544868 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1764b-61a6-4d76-8f63-fb6491fcac66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:04.548119 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-30f1764b-61a6-4d76-8f63-fb6491fcac66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:04.562164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1764b-61a6-4d76-8f63-fb6491fcac66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:04.563563 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1764b-61a6-4d76-8f63-fb6491fcac66 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:04.576856 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 965/1954] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:04.577555 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1764b-61a6-4d76-8f63-fb6491fcac66 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:04.579405 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-30f1764b-61a6-4d76-8f63-fb6491fcac66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:04.591380 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 990/1955] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:29:04 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:04.595310 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9997607-d270-432f-881e-55e98e42aa87 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:04.597369 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a9997607-d270-432f-881e-55e98e42aa87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:04.600288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1764b-61a6-4d76-8f63-fb6491fcac66 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:04.702883 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9997607-d270-432f-881e-55e98e42aa87 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:04.703376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f58e37-7064-4c3f-82eb-decd01e0ba02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:04.704770 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f58e37-7064-4c3f-82eb-decd01e0ba02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:04.705310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f58e37-7064-4c3f-82eb-decd01e0ba02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:04.705758 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f58e37-7064-4c3f-82eb-decd01e0ba02 admin admin] PATH_INFO: `/v3/users/187b3caf204e49119b56aae5f41c70f5` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:04.707388 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f58e37-7064-4c3f-82eb-decd01e0ba02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=187b3caf204e49119b56aae5f41c70f5)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:04.709638 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f58e37-7064-4c3f-82eb-decd01e0ba02 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:04.710578 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3257f7a-4a3d-4819-b93c-5a364f1dd61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:04.712180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3257f7a-4a3d-4819-b93c-5a364f1dd61e admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:04.712649 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3257f7a-4a3d-4819-b93c-5a364f1dd61e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:04.712936 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3257f7a-4a3d-4819-b93c-5a364f1dd61e admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:04.714155 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3257f7a-4a3d-4819-b93c-5a364f1dd61e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:04.716963 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3257f7a-4a3d-4819-b93c-5a364f1dd61e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:04.813705 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 991/1956] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:29:04 2022] POST /identity/v3/users => generated 290 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:04.815048 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3257f7a-4a3d-4819-b93c-5a364f1dd61e admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:04.825646 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3257f7a-4a3d-4819-b93c-5a364f1dd61e admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:04.830721 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a402bd2-076e-47ce-add4-1c8a83dfb3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:04.831397 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a402bd2-076e-47ce-add4-1c8a83dfb3fe admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:04.831684 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a402bd2-076e-47ce-add4-1c8a83dfb3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:04.831961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a402bd2-076e-47ce-add4-1c8a83dfb3fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:04.832807 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a402bd2-076e-47ce-add4-1c8a83dfb3fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:04.834518 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a402bd2-076e-47ce-add4-1c8a83dfb3fe admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:04.847217 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 992/1957] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:29:04.851206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a402bd2-076e-47ce-add4-1c8a83dfb3fe admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:04.865915 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a402bd2-076e-47ce-add4-1c8a83dfb3fe admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:04.874414 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc00f9-1c70-4ce8-abd4-a12d0d0cd1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:04.875347 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc00f9-1c70-4ce8-abd4-a12d0d0cd1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:04.875797 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc00f9-1c70-4ce8-abd4-a12d0d0cd1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:04.876455 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc00f9-1c70-4ce8-abd4-a12d0d0cd1b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:04.879040 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc00f9-1c70-4ce8-abd4-a12d0d0cd1b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:04.880745 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc00f9-1c70-4ce8-abd4-a12d0d0cd1b9 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:04.894385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 993/1958] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:29:04.900011 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc00f9-1c70-4ce8-abd4-a12d0d0cd1b9 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:04.910833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc00f9-1c70-4ce8-abd4-a12d0d0cd1b9 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:04.916704 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c710d-3d1a-4948-adce-abff801cc300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:04.917609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c710d-3d1a-4948-adce-abff801cc300 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:04.917899 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c710d-3d1a-4948-adce-abff801cc300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:04.918210 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c710d-3d1a-4948-adce-abff801cc300 admin admin] PATH_INFO: `/v3/projects/9d29f99614d14d42b76370752eb277a7/users/283a808d9d2e4e2d84d4b28bb0c1a84e/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:04.936190 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c710d-3d1a-4948-adce-abff801cc300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d29f99614d14d42b76370752eb277a7, user_id=283a808d9d2e4e2d84d4b28bb0c1a84e, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:04.939668 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:04.940145 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c710d-3d1a-4948-adce-abff801cc300 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:05.002771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e1f58e37-7064-4c3f-82eb-decd01e0ba02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '187b3caf204e49119b56aae5f41c70f5'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:05.009983 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e1f58e37-7064-4c3f-82eb-decd01e0ba02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '187b3caf204e49119b56aae5f41c70f5'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:05.026354 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e1f58e37-7064-4c3f-82eb-decd01e0ba02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '187b3caf204e49119b56aae5f41c70f5'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:05.027091 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e1f58e37-7064-4c3f-82eb-decd01e0ba02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '187b3caf204e49119b56aae5f41c70f5'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:05.038385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 994/1959] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:04 2022] PUT /identity/v3/projects/9d29f99614d14d42b76370752eb277a7/users/283a808d9d2e4e2d84d4b28bb0c1a84e/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:05.048989 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a417c-a3ce-4510-9ac2-21f259536c46 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:05.049305 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a417c-a3ce-4510-9ac2-21f259536c46 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:05.049573 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a417c-a3ce-4510-9ac2-21f259536c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:05.076408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-6f5a417c-a3ce-4510-9ac2-21f259536c46 None None] MFA Rules not processed for user `283a808d9d2e4e2d84d4b28bb0c1a84e`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:05.077608 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6f5a417c-a3ce-4510-9ac2-21f259536c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:05.106755 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e1f58e37-7064-4c3f-82eb-decd01e0ba02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '187b3caf204e49119b56aae5f41c70f5'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:05.113536 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 966/1960] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:29:04 2022] DELETE /identity/v3/users/187b3caf204e49119b56aae5f41c70f5 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:05.117544 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f58e37-7064-4c3f-82eb-decd01e0ba02 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:05.119558 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e1f58e37-7064-4c3f-82eb-decd01e0ba02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:05.158940 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 995/1961] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:29:05.160603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a417c-a3ce-4510-9ac2-21f259536c46 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:05.162801 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6f5a417c-a3ce-4510-9ac2-21f259536c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:05.211016 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f58e37-7064-4c3f-82eb-decd01e0ba02 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:05.216575 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9b477-175a-48f1-b5fe-f1babb90a401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:05.217454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9b477-175a-48f1-b5fe-f1babb90a401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:05.217736 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9b477-175a-48f1-b5fe-f1babb90a401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:05.218006 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9b477-175a-48f1-b5fe-f1babb90a401 admin admin] PATH_INFO: `/v3/projects/6b5d28a265584778997b5912750c43f6` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:05.219235 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9b477-175a-48f1-b5fe-f1babb90a401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b5d28a265584778997b5912750c43f6)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:05.221142 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9b477-175a-48f1-b5fe-f1babb90a401 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:05.239036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a417c-a3ce-4510-9ac2-21f259536c46 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:05.244385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9fee5-5d3b-40bd-9627-23c9ce766388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:05.245185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9fee5-5d3b-40bd-9627-23c9ce766388 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:05.245640 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9fee5-5d3b-40bd-9627-23c9ce766388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:05.246032 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9fee5-5d3b-40bd-9627-23c9ce766388 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:05.246928 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9fee5-5d3b-40bd-9627-23c9ce766388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:05.252490 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9fee5-5d3b-40bd-9627-23c9ce766388 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:05.357517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 996/1962] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:29:05 2022] POST /identity/v3/projects => generated 375 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:05.361319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9fee5-5d3b-40bd-9627-23c9ce766388 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:05.384812 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-30a9b477-175a-48f1-b5fe-f1babb90a401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b5d28a265584778997b5912750c43f6', 'request_id': 'req-30a9b477-175a-48f1-b5fe-f1babb90a401'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:05.393375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-30a9b477-175a-48f1-b5fe-f1babb90a401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b5d28a265584778997b5912750c43f6', 'request_id': 'req-30a9b477-175a-48f1-b5fe-f1babb90a401'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:05.457204 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9fee5-5d3b-40bd-9627-23c9ce766388 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:05.462637 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d759637-6063-430b-9143-830eb1ca2fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:05.463325 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d759637-6063-430b-9143-830eb1ca2fcb admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:05.463616 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d759637-6063-430b-9143-830eb1ca2fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:05.463898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d759637-6063-430b-9143-830eb1ca2fcb admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:05.464595 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d759637-6063-430b-9143-830eb1ca2fcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:05.466694 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d759637-6063-430b-9143-830eb1ca2fcb admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:05.472507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-30a9b477-175a-48f1-b5fe-f1babb90a401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b5d28a265584778997b5912750c43f6', 'request_id': 'req-30a9b477-175a-48f1-b5fe-f1babb90a401'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:05.485744 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-30a9b477-175a-48f1-b5fe-f1babb90a401 admin admin] The token cache is being invalidate because project 6b5d28a265584778997b5912750c43f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:29:05.486035 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-30a9b477-175a-48f1-b5fe-f1babb90a401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:05.486750 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-30a9b477-175a-48f1-b5fe-f1babb90a401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:05.488416 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 967/1963] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:29:05 2022] DELETE /identity/v3/projects/6b5d28a265584778997b5912750c43f6 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:05.492838 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9b477-175a-48f1-b5fe-f1babb90a401 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:05.495297 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-30a9b477-175a-48f1-b5fe-f1babb90a401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:05.501382 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:05.562090 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9b477-175a-48f1-b5fe-f1babb90a401 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:05.568612 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509b4de-4fdc-433c-b0c2-63a9138c6b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:05.569797 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509b4de-4fdc-433c-b0c2-63a9138c6b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:05.570479 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509b4de-4fdc-433c-b0c2-63a9138c6b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:05.570479 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509b4de-4fdc-433c-b0c2-63a9138c6b49 admin admin] PATH_INFO: `/v3/users/5b7d5fd9f197432fb5624a4813f95407` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:05.571948 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509b4de-4fdc-433c-b0c2-63a9138c6b49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b7d5fd9f197432fb5624a4813f95407)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:05.576464 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509b4de-4fdc-433c-b0c2-63a9138c6b49 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:05.612990 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 997/1964] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:29:05 2022] POST /identity/v3/users => generated 294 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:29:05.624571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d759637-6063-430b-9143-830eb1ca2fcb admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:05.627569 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5d759637-6063-430b-9143-830eb1ca2fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:05.640831 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d759637-6063-430b-9143-830eb1ca2fcb admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:05.645918 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132b1bd-5094-4e89-873c-032d58a89e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:05.646784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132b1bd-5094-4e89-873c-032d58a89e3f admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:05.647072 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132b1bd-5094-4e89-873c-032d58a89e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:05.647345 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132b1bd-5094-4e89-873c-032d58a89e3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:05.648076 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132b1bd-5094-4e89-873c-032d58a89e3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:05.650678 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132b1bd-5094-4e89-873c-032d58a89e3f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:05.665677 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 998/1965] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:29:05.669517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132b1bd-5094-4e89-873c-032d58a89e3f admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:05.681101 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132b1bd-5094-4e89-873c-032d58a89e3f admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:05.686646 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb8b2a-e692-4a3e-97b2-fd776e8503b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:05.687709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb8b2a-e692-4a3e-97b2-fd776e8503b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:05.688109 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb8b2a-e692-4a3e-97b2-fd776e8503b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:05.688490 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb8b2a-e692-4a3e-97b2-fd776e8503b4 admin admin] PATH_INFO: `/v3/projects/854b0d57df0e4aeba2b1a21bbb7d1cde/users/da2384dc3ccd487d898ac12d0588d23d/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:05.705377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb8b2a-e692-4a3e-97b2-fd776e8503b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=854b0d57df0e4aeba2b1a21bbb7d1cde, user_id=da2384dc3ccd487d898ac12d0588d23d, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:05.708659 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb8b2a-e692-4a3e-97b2-fd776e8503b4 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:05.835265 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 999/1966] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:05 2022] PUT /identity/v3/projects/854b0d57df0e4aeba2b1a21bbb7d1cde/users/da2384dc3ccd487d898ac12d0588d23d/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:05.837668 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb8b2a-e692-4a3e-97b2-fd776e8503b4 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:05.841311 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-56bb8b2a-e692-4a3e-97b2-fd776e8503b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:05.873218 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c509b4de-4fdc-433c-b0c2-63a9138c6b49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b7d5fd9f197432fb5624a4813f95407'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:05.882076 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c509b4de-4fdc-433c-b0c2-63a9138c6b49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b7d5fd9f197432fb5624a4813f95407'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:05.900461 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c509b4de-4fdc-433c-b0c2-63a9138c6b49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b7d5fd9f197432fb5624a4813f95407'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:05.901429 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c509b4de-4fdc-433c-b0c2-63a9138c6b49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b7d5fd9f197432fb5624a4813f95407'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:05.919420 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb8b2a-e692-4a3e-97b2-fd776e8503b4 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:05.926753 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6a187-49b3-4a8b-8c9f-6a138abae597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:05.926753 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6a187-49b3-4a8b-8c9f-6a138abae597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:05.926753 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6a187-49b3-4a8b-8c9f-6a138abae597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:05.926753 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6a187-49b3-4a8b-8c9f-6a138abae597 admin admin] PATH_INFO: `/v3/projects/339322e7aa664e838c496bbbbeda8185` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:05.927970 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6a187-49b3-4a8b-8c9f-6a138abae597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=339322e7aa664e838c496bbbbeda8185)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:05.929942 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6a187-49b3-4a8b-8c9f-6a138abae597 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:05.967566 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c509b4de-4fdc-433c-b0c2-63a9138c6b49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b7d5fd9f197432fb5624a4813f95407'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:05.974213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 968/1967] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:29:05 2022] DELETE /identity/v3/users/5b7d5fd9f197432fb5624a4813f95407 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:05.975078 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509b4de-4fdc-433c-b0c2-63a9138c6b49 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:05.976912 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c509b4de-4fdc-433c-b0c2-63a9138c6b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:06.056981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509b4de-4fdc-433c-b0c2-63a9138c6b49 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:06.064747 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-03a6a187-49b3-4a8b-8c9f-6a138abae597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '339322e7aa664e838c496bbbbeda8185', 'request_id': 'req-03a6a187-49b3-4a8b-8c9f-6a138abae597'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:06.132709 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ace3d9-8dc7-40b7-831e-c8e72fa49d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:06.134480 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ace3d9-8dc7-40b7-831e-c8e72fa49d21 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:06.134770 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ace3d9-8dc7-40b7-831e-c8e72fa49d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:06.135051 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ace3d9-8dc7-40b7-831e-c8e72fa49d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:06.135921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ace3d9-8dc7-40b7-831e-c8e72fa49d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:06.137634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ace3d9-8dc7-40b7-831e-c8e72fa49d21 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:06.151997 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 969/1968] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:06.153617 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ace3d9-8dc7-40b7-831e-c8e72fa49d21 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:06.166532 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ace3d9-8dc7-40b7-831e-c8e72fa49d21 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:06.168148 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-03a6a187-49b3-4a8b-8c9f-6a138abae597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '339322e7aa664e838c496bbbbeda8185', 'request_id': 'req-03a6a187-49b3-4a8b-8c9f-6a138abae597'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:06.175048 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-03a6a187-49b3-4a8b-8c9f-6a138abae597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '339322e7aa664e838c496bbbbeda8185', 'request_id': 'req-03a6a187-49b3-4a8b-8c9f-6a138abae597'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:06.179159 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c794c5-31eb-4b8c-826d-31464ce4affa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:06.180198 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c794c5-31eb-4b8c-826d-31464ce4affa admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:06.180929 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c794c5-31eb-4b8c-826d-31464ce4affa admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:06.181507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c794c5-31eb-4b8c-826d-31464ce4affa admin admin] PATH_INFO: `/v3/projects/854b0d57df0e4aeba2b1a21bbb7d1cde/users/da2384dc3ccd487d898ac12d0588d23d/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:06.184339 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c794c5-31eb-4b8c-826d-31464ce4affa admin admin] RBAC: Authorizing `identity:create_grant(project_id=854b0d57df0e4aeba2b1a21bbb7d1cde, user_id=da2384dc3ccd487d898ac12d0588d23d, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:06.187520 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c794c5-31eb-4b8c-826d-31464ce4affa admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:06.187927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-03a6a187-49b3-4a8b-8c9f-6a138abae597 admin admin] The token cache is being invalidate because project 339322e7aa664e838c496bbbbeda8185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:29:06.188232 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-03a6a187-49b3-4a8b-8c9f-6a138abae597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:06.188968 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-03a6a187-49b3-4a8b-8c9f-6a138abae597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:06.190823 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1000/1969] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:29:05 2022] DELETE /identity/v3/projects/339322e7aa664e838c496bbbbeda8185 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:06.196718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a902f92-aad2-4628-ab03-eff7b047d114 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:06.197012 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a902f92-aad2-4628-ab03-eff7b047d114 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:06.197292 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a902f92-aad2-4628-ab03-eff7b047d114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:06.214217 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 970/1970] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:06 2022] PUT /identity/v3/projects/854b0d57df0e4aeba2b1a21bbb7d1cde/users/da2384dc3ccd487d898ac12d0588d23d/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:29:06.220229 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef133f-dfc7-4eeb-b73b-dd7c64d66cc5 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:06.220229 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef133f-dfc7-4eeb-b73b-dd7c64d66cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:06.220229 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef133f-dfc7-4eeb-b73b-dd7c64d66cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:06.241418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-2a902f92-aad2-4628-ab03-eff7b047d114 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:06.245058 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2a902f92-aad2-4628-ab03-eff7b047d114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:06.270297 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-5cef133f-dfc7-4eeb-b73b-dd7c64d66cc5 None None] MFA Rules not processed for user `da2384dc3ccd487d898ac12d0588d23d`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:06.271959 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5cef133f-dfc7-4eeb-b73b-dd7c64d66cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:06.324097 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1001/1971] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:06.331420 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b953c7b-bcc6-4892-b237-b52a91afbd7b None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:06.331990 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b953c7b-bcc6-4892-b237-b52a91afbd7b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:06.332371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b953c7b-bcc6-4892-b237-b52a91afbd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:06.378795 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0b953c7b-bcc6-4892-b237-b52a91afbd7b None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:06.382070 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0b953c7b-bcc6-4892-b237-b52a91afbd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:06.382805 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 971/1972] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:06.403380 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef133f-dfc7-4eeb-b73b-dd7c64d66cc5 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:06.405081 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5cef133f-dfc7-4eeb-b73b-dd7c64d66cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:06.409039 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1002/1973] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:06.410576 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b953c7b-bcc6-4892-b237-b52a91afbd7b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:06.425638 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b953c7b-bcc6-4892-b237-b52a91afbd7b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:06.431556 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25362254-4273-49dc-b566-fe7bd8c59bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:06.432436 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25362254-4273-49dc-b566-fe7bd8c59bec admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:06.432866 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25362254-4273-49dc-b566-fe7bd8c59bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:06.433322 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25362254-4273-49dc-b566-fe7bd8c59bec admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:06.434370 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25362254-4273-49dc-b566-fe7bd8c59bec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:29:06.434999 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25362254-4273-49dc-b566-fe7bd8c59bec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:06.436623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25362254-4273-49dc-b566-fe7bd8c59bec admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:06.451056 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1003/1974] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:29:06.455279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25362254-4273-49dc-b566-fe7bd8c59bec admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:06.470662 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25362254-4273-49dc-b566-fe7bd8c59bec admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:06.476274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452d0f4-d4f5-47d4-bf55-dd31d46dce87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:06.477768 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452d0f4-d4f5-47d4-bf55-dd31d46dce87 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:06.480328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452d0f4-d4f5-47d4-bf55-dd31d46dce87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:06.480328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452d0f4-d4f5-47d4-bf55-dd31d46dce87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:06.480328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452d0f4-d4f5-47d4-bf55-dd31d46dce87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:06.481686 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452d0f4-d4f5-47d4-bf55-dd31d46dce87 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:06.503176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef133f-dfc7-4eeb-b73b-dd7c64d66cc5 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:06.507389 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee1b4d-df16-464d-8796-374ec6f698a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:06.508384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee1b4d-df16-464d-8796-374ec6f698a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:06.508944 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee1b4d-df16-464d-8796-374ec6f698a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:06.509632 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee1b4d-df16-464d-8796-374ec6f698a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:06.522630 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee1b4d-df16-464d-8796-374ec6f698a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:06.524938 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee1b4d-df16-464d-8796-374ec6f698a6 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:06.543012 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 972/1975] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:06 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:06.589544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1004/1976] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:29:06 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:29:06.602069 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee1b4d-df16-464d-8796-374ec6f698a6 service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:06.615118 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee1b4d-df16-464d-8796-374ec6f698a6 service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:06.689166 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452d0f4-d4f5-47d4-bf55-dd31d46dce87 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:06.692138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d452d0f4-d4f5-47d4-bf55-dd31d46dce87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:06.709092 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c82a4e-d7f7-4144-9f75-e5d9eea62412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:06.709939 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c82a4e-d7f7-4144-9f75-e5d9eea62412 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:06.710270 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c82a4e-d7f7-4144-9f75-e5d9eea62412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:06.710558 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c82a4e-d7f7-4144-9f75-e5d9eea62412 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:06.712165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c82a4e-d7f7-4144-9f75-e5d9eea62412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:06.714622 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c82a4e-d7f7-4144-9f75-e5d9eea62412 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:06.723108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452d0f4-d4f5-47d4-bf55-dd31d46dce87 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:06.731213 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e3a09-1c05-4457-ae75-fbd5db471556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:06.732092 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e3a09-1c05-4457-ae75-fbd5db471556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:06.732504 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e3a09-1c05-4457-ae75-fbd5db471556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:06.732789 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e3a09-1c05-4457-ae75-fbd5db471556 admin admin] PATH_INFO: `/v3/projects/47c0c5d51690429a9fcf20af9fa200df` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:06.734039 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e3a09-1c05-4457-ae75-fbd5db471556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47c0c5d51690429a9fcf20af9fa200df)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:06.736147 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e3a09-1c05-4457-ae75-fbd5db471556 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:06.804420 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 973/1977] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:29:06 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:06.805648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c82a4e-d7f7-4144-9f75-e5d9eea62412 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:06.808514 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-45c82a4e-d7f7-4144-9f75-e5d9eea62412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:06.890350 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6c2e3a09-1c05-4457-ae75-fbd5db471556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47c0c5d51690429a9fcf20af9fa200df', 'request_id': 'req-6c2e3a09-1c05-4457-ae75-fbd5db471556'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:06.930948 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c82a4e-d7f7-4144-9f75-e5d9eea62412 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:06.963828 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6c2e3a09-1c05-4457-ae75-fbd5db471556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47c0c5d51690429a9fcf20af9fa200df', 'request_id': 'req-6c2e3a09-1c05-4457-ae75-fbd5db471556'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:06.973035 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6c2e3a09-1c05-4457-ae75-fbd5db471556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47c0c5d51690429a9fcf20af9fa200df', 'request_id': 'req-6c2e3a09-1c05-4457-ae75-fbd5db471556'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:06.990389 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6c2e3a09-1c05-4457-ae75-fbd5db471556 admin admin] The token cache is being invalidate because project 47c0c5d51690429a9fcf20af9fa200df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:29:06.990684 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6c2e3a09-1c05-4457-ae75-fbd5db471556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:06.993701 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6c2e3a09-1c05-4457-ae75-fbd5db471556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:06.996174 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1005/1978] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:29:06 2022] DELETE /identity/v3/projects/47c0c5d51690429a9fcf20af9fa200df => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:06.997091 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e3a09-1c05-4457-ae75-fbd5db471556 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:07.000399 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6c2e3a09-1c05-4457-ae75-fbd5db471556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:07.006712 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf368d3b-addc-4f52-b744-8dd08666787a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:07.007732 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf368d3b-addc-4f52-b744-8dd08666787a service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:07.008088 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf368d3b-addc-4f52-b744-8dd08666787a service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:07.008474 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf368d3b-addc-4f52-b744-8dd08666787a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:07.012044 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-bf368d3b-addc-4f52-b744-8dd08666787a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:07.045296 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:07.092589 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:07.109277 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e3a09-1c05-4457-ae75-fbd5db471556 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:07.118268 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf368d3b-addc-4f52-b744-8dd08666787a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:07.119080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf368d3b-addc-4f52-b744-8dd08666787a service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:07.131271 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 974/1979] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:07.132605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2f570-fe18-42d4-88b0-d1798ce8a00a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:07.132997 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2f570-fe18-42d4-88b0-d1798ce8a00a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:07.134095 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2f570-fe18-42d4-88b0-d1798ce8a00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:07.146762 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3528006-271b-4955-9454-81e4a3676722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:07.154317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3528006-271b-4955-9454-81e4a3676722 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:07.154615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3528006-271b-4955-9454-81e4a3676722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:07.155089 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3528006-271b-4955-9454-81e4a3676722 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:07.159877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3528006-271b-4955-9454-81e4a3676722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:07.159994 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-1dc2f570-fe18-42d4-88b0-d1798ce8a00a None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:07.159994 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1dc2f570-fe18-42d4-88b0-d1798ce8a00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:07.164738 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3528006-271b-4955-9454-81e4a3676722 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:07.179021 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 975/1980] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:07.179021 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73469b2d-8c0e-4120-a456-4e75503c3143 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:07.179021 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73469b2d-8c0e-4120-a456-4e75503c3143 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:07.179021 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73469b2d-8c0e-4120-a456-4e75503c3143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:07.196487 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1006/1981] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:07.198459 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3528006-271b-4955-9454-81e4a3676722 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:07.212436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-73469b2d-8c0e-4120-a456-4e75503c3143 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:07.213801 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-73469b2d-8c0e-4120-a456-4e75503c3143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:07.221719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3528006-271b-4955-9454-81e4a3676722 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:07.227322 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 976/1982] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:07.228923 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73469b2d-8c0e-4120-a456-4e75503c3143 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:07.243961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789389f7-fdea-4eab-87d7-3a90228e9181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:07.244866 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789389f7-fdea-4eab-87d7-3a90228e9181 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:07.245151 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789389f7-fdea-4eab-87d7-3a90228e9181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:07.245429 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789389f7-fdea-4eab-87d7-3a90228e9181 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:07.246939 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789389f7-fdea-4eab-87d7-3a90228e9181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:07.248665 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789389f7-fdea-4eab-87d7-3a90228e9181 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:07.255624 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73469b2d-8c0e-4120-a456-4e75503c3143 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:07.261216 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1007/1983] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:07.265903 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789389f7-fdea-4eab-87d7-3a90228e9181 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:07.278654 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dee21f-6409-4eec-96a6-8b91d3c3e756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:07.279343 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dee21f-6409-4eec-96a6-8b91d3c3e756 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:07.279495 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789389f7-fdea-4eab-87d7-3a90228e9181 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:07.279674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dee21f-6409-4eec-96a6-8b91d3c3e756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:07.279910 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dee21f-6409-4eec-96a6-8b91d3c3e756 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:07.280646 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dee21f-6409-4eec-96a6-8b91d3c3e756 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:29:07.280955 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dee21f-6409-4eec-96a6-8b91d3c3e756 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:07.283816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dee21f-6409-4eec-96a6-8b91d3c3e756 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:07.288058 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb03739-7383-4b71-81ca-147f0513422b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:07.288058 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb03739-7383-4b71-81ca-147f0513422b admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:07.288058 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb03739-7383-4b71-81ca-147f0513422b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:07.288058 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb03739-7383-4b71-81ca-147f0513422b admin admin] PATH_INFO: `/v3/projects/5b7b1f1cfcdb42c2b62f51f1c1828ac6/users/743274d4733f405fa47ffa4705f111e0/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:07.308725 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb03739-7383-4b71-81ca-147f0513422b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b7b1f1cfcdb42c2b62f51f1c1828ac6, user_id=743274d4733f405fa47ffa4705f111e0, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:07.310436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 977/1984] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:29:07.312662 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb03739-7383-4b71-81ca-147f0513422b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:07.314422 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dee21f-6409-4eec-96a6-8b91d3c3e756 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:07.328150 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dee21f-6409-4eec-96a6-8b91d3c3e756 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:07.333269 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd7122-8f52-4ac4-846b-c16cd4b47013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:07.334259 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd7122-8f52-4ac4-846b-c16cd4b47013 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:07.334645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd7122-8f52-4ac4-846b-c16cd4b47013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:07.335044 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd7122-8f52-4ac4-846b-c16cd4b47013 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:07.335891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd7122-8f52-4ac4-846b-c16cd4b47013 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:07.338013 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd7122-8f52-4ac4-846b-c16cd4b47013 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:07.444494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1008/1985] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:07 2022] PUT /identity/v3/projects/5b7b1f1cfcdb42c2b62f51f1c1828ac6/users/743274d4733f405fa47ffa4705f111e0/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:07.458146 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa63bd4-6816-48ea-8622-82bd3d3b6bb1 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:07.459409 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa63bd4-6816-48ea-8622-82bd3d3b6bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:07.460028 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa63bd4-6816-48ea-8622-82bd3d3b6bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:07.490795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 978/1986] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:29:07 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:29:07.493316 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd7122-8f52-4ac4-846b-c16cd4b47013 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:07.521285 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-aaa63bd4-6816-48ea-8622-82bd3d3b6bb1 None None] MFA Rules not processed for user `743274d4733f405fa47ffa4705f111e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:07.522983 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-aaa63bd4-6816-48ea-8622-82bd3d3b6bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:07.636101 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd7122-8f52-4ac4-846b-c16cd4b47013 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:07.650367 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1009/1987] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:07.660784 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ca6a7-30a5-409f-9604-5c48181c5257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:07.661995 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ca6a7-30a5-409f-9604-5c48181c5257 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:07.661995 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ca6a7-30a5-409f-9604-5c48181c5257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:07.662252 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ca6a7-30a5-409f-9604-5c48181c5257 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:07.662931 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ca6a7-30a5-409f-9604-5c48181c5257 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:07.665209 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ca6a7-30a5-409f-9604-5c48181c5257 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:07.719877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa63bd4-6816-48ea-8622-82bd3d3b6bb1 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:07.721563 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-aaa63bd4-6816-48ea-8622-82bd3d3b6bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:07.728831 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:07.805126 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa63bd4-6816-48ea-8622-82bd3d3b6bb1 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:07.810502 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac17321-6d73-47a9-9878-40cb2859255a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:07.811423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac17321-6d73-47a9-9878-40cb2859255a service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:07.811544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac17321-6d73-47a9-9878-40cb2859255a service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:07.812064 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac17321-6d73-47a9-9878-40cb2859255a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:07.823525 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 979/1988] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:29:07 2022] POST /identity/v3/users => generated 291 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:07.824710 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ca6a7-30a5-409f-9604-5c48181c5257 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:07.838922 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac17321-6d73-47a9-9878-40cb2859255a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:07.841133 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac17321-6d73-47a9-9878-40cb2859255a service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:07.845371 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ca6a7-30a5-409f-9604-5c48181c5257 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:07.855146 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1010/1989] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:07.861291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fdb8a-861d-403e-a164-9b81939a8fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:07.862063 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fdb8a-861d-403e-a164-9b81939a8fad admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:07.862523 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fdb8a-861d-403e-a164-9b81939a8fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:07.862880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fdb8a-861d-403e-a164-9b81939a8fad admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:07.863736 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fdb8a-861d-403e-a164-9b81939a8fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:07.865459 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fdb8a-861d-403e-a164-9b81939a8fad admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:07.891356 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 980/1990] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:07.891562 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac17321-6d73-47a9-9878-40cb2859255a service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:07.916367 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac17321-6d73-47a9-9878-40cb2859255a service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:07.929733 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bcd63-1a52-4a87-aacc-73cd29d146df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:07.930491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bcd63-1a52-4a87-aacc-73cd29d146df admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:07.930773 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bcd63-1a52-4a87-aacc-73cd29d146df admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:07.931053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bcd63-1a52-4a87-aacc-73cd29d146df admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:07.931885 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bcd63-1a52-4a87-aacc-73cd29d146df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:07.933501 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bcd63-1a52-4a87-aacc-73cd29d146df admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:07.954537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1011/1991] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:07.958262 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fdb8a-861d-403e-a164-9b81939a8fad admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:07.976013 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fdb8a-861d-403e-a164-9b81939a8fad admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:07.986419 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21cef6-bf9f-46e6-abb8-eec338dfb3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:07.987440 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21cef6-bf9f-46e6-abb8-eec338dfb3be admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:07.987729 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21cef6-bf9f-46e6-abb8-eec338dfb3be admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:07.988014 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21cef6-bf9f-46e6-abb8-eec338dfb3be admin admin] PATH_INFO: `/v3/projects/ac319bf793e949f59e4266969c0b2031/users/31477d25fb1445709126ead27a380b26/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:08.006805 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21cef6-bf9f-46e6-abb8-eec338dfb3be admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac319bf793e949f59e4266969c0b2031, user_id=31477d25fb1445709126ead27a380b26, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:08.010489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21cef6-bf9f-46e6-abb8-eec338dfb3be admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:08.094734 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 981/1992] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:07 2022] PUT /identity/v3/projects/ac319bf793e949f59e4266969c0b2031/users/31477d25fb1445709126ead27a380b26/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:08.104792 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d917896-1164-4941-98f4-ff03b50ff762 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:08.105316 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d917896-1164-4941-98f4-ff03b50ff762 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:08.105409 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d917896-1164-4941-98f4-ff03b50ff762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:08.136317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-6d917896-1164-4941-98f4-ff03b50ff762 None None] MFA Rules not processed for user `31477d25fb1445709126ead27a380b26`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:08.137824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6d917896-1164-4941-98f4-ff03b50ff762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:08.217850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1012/1993] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:08.222273 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21cef6-bf9f-46e6-abb8-eec338dfb3be admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:08.290853 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:08.314339 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21cef6-bf9f-46e6-abb8-eec338dfb3be admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:08.332203 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b502328-94e3-497b-88dd-8eda8c56b274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:08.332757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b502328-94e3-497b-88dd-8eda8c56b274 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:08.333047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b502328-94e3-497b-88dd-8eda8c56b274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:08.333326 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b502328-94e3-497b-88dd-8eda8c56b274 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:08.334088 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b502328-94e3-497b-88dd-8eda8c56b274 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:08.336050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b502328-94e3-497b-88dd-8eda8c56b274 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:08.447522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 982/1994] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:29:08 2022] POST /identity/v3/projects => generated 379 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:08.451535 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d917896-1164-4941-98f4-ff03b50ff762 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:08.467899 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d917896-1164-4941-98f4-ff03b50ff762 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:08.548109 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735b002-3163-4287-b687-3c448cc6bad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:08.550303 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735b002-3163-4287-b687-3c448cc6bad2 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:08.550817 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735b002-3163-4287-b687-3c448cc6bad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:08.551252 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735b002-3163-4287-b687-3c448cc6bad2 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:08.552125 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735b002-3163-4287-b687-3c448cc6bad2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:08.554345 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735b002-3163-4287-b687-3c448cc6bad2 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:08.704300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1013/1995] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:29:08 2022] POST /identity/v3/users => generated 296 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:08.708032 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b502328-94e3-497b-88dd-8eda8c56b274 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:08.720857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b502328-94e3-497b-88dd-8eda8c56b274 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:08.726340 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0631e9-6215-45b8-81f0-fa0d9e1d4cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:08.727877 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0631e9-6215-45b8-81f0-fa0d9e1d4cfd admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:08.728278 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0631e9-6215-45b8-81f0-fa0d9e1d4cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:08.728682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0631e9-6215-45b8-81f0-fa0d9e1d4cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:08.729412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0631e9-6215-45b8-81f0-fa0d9e1d4cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:08.731311 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0631e9-6215-45b8-81f0-fa0d9e1d4cfd admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:08.746413 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 983/1996] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:08.749673 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735b002-3163-4287-b687-3c448cc6bad2 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:08.776588 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735b002-3163-4287-b687-3c448cc6bad2 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:08.784808 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072f724-1489-426d-89d3-22ea1ffdb894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:08.786189 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072f724-1489-426d-89d3-22ea1ffdb894 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:08.786482 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072f724-1489-426d-89d3-22ea1ffdb894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:08.786808 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072f724-1489-426d-89d3-22ea1ffdb894 admin admin] PATH_INFO: `/v3/projects/181e076878814c9ea3cc5885973fe742/users/f551f04a616246f28c55a8948e8588d3/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:08.813038 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072f724-1489-426d-89d3-22ea1ffdb894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=181e076878814c9ea3cc5885973fe742, user_id=f551f04a616246f28c55a8948e8588d3, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:08.819086 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072f724-1489-426d-89d3-22ea1ffdb894 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:08.944665 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:08.970014 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1014/1997] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:08 2022] PUT /identity/v3/projects/181e076878814c9ea3cc5885973fe742/users/f551f04a616246f28c55a8948e8588d3/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:29:08.971501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0631e9-6215-45b8-81f0-fa0d9e1d4cfd admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:08.993939 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0631e9-6215-45b8-81f0-fa0d9e1d4cfd admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:09.063630 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db876b-fc6d-4c8c-8657-8456983fa77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:09.064504 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db876b-fc6d-4c8c-8657-8456983fa77f admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:09.064793 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db876b-fc6d-4c8c-8657-8456983fa77f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:09.065070 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db876b-fc6d-4c8c-8657-8456983fa77f admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:09.065918 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db876b-fc6d-4c8c-8657-8456983fa77f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:09.068256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db876b-fc6d-4c8c-8657-8456983fa77f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:09.080712 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 984/1998] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:09.084849 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072f724-1489-426d-89d3-22ea1ffdb894 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:09.097555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072f724-1489-426d-89d3-22ea1ffdb894 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:09.106625 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc881f54-b371-4738-bad6-6bf3233affe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:09.107807 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc881f54-b371-4738-bad6-6bf3233affe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:09.108162 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc881f54-b371-4738-bad6-6bf3233affe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:09.108499 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc881f54-b371-4738-bad6-6bf3233affe4 admin admin] PATH_INFO: `/v3/projects/181e076878814c9ea3cc5885973fe742/users/f551f04a616246f28c55a8948e8588d3/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:09.114664 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc881f54-b371-4738-bad6-6bf3233affe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=181e076878814c9ea3cc5885973fe742, user_id=f551f04a616246f28c55a8948e8588d3, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:09.119363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc881f54-b371-4738-bad6-6bf3233affe4 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:09.136926 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1015/1999] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:09 2022] PUT /identity/v3/projects/181e076878814c9ea3cc5885973fe742/users/f551f04a616246f28c55a8948e8588d3/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:09.148102 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1446f-c8e4-448c-b8ab-6ec031a02bf0 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:09.148749 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1446f-c8e4-448c-b8ab-6ec031a02bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:09.149349 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1446f-c8e4-448c-b8ab-6ec031a02bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:09.186376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-a2a1446f-c8e4-448c-b8ab-6ec031a02bf0 None None] MFA Rules not processed for user `f551f04a616246f28c55a8948e8588d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:09.187721 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a2a1446f-c8e4-448c-b8ab-6ec031a02bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:09.278810 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 985/2000] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:09.292159 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc881f54-b371-4738-bad6-6bf3233affe4 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:09.294482 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-dc881f54-b371-4738-bad6-6bf3233affe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:09.320233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:09.372273 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc881f54-b371-4738-bad6-6bf3233affe4 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:09.377676 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af0e38-d794-4aca-9848-0a769e0f53c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:09.378386 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af0e38-d794-4aca-9848-0a769e0f53c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:09.378672 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af0e38-d794-4aca-9848-0a769e0f53c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:09.378951 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af0e38-d794-4aca-9848-0a769e0f53c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:09.394970 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af0e38-d794-4aca-9848-0a769e0f53c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:09.396464 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af0e38-d794-4aca-9848-0a769e0f53c0 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:09.409683 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1016/2001] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:09 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:09.863079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:10.375693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:10.654009 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1446f-c8e4-448c-b8ab-6ec031a02bf0 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:10.665147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1446f-c8e4-448c-b8ab-6ec031a02bf0 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:10.672157 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af0e38-d794-4aca-9848-0a769e0f53c0 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:10.673123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521b3b6-c12f-416d-839f-8b8f66a474f4 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f551f04a616246f28c55a8948e8588d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '181e076878814c9ea3cc5885973fe742', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:10.673946 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-04af0e38-d794-4aca-9848-0a769e0f53c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:10.674277 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521b3b6-c12f-416d-839f-8b8f66a474f4 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:10.674569 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521b3b6-c12f-416d-839f-8b8f66a474f4 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:10.674859 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521b3b6-c12f-416d-839f-8b8f66a474f4 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:10.675603 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521b3b6-c12f-416d-839f-8b8f66a474f4 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:29:10.675916 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521b3b6-c12f-416d-839f-8b8f66a474f4 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:10.677771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521b3b6-c12f-416d-839f-8b8f66a474f4 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:10.696049 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 986/2002] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:29:10.700009 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521b3b6-c12f-416d-839f-8b8f66a474f4 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:10.715294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521b3b6-c12f-416d-839f-8b8f66a474f4 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:10.721340 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84bc531-a8ce-42c6-bae0-f72eb5b9eb18 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f551f04a616246f28c55a8948e8588d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '181e076878814c9ea3cc5885973fe742', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:10.722223 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bc531-a8ce-42c6-bae0-f72eb5b9eb18 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:10.724870 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bc531-a8ce-42c6-bae0-f72eb5b9eb18 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:10.724870 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bc531-a8ce-42c6-bae0-f72eb5b9eb18 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:10.724870 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84bc531-a8ce-42c6-bae0-f72eb5b9eb18 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:10.726066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84bc531-a8ce-42c6-bae0-f72eb5b9eb18 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:10.766657 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af0e38-d794-4aca-9848-0a769e0f53c0 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:10.773057 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285113e-5f3a-4c5b-8a4c-896380403080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:10.774639 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285113e-5f3a-4c5b-8a4c-896380403080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:10.775096 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285113e-5f3a-4c5b-8a4c-896380403080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:10.775341 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285113e-5f3a-4c5b-8a4c-896380403080 admin admin] PATH_INFO: `/v3/users/0daa5f6bc29d402ab08440c024d7bbae` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:10.776588 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285113e-5f3a-4c5b-8a4c-896380403080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0daa5f6bc29d402ab08440c024d7bbae)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:10.778686 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285113e-5f3a-4c5b-8a4c-896380403080 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:10.854672 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 987/2003] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:29:10 2022] POST /identity/v3/projects => generated 353 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:10.858881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84bc531-a8ce-42c6-bae0-f72eb5b9eb18 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:10.925721 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84bc531-a8ce-42c6-bae0-f72eb5b9eb18 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:10.932832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9ccf8-980f-4e2c-bb13-48cde51f46f5 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f551f04a616246f28c55a8948e8588d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '181e076878814c9ea3cc5885973fe742', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:10.933862 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9ccf8-980f-4e2c-bb13-48cde51f46f5 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:10.934179 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9ccf8-980f-4e2c-bb13-48cde51f46f5 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:10.934462 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9ccf8-980f-4e2c-bb13-48cde51f46f5 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:10.935195 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9ccf8-980f-4e2c-bb13-48cde51f46f5 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:29:10.935504 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9ccf8-980f-4e2c-bb13-48cde51f46f5 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:10.937107 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9ccf8-980f-4e2c-bb13-48cde51f46f5 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:10.950540 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 988/2004] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:29:10.994026 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9ccf8-980f-4e2c-bb13-48cde51f46f5 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:11.004604 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9ccf8-980f-4e2c-bb13-48cde51f46f5 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:11.010389 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4ff81-625c-4d1d-91bb-c98b72846388 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f551f04a616246f28c55a8948e8588d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '181e076878814c9ea3cc5885973fe742', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:11.011274 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4ff81-625c-4d1d-91bb-c98b72846388 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:11.011550 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4ff81-625c-4d1d-91bb-c98b72846388 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:11.011829 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4ff81-625c-4d1d-91bb-c98b72846388 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] PATH_INFO: `/v3/projects/182a47dace3b40778a4d03bec01ef62d` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:11.016318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4ff81-625c-4d1d-91bb-c98b72846388 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] RBAC: Authorizing `identity:delete_project(project_id=182a47dace3b40778a4d03bec01ef62d)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:11.022496 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4ff81-625c-4d1d-91bb-c98b72846388 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:11.034341 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8285113e-5f3a-4c5b-8a4c-896380403080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0daa5f6bc29d402ab08440c024d7bbae'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:11.064416 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:11.115737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8285113e-5f3a-4c5b-8a4c-896380403080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0daa5f6bc29d402ab08440c024d7bbae'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:11.129218 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8285113e-5f3a-4c5b-8a4c-896380403080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0daa5f6bc29d402ab08440c024d7bbae'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:11.136825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8285113e-5f3a-4c5b-8a4c-896380403080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0daa5f6bc29d402ab08440c024d7bbae'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:11.137493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-8285113e-5f3a-4c5b-8a4c-896380403080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0daa5f6bc29d402ab08440c024d7bbae'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:11.143490 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1017/2005] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:29:10 2022] DELETE /identity/v3/users/0daa5f6bc29d402ab08440c024d7bbae => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:11.147747 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46430469-ff64-4080-8733-4edf66feb8d7 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:11.148040 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46430469-ff64-4080-8733-4edf66feb8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:11.148320 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46430469-ff64-4080-8733-4edf66feb8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:11.164753 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-46430469-ff64-4080-8733-4edf66feb8d7 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:11.166445 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-46430469-ff64-4080-8733-4edf66feb8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:11.186706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-86a4ff81-625c-4d1d-91bb-c98b72846388 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '182a47dace3b40778a4d03bec01ef62d', 'request_id': 'req-86a4ff81-625c-4d1d-91bb-c98b72846388'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:11.192000 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-86a4ff81-625c-4d1d-91bb-c98b72846388 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '182a47dace3b40778a4d03bec01ef62d', 'request_id': 'req-86a4ff81-625c-4d1d-91bb-c98b72846388'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:11.226791 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1018/2006] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:29:11.236959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46430469-ff64-4080-8733-4edf66feb8d7 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:11.238274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-46430469-ff64-4080-8733-4edf66feb8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:11.277049 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-86a4ff81-625c-4d1d-91bb-c98b72846388 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '182a47dace3b40778a4d03bec01ef62d', 'request_id': 'req-86a4ff81-625c-4d1d-91bb-c98b72846388'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:11.294325 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-86a4ff81-625c-4d1d-91bb-c98b72846388 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] The token cache is being invalidate because project 182a47dace3b40778a4d03bec01ef62d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:29:11.294698 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-86a4ff81-625c-4d1d-91bb-c98b72846388 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:11.295587 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-86a4ff81-625c-4d1d-91bb-c98b72846388 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:11.297999 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 989/2007] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:29:10 2022] DELETE /identity/v3/projects/182a47dace3b40778a4d03bec01ef62d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:29:11.307508 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46430469-ff64-4080-8733-4edf66feb8d7 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:11.369020 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c01bc8-b999-4b58-ae2b-d7fa132e52d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:11.369717 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c01bc8-b999-4b58-ae2b-d7fa132e52d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:11.369982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c01bc8-b999-4b58-ae2b-d7fa132e52d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:11.370299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c01bc8-b999-4b58-ae2b-d7fa132e52d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:11.372136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-58c01bc8-b999-4b58-ae2b-d7fa132e52d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:11.449014 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c01bc8-b999-4b58-ae2b-d7fa132e52d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:11.452857 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c01bc8-b999-4b58-ae2b-d7fa132e52d4 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:11.465608 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1019/2008] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:11.470104 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:12.078045 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4ff81-625c-4d1d-91bb-c98b72846388 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:12.079586 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-86a4ff81-625c-4d1d-91bb-c98b72846388 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:12.091888 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:12.097891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4ff81-625c-4d1d-91bb-c98b72846388 tempest-VolumeQuotaClassesTest-777686549 tempest-VolumeQuotaClassesTest-777686549-project-admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:12.106341 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e7f9f-7854-46fb-ae9b-5bcb175c47d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:12.107829 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e7f9f-7854-46fb-ae9b-5bcb175c47d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:12.108144 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e7f9f-7854-46fb-ae9b-5bcb175c47d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:12.108754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e7f9f-7854-46fb-ae9b-5bcb175c47d4 admin admin] PATH_INFO: `/v3/users/31477d25fb1445709126ead27a380b26` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:12.110193 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e7f9f-7854-46fb-ae9b-5bcb175c47d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31477d25fb1445709126ead27a380b26)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:12.112188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e7f9f-7854-46fb-ae9b-5bcb175c47d4 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:12.166464 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c01bc8-b999-4b58-ae2b-d7fa132e52d4 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:12.168283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-58c01bc8-b999-4b58-ae2b-d7fa132e52d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:12.180490 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c01bc8-b999-4b58-ae2b-d7fa132e52d4 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:12.186209 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4879890-072f-465a-ae8c-fdaab2f1b7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:12.187585 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4879890-072f-465a-ae8c-fdaab2f1b7ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:12.188203 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4879890-072f-465a-ae8c-fdaab2f1b7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:12.188499 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4879890-072f-465a-ae8c-fdaab2f1b7ab admin admin] PATH_INFO: `/v3/projects/d21a71e2b24b4ead881eef96b1636782` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:12.190219 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4879890-072f-465a-ae8c-fdaab2f1b7ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=d21a71e2b24b4ead881eef96b1636782)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:12.192756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4879890-072f-465a-ae8c-fdaab2f1b7ab admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:12.360374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e4879890-072f-465a-ae8c-fdaab2f1b7ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd21a71e2b24b4ead881eef96b1636782', 'request_id': 'req-e4879890-072f-465a-ae8c-fdaab2f1b7ab'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:12.362821 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b92e7f9f-7854-46fb-ae9b-5bcb175c47d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31477d25fb1445709126ead27a380b26'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:12.370638 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b92e7f9f-7854-46fb-ae9b-5bcb175c47d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31477d25fb1445709126ead27a380b26'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:12.383920 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b92e7f9f-7854-46fb-ae9b-5bcb175c47d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31477d25fb1445709126ead27a380b26'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:12.384737 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b92e7f9f-7854-46fb-ae9b-5bcb175c47d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31477d25fb1445709126ead27a380b26'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:12.429963 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e4879890-072f-465a-ae8c-fdaab2f1b7ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd21a71e2b24b4ead881eef96b1636782', 'request_id': 'req-e4879890-072f-465a-ae8c-fdaab2f1b7ab'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:12.437119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e4879890-072f-465a-ae8c-fdaab2f1b7ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd21a71e2b24b4ead881eef96b1636782', 'request_id': 'req-e4879890-072f-465a-ae8c-fdaab2f1b7ab'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:12.449221 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e4879890-072f-465a-ae8c-fdaab2f1b7ab admin admin] The token cache is being invalidate because project d21a71e2b24b4ead881eef96b1636782 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:29:12.450275 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e4879890-072f-465a-ae8c-fdaab2f1b7ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:12.451533 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e4879890-072f-465a-ae8c-fdaab2f1b7ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:12.456741 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1020/2009] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:29:12 2022] DELETE /identity/v3/projects/d21a71e2b24b4ead881eef96b1636782 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:29:12.457802 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4879890-072f-465a-ae8c-fdaab2f1b7ab admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:12.459517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e4879890-072f-465a-ae8c-fdaab2f1b7ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:12.523813 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-b92e7f9f-7854-46fb-ae9b-5bcb175c47d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31477d25fb1445709126ead27a380b26'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:12.527066 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4879890-072f-465a-ae8c-fdaab2f1b7ab admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:12.534620 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c243c7-831b-4aa4-9ec6-2df2f4e54414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:12.534787 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 990/2010] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:29:12 2022] DELETE /identity/v3/users/31477d25fb1445709126ead27a380b26 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:12.534886 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c243c7-831b-4aa4-9ec6-2df2f4e54414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:12.534995 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e7f9f-7854-46fb-ae9b-5bcb175c47d4 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:12.535083 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c243c7-831b-4aa4-9ec6-2df2f4e54414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:12.535083 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c243c7-831b-4aa4-9ec6-2df2f4e54414 admin admin] PATH_INFO: `/v3/users/9590cf43c93f439d89ff8034d931d617` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:12.535246 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b92e7f9f-7854-46fb-ae9b-5bcb175c47d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:12.535329 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c243c7-831b-4aa4-9ec6-2df2f4e54414 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9590cf43c93f439d89ff8034d931d617)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:12.536771 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c243c7-831b-4aa4-9ec6-2df2f4e54414 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:12.599557 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e7f9f-7854-46fb-ae9b-5bcb175c47d4 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:12.605041 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221ff45-13e1-4b97-9b71-e83bba002b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:12.606031 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221ff45-13e1-4b97-9b71-e83bba002b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:12.606346 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221ff45-13e1-4b97-9b71-e83bba002b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:12.606627 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221ff45-13e1-4b97-9b71-e83bba002b31 admin admin] PATH_INFO: `/v3/users/e96565d429934cdaaee549bebb071fb6` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:12.607827 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221ff45-13e1-4b97-9b71-e83bba002b31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e96565d429934cdaaee549bebb071fb6)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:12.609759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221ff45-13e1-4b97-9b71-e83bba002b31 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:12.779958 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-98c243c7-831b-4aa4-9ec6-2df2f4e54414 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9590cf43c93f439d89ff8034d931d617'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:12.807270 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2221ff45-13e1-4b97-9b71-e83bba002b31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e96565d429934cdaaee549bebb071fb6'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:12.814771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2221ff45-13e1-4b97-9b71-e83bba002b31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e96565d429934cdaaee549bebb071fb6'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:12.827535 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2221ff45-13e1-4b97-9b71-e83bba002b31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e96565d429934cdaaee549bebb071fb6'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:12.828472 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2221ff45-13e1-4b97-9b71-e83bba002b31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e96565d429934cdaaee549bebb071fb6'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:12.898830 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-98c243c7-831b-4aa4-9ec6-2df2f4e54414 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9590cf43c93f439d89ff8034d931d617'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:12.914334 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-98c243c7-831b-4aa4-9ec6-2df2f4e54414 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9590cf43c93f439d89ff8034d931d617'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:12.923498 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-98c243c7-831b-4aa4-9ec6-2df2f4e54414 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9590cf43c93f439d89ff8034d931d617'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:12.927717 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-98c243c7-831b-4aa4-9ec6-2df2f4e54414 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9590cf43c93f439d89ff8034d931d617'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:12.934351 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1021/2011] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:29:12 2022] DELETE /identity/v3/users/9590cf43c93f439d89ff8034d931d617 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:12.936011 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed50fac-7986-4b16-a910-395752c64bd3 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:12.936305 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed50fac-7986-4b16-a910-395752c64bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:12.936744 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed50fac-7986-4b16-a910-395752c64bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:12.955663 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-5ed50fac-7986-4b16-a910-395752c64bd3 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:12.956898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5ed50fac-7986-4b16-a910-395752c64bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:12.998569 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2221ff45-13e1-4b97-9b71-e83bba002b31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e96565d429934cdaaee549bebb071fb6'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:13.006667 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 991/2012] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:29:12 2022] DELETE /identity/v3/users/e96565d429934cdaaee549bebb071fb6 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:13.012337 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577595a0-7456-414e-baa9-d03f1671ef8c None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:13.012749 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577595a0-7456-414e-baa9-d03f1671ef8c None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:13.013191 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577595a0-7456-414e-baa9-d03f1671ef8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:13.024477 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1022/2013] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:13.042312 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-577595a0-7456-414e-baa9-d03f1671ef8c None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:13.043863 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-577595a0-7456-414e-baa9-d03f1671ef8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:13.044843 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed50fac-7986-4b16-a910-395752c64bd3 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:13.046328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5ed50fac-7986-4b16-a910-395752c64bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:13.127812 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 992/2014] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:13.138038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577595a0-7456-414e-baa9-d03f1671ef8c None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:13.150278 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed50fac-7986-4b16-a910-395752c64bd3 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:13.171765 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:13.218753 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522adb7-8435-4c58-869e-1df3fdcc15a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:13.219718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522adb7-8435-4c58-869e-1df3fdcc15a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:13.220308 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522adb7-8435-4c58-869e-1df3fdcc15a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:13.220741 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522adb7-8435-4c58-869e-1df3fdcc15a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:13.222569 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577595a0-7456-414e-baa9-d03f1671ef8c None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:13.229004 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbf347-7bc3-49fc-b2e3-2a1e879d54d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:13.229674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbf347-7bc3-49fc-b2e3-2a1e879d54d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:13.229954 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbf347-7bc3-49fc-b2e3-2a1e879d54d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:13.230261 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbf347-7bc3-49fc-b2e3-2a1e879d54d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:13.233343 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522adb7-8435-4c58-869e-1df3fdcc15a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:13.235055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522adb7-8435-4c58-869e-1df3fdcc15a4 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:13.242644 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbf347-7bc3-49fc-b2e3-2a1e879d54d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:13.245532 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbf347-7bc3-49fc-b2e3-2a1e879d54d6 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:13.247964 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1023/2015] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:29:13.262907 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 993/2016] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:13.687243 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522adb7-8435-4c58-869e-1df3fdcc15a4 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:13.688749 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c522adb7-8435-4c58-869e-1df3fdcc15a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:13.709436 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522adb7-8435-4c58-869e-1df3fdcc15a4 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:13.724062 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125e521-ba38-49d1-9a5e-1c5d91ac0fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:13.725723 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125e521-ba38-49d1-9a5e-1c5d91ac0fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:13.726326 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125e521-ba38-49d1-9a5e-1c5d91ac0fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:13.726874 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125e521-ba38-49d1-9a5e-1c5d91ac0fbe admin admin] PATH_INFO: `/v3/projects/cf3b316acb2344488e48f5bc04e815dc` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:13.728912 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125e521-ba38-49d1-9a5e-1c5d91ac0fbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf3b316acb2344488e48f5bc04e815dc)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:13.732524 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125e521-ba38-49d1-9a5e-1c5d91ac0fbe admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:13.844768 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-4125e521-ba38-49d1-9a5e-1c5d91ac0fbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf3b316acb2344488e48f5bc04e815dc', 'request_id': 'req-4125e521-ba38-49d1-9a5e-1c5d91ac0fbe'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:13.855701 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:13.968788 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-4125e521-ba38-49d1-9a5e-1c5d91ac0fbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf3b316acb2344488e48f5bc04e815dc', 'request_id': 'req-4125e521-ba38-49d1-9a5e-1c5d91ac0fbe'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:13.975164 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-4125e521-ba38-49d1-9a5e-1c5d91ac0fbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf3b316acb2344488e48f5bc04e815dc', 'request_id': 'req-4125e521-ba38-49d1-9a5e-1c5d91ac0fbe'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:13.987196 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-4125e521-ba38-49d1-9a5e-1c5d91ac0fbe admin admin] The token cache is being invalidate because project cf3b316acb2344488e48f5bc04e815dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:29:13.987487 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-4125e521-ba38-49d1-9a5e-1c5d91ac0fbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:13.988132 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-4125e521-ba38-49d1-9a5e-1c5d91ac0fbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:13.989704 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1024/2017] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:29:13 2022] DELETE /identity/v3/projects/cf3b316acb2344488e48f5bc04e815dc => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:13.998459 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbf347-7bc3-49fc-b2e3-2a1e879d54d6 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:13.999372 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125e521-ba38-49d1-9a5e-1c5d91ac0fbe admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:14.001576 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4125e521-ba38-49d1-9a5e-1c5d91ac0fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:14.001725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:14.009314 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbf347-7bc3-49fc-b2e3-2a1e879d54d6 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:14.080845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee4eef-8984-468e-b024-925ce28fc5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:14.081727 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee4eef-8984-468e-b024-925ce28fc5f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:14.082011 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee4eef-8984-468e-b024-925ce28fc5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:14.082332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee4eef-8984-468e-b024-925ce28fc5f7 admin admin] PATH_INFO: `/v3/users/da1e2ac2cc4e40d09d70730162ce57b4` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:14.083522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee4eef-8984-468e-b024-925ce28fc5f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da1e2ac2cc4e40d09d70730162ce57b4)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:14.085488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee4eef-8984-468e-b024-925ce28fc5f7 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:14.089727 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125e521-ba38-49d1-9a5e-1c5d91ac0fbe admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:14.095761 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beff086-7b4f-4b22-95bf-1df5cd863b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:14.096651 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beff086-7b4f-4b22-95bf-1df5cd863b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:14.096914 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beff086-7b4f-4b22-95bf-1df5cd863b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:14.097196 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beff086-7b4f-4b22-95bf-1df5cd863b72 admin admin] PATH_INFO: `/v3/projects/ac319bf793e949f59e4266969c0b2031` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:14.098478 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beff086-7b4f-4b22-95bf-1df5cd863b72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac319bf793e949f59e4266969c0b2031)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:14.100570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beff086-7b4f-4b22-95bf-1df5cd863b72 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:14.289257 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-40ee4eef-8984-468e-b024-925ce28fc5f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da1e2ac2cc4e40d09d70730162ce57b4'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:14.301014 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-40ee4eef-8984-468e-b024-925ce28fc5f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da1e2ac2cc4e40d09d70730162ce57b4'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:14.303492 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6beff086-7b4f-4b22-95bf-1df5cd863b72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac319bf793e949f59e4266969c0b2031', 'request_id': 'req-6beff086-7b4f-4b22-95bf-1df5cd863b72'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:14.317832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-40ee4eef-8984-468e-b024-925ce28fc5f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da1e2ac2cc4e40d09d70730162ce57b4'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:14.319282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-40ee4eef-8984-468e-b024-925ce28fc5f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da1e2ac2cc4e40d09d70730162ce57b4'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:14.426076 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6beff086-7b4f-4b22-95bf-1df5cd863b72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac319bf793e949f59e4266969c0b2031', 'request_id': 'req-6beff086-7b4f-4b22-95bf-1df5cd863b72'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:14.432263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6beff086-7b4f-4b22-95bf-1df5cd863b72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac319bf793e949f59e4266969c0b2031', 'request_id': 'req-6beff086-7b4f-4b22-95bf-1df5cd863b72'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:14.443426 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6beff086-7b4f-4b22-95bf-1df5cd863b72 admin admin] The token cache is being invalidate because project ac319bf793e949f59e4266969c0b2031 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:29:14.443718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6beff086-7b4f-4b22-95bf-1df5cd863b72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:14.444368 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6beff086-7b4f-4b22-95bf-1df5cd863b72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:14.446081 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1025/2018] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:29:13 2022] DELETE /identity/v3/projects/ac319bf793e949f59e4266969c0b2031 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:29:14.447398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beff086-7b4f-4b22-95bf-1df5cd863b72 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:14.448685 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6beff086-7b4f-4b22-95bf-1df5cd863b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:14.512481 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beff086-7b4f-4b22-95bf-1df5cd863b72 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:14.515615 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-40ee4eef-8984-468e-b024-925ce28fc5f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da1e2ac2cc4e40d09d70730162ce57b4'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:14.517502 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95511b0-21d6-4633-883e-944dcac41023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:14.518475 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95511b0-21d6-4633-883e-944dcac41023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:14.518764 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95511b0-21d6-4633-883e-944dcac41023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:14.519060 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95511b0-21d6-4633-883e-944dcac41023 admin admin] PATH_INFO: `/v3/projects/a3aacb1e996b4187a29e0d4d9477d078` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:14.525433 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95511b0-21d6-4633-883e-944dcac41023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3aacb1e996b4187a29e0d4d9477d078)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:14.525659 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 994/2019] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:29:13 2022] DELETE /identity/v3/users/da1e2ac2cc4e40d09d70730162ce57b4 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:14.525767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95511b0-21d6-4633-883e-944dcac41023 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:14.525843 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee4eef-8984-468e-b024-925ce28fc5f7 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:14.526948 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-40ee4eef-8984-468e-b024-925ce28fc5f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:14.606025 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee4eef-8984-468e-b024-925ce28fc5f7 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:14.611290 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1815422-0437-4a09-b919-1606bc7ac323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:14.612172 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1815422-0437-4a09-b919-1606bc7ac323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:14.612457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1815422-0437-4a09-b919-1606bc7ac323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:14.612739 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1815422-0437-4a09-b919-1606bc7ac323 admin admin] PATH_INFO: `/v3/users/f551f04a616246f28c55a8948e8588d3` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:14.617143 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1815422-0437-4a09-b919-1606bc7ac323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f551f04a616246f28c55a8948e8588d3)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:14.617143 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1815422-0437-4a09-b919-1606bc7ac323 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:14.664021 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f95511b0-21d6-4633-883e-944dcac41023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3aacb1e996b4187a29e0d4d9477d078', 'request_id': 'req-f95511b0-21d6-4633-883e-944dcac41023'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:14.766907 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f95511b0-21d6-4633-883e-944dcac41023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3aacb1e996b4187a29e0d4d9477d078', 'request_id': 'req-f95511b0-21d6-4633-883e-944dcac41023'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:14.774002 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f95511b0-21d6-4633-883e-944dcac41023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3aacb1e996b4187a29e0d4d9477d078', 'request_id': 'req-f95511b0-21d6-4633-883e-944dcac41023'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:14.786281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f95511b0-21d6-4633-883e-944dcac41023 admin admin] The token cache is being invalidate because project a3aacb1e996b4187a29e0d4d9477d078 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:29:14.786574 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f95511b0-21d6-4633-883e-944dcac41023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:14.787289 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f95511b0-21d6-4633-883e-944dcac41023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:14.788879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1026/2020] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:29:14 2022] DELETE /identity/v3/projects/a3aacb1e996b4187a29e0d4d9477d078 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:14.792845 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95511b0-21d6-4633-883e-944dcac41023 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:14.794334 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f95511b0-21d6-4633-883e-944dcac41023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:14.868655 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95511b0-21d6-4633-883e-944dcac41023 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:14.874306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5a82e-c8b0-4ad4-94b4-b43438d3e05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:14.875214 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5a82e-c8b0-4ad4-94b4-b43438d3e05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:14.875505 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5a82e-c8b0-4ad4-94b4-b43438d3e05a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:14.875812 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5a82e-c8b0-4ad4-94b4-b43438d3e05a admin admin] PATH_INFO: `/v3/users/283a808d9d2e4e2d84d4b28bb0c1a84e` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:14.877308 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5a82e-c8b0-4ad4-94b4-b43438d3e05a admin admin] RBAC: Authorizing `identity:delete_user(user_id=283a808d9d2e4e2d84d4b28bb0c1a84e)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:14.879353 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5a82e-c8b0-4ad4-94b4-b43438d3e05a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:14.907657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c1815422-0437-4a09-b919-1606bc7ac323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f551f04a616246f28c55a8948e8588d3'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:14.914718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c1815422-0437-4a09-b919-1606bc7ac323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f551f04a616246f28c55a8948e8588d3'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:14.927327 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c1815422-0437-4a09-b919-1606bc7ac323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f551f04a616246f28c55a8948e8588d3'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:14.928119 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c1815422-0437-4a09-b919-1606bc7ac323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f551f04a616246f28c55a8948e8588d3'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:15.020906 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c1815422-0437-4a09-b919-1606bc7ac323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f551f04a616246f28c55a8948e8588d3'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:15.028499 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 995/2021] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:29:14 2022] DELETE /identity/v3/users/f551f04a616246f28c55a8948e8588d3 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:15.036984 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1815422-0437-4a09-b919-1606bc7ac323 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:15.038450 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c1815422-0437-4a09-b919-1606bc7ac323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:15.113073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1815422-0437-4a09-b919-1606bc7ac323 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:15.121161 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42dc9f-7b66-4fa0-a9bc-85b03ebfb308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:15.122252 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42dc9f-7b66-4fa0-a9bc-85b03ebfb308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:15.122716 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42dc9f-7b66-4fa0-a9bc-85b03ebfb308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:15.123158 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42dc9f-7b66-4fa0-a9bc-85b03ebfb308 admin admin] PATH_INFO: `/v3/projects/36dff46d0cae4a7a871f3815f9e4e220` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:15.124927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42dc9f-7b66-4fa0-a9bc-85b03ebfb308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36dff46d0cae4a7a871f3815f9e4e220)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:15.128391 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42dc9f-7b66-4fa0-a9bc-85b03ebfb308 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:15.133349 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e8f5a82e-c8b0-4ad4-94b4-b43438d3e05a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '283a808d9d2e4e2d84d4b28bb0c1a84e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:15.244297 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e8f5a82e-c8b0-4ad4-94b4-b43438d3e05a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '283a808d9d2e4e2d84d4b28bb0c1a84e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:15.257486 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e8f5a82e-c8b0-4ad4-94b4-b43438d3e05a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '283a808d9d2e4e2d84d4b28bb0c1a84e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:15.264342 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e8f5a82e-c8b0-4ad4-94b4-b43438d3e05a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '283a808d9d2e4e2d84d4b28bb0c1a84e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:15.265081 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e8f5a82e-c8b0-4ad4-94b4-b43438d3e05a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '283a808d9d2e4e2d84d4b28bb0c1a84e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:15.271034 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1027/2022] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:29:14 2022] DELETE /identity/v3/users/283a808d9d2e4e2d84d4b28bb0c1a84e => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:29:15.297941 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0b42dc9f-7b66-4fa0-a9bc-85b03ebfb308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36dff46d0cae4a7a871f3815f9e4e220', 'request_id': 'req-0b42dc9f-7b66-4fa0-a9bc-85b03ebfb308'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:15.305470 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0b42dc9f-7b66-4fa0-a9bc-85b03ebfb308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36dff46d0cae4a7a871f3815f9e4e220', 'request_id': 'req-0b42dc9f-7b66-4fa0-a9bc-85b03ebfb308'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:15.420791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0b42dc9f-7b66-4fa0-a9bc-85b03ebfb308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36dff46d0cae4a7a871f3815f9e4e220', 'request_id': 'req-0b42dc9f-7b66-4fa0-a9bc-85b03ebfb308'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:15.435424 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0b42dc9f-7b66-4fa0-a9bc-85b03ebfb308 admin admin] The token cache is being invalidate because project 36dff46d0cae4a7a871f3815f9e4e220 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:29:15.435813 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0b42dc9f-7b66-4fa0-a9bc-85b03ebfb308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:15.436586 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0b42dc9f-7b66-4fa0-a9bc-85b03ebfb308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:15.439260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 996/2023] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:29:15 2022] DELETE /identity/v3/projects/36dff46d0cae4a7a871f3815f9e4e220 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:15.443967 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df31644-7a71-43b6-9428-ac35a889e6ab None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:15.444371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df31644-7a71-43b6-9428-ac35a889e6ab None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:15.444805 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df31644-7a71-43b6-9428-ac35a889e6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:15.463746 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-8df31644-7a71-43b6-9428-ac35a889e6ab None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:15.465226 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8df31644-7a71-43b6-9428-ac35a889e6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:15.540973 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1028/2024] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:15.548542 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673d04f-8428-43b7-b49a-3b7348798f7f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:15.548829 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673d04f-8428-43b7-b49a-3b7348798f7f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:15.549105 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673d04f-8428-43b7-b49a-3b7348798f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:15.568195 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-5673d04f-8428-43b7-b49a-3b7348798f7f None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:15.569393 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5673d04f-8428-43b7-b49a-3b7348798f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:15.577773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 997/2025] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:15.581891 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df31644-7a71-43b6-9428-ac35a889e6ab None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:15.592882 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df31644-7a71-43b6-9428-ac35a889e6ab None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:15.597950 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c7b5c-3596-48a2-9447-76d3a5f9e7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:15.598791 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c7b5c-3596-48a2-9447-76d3a5f9e7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:15.598992 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c7b5c-3596-48a2-9447-76d3a5f9e7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:15.599276 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c7b5c-3596-48a2-9447-76d3a5f9e7f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:15.600066 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c7b5c-3596-48a2-9447-76d3a5f9e7f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:29:15.600378 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c7b5c-3596-48a2-9447-76d3a5f9e7f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:15.602005 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c7b5c-3596-48a2-9447-76d3a5f9e7f3 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:15.614953 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1029/2026] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:29:15.619658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673d04f-8428-43b7-b49a-3b7348798f7f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:15.622402 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c7b5c-3596-48a2-9447-76d3a5f9e7f3 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:15.624576 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0f7c7b5c-3596-48a2-9447-76d3a5f9e7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:15.638903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673d04f-8428-43b7-b49a-3b7348798f7f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:15.644623 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46665939-0f26-48c1-b080-23a1ed306e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:15.645347 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46665939-0f26-48c1-b080-23a1ed306e9b admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:15.645469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c7b5c-3596-48a2-9447-76d3a5f9e7f3 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:15.647587 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46665939-0f26-48c1-b080-23a1ed306e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:15.647587 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46665939-0f26-48c1-b080-23a1ed306e9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:15.647587 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46665939-0f26-48c1-b080-23a1ed306e9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:15.652376 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd970a-bb09-4075-ac38-09d9be771abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:15.653336 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd970a-bb09-4075-ac38-09d9be771abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:15.653632 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd970a-bb09-4075-ac38-09d9be771abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:15.653921 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd970a-bb09-4075-ac38-09d9be771abc admin admin] PATH_INFO: `/v3/projects/181e076878814c9ea3cc5885973fe742` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:15.655321 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd970a-bb09-4075-ac38-09d9be771abc admin admin] RBAC: Authorizing `identity:delete_project(project_id=181e076878814c9ea3cc5885973fe742)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:15.658661 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46665939-0f26-48c1-b080-23a1ed306e9b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:15.671300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd970a-bb09-4075-ac38-09d9be771abc admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:15.763231 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 998/2027] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:29:15 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:29:15.763231 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46665939-0f26-48c1-b080-23a1ed306e9b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:15.763231 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-46665939-0f26-48c1-b080-23a1ed306e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:15.812435 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0cdd970a-bb09-4075-ac38-09d9be771abc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '181e076878814c9ea3cc5885973fe742', 'request_id': 'req-0cdd970a-bb09-4075-ac38-09d9be771abc'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:15.829802 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46665939-0f26-48c1-b080-23a1ed306e9b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:15.888635 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00eff1-a908-4561-94cd-13099ea5699d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:15.889566 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00eff1-a908-4561-94cd-13099ea5699d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:15.889836 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00eff1-a908-4561-94cd-13099ea5699d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:15.890165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00eff1-a908-4561-94cd-13099ea5699d admin admin] PATH_INFO: `/v3/users/743274d4733f405fa47ffa4705f111e0` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:15.891380 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00eff1-a908-4561-94cd-13099ea5699d admin admin] RBAC: Authorizing `identity:delete_user(user_id=743274d4733f405fa47ffa4705f111e0)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:15.893317 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00eff1-a908-4561-94cd-13099ea5699d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:15.900243 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0cdd970a-bb09-4075-ac38-09d9be771abc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '181e076878814c9ea3cc5885973fe742', 'request_id': 'req-0cdd970a-bb09-4075-ac38-09d9be771abc'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:15.907482 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0cdd970a-bb09-4075-ac38-09d9be771abc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '181e076878814c9ea3cc5885973fe742', 'request_id': 'req-0cdd970a-bb09-4075-ac38-09d9be771abc'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:15.925508 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0cdd970a-bb09-4075-ac38-09d9be771abc admin admin] The token cache is being invalidate because project 181e076878814c9ea3cc5885973fe742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:29:15.925811 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0cdd970a-bb09-4075-ac38-09d9be771abc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:15.926622 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0cdd970a-bb09-4075-ac38-09d9be771abc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:15.928115 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1030/2028] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:29:15 2022] DELETE /identity/v3/projects/181e076878814c9ea3cc5885973fe742 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:15.928929 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd970a-bb09-4075-ac38-09d9be771abc admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:15.930284 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0cdd970a-bb09-4075-ac38-09d9be771abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:15.943796 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd970a-bb09-4075-ac38-09d9be771abc admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:15.949561 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531bd15-e8f5-4c0d-9558-08646db51d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:15.950616 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531bd15-e8f5-4c0d-9558-08646db51d4a admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:15.950995 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531bd15-e8f5-4c0d-9558-08646db51d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:15.951371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531bd15-e8f5-4c0d-9558-08646db51d4a admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:15.952203 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531bd15-e8f5-4c0d-9558-08646db51d4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:15.954477 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531bd15-e8f5-4c0d-9558-08646db51d4a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:16.094938 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1031/2029] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:29:15 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:16.095724 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531bd15-e8f5-4c0d-9558-08646db51d4a admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:16.097277 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e531bd15-e8f5-4c0d-9558-08646db51d4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:16.109859 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531bd15-e8f5-4c0d-9558-08646db51d4a admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:16.114509 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b20d7-b6ee-4474-8167-86cbcf891fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:16.115326 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b20d7-b6ee-4474-8167-86cbcf891fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:16.115605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b20d7-b6ee-4474-8167-86cbcf891fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:16.115876 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b20d7-b6ee-4474-8167-86cbcf891fdd admin admin] PATH_INFO: `/v3/projects/9d29f99614d14d42b76370752eb277a7` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:16.117094 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b20d7-b6ee-4474-8167-86cbcf891fdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d29f99614d14d42b76370752eb277a7)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:16.119071 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b20d7-b6ee-4474-8167-86cbcf891fdd admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:16.133507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6f00eff1-a908-4561-94cd-13099ea5699d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '743274d4733f405fa47ffa4705f111e0'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:16.139912 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6f00eff1-a908-4561-94cd-13099ea5699d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '743274d4733f405fa47ffa4705f111e0'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:16.152821 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6f00eff1-a908-4561-94cd-13099ea5699d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '743274d4733f405fa47ffa4705f111e0'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:16.153514 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6f00eff1-a908-4561-94cd-13099ea5699d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '743274d4733f405fa47ffa4705f111e0'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:16.235257 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ca9b20d7-b6ee-4474-8167-86cbcf891fdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d29f99614d14d42b76370752eb277a7', 'request_id': 'req-ca9b20d7-b6ee-4474-8167-86cbcf891fdd'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:16.257679 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6f00eff1-a908-4561-94cd-13099ea5699d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '743274d4733f405fa47ffa4705f111e0'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:16.264340 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 999/2030] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:29:15 2022] DELETE /identity/v3/users/743274d4733f405fa47ffa4705f111e0 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:16.265598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea7aea-2ee1-4b49-bbe4-203d1c34385b None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:16.265885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea7aea-2ee1-4b49-bbe4-203d1c34385b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:16.266196 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea7aea-2ee1-4b49-bbe4-203d1c34385b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:16.284529 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-74ea7aea-2ee1-4b49-bbe4-203d1c34385b None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:16.285737 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-74ea7aea-2ee1-4b49-bbe4-203d1c34385b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:16.344773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1000/2031] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:16.345672 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea7aea-2ee1-4b49-bbe4-203d1c34385b None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:16.346885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-74ea7aea-2ee1-4b49-bbe4-203d1c34385b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:16.359398 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea7aea-2ee1-4b49-bbe4-203d1c34385b None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:16.360681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ca9b20d7-b6ee-4474-8167-86cbcf891fdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d29f99614d14d42b76370752eb277a7', 'request_id': 'req-ca9b20d7-b6ee-4474-8167-86cbcf891fdd'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:16.364023 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778ede0-4331-4bd2-af36-de25919f6d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:16.364670 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778ede0-4331-4bd2-af36-de25919f6d48 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:16.364953 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778ede0-4331-4bd2-af36-de25919f6d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:16.365233 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778ede0-4331-4bd2-af36-de25919f6d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:16.366103 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0778ede0-4331-4bd2-af36-de25919f6d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:16.367163 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ca9b20d7-b6ee-4474-8167-86cbcf891fdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d29f99614d14d42b76370752eb277a7', 'request_id': 'req-ca9b20d7-b6ee-4474-8167-86cbcf891fdd'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:16.367584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0778ede0-4331-4bd2-af36-de25919f6d48 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:16.379371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ca9b20d7-b6ee-4474-8167-86cbcf891fdd admin admin] The token cache is being invalidate because project 9d29f99614d14d42b76370752eb277a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:29:16.379666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ca9b20d7-b6ee-4474-8167-86cbcf891fdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:16.380058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1001/2032] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:16.381296 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bfbb1-867e-4d6d-969a-1d98bfe34cfb None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:16.381590 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bfbb1-867e-4d6d-969a-1d98bfe34cfb None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:16.381866 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bfbb1-867e-4d6d-969a-1d98bfe34cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:16.383313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ca9b20d7-b6ee-4474-8167-86cbcf891fdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:16.385099 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1032/2033] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:29:16 2022] DELETE /identity/v3/projects/9d29f99614d14d42b76370752eb277a7 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:16.386377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33cc3b-9279-48bf-9880-ca06cf7af2c8 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:16.386644 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33cc3b-9279-48bf-9880-ca06cf7af2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:16.386924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33cc3b-9279-48bf-9880-ca06cf7af2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:16.401913 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-c91bfbb1-867e-4d6d-969a-1d98bfe34cfb None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:16.403195 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c91bfbb1-867e-4d6d-969a-1d98bfe34cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:16.405560 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-ef33cc3b-9279-48bf-9880-ca06cf7af2c8 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:16.406793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ef33cc3b-9279-48bf-9880-ca06cf7af2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:16.411610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1002/2034] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:16.412416 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bfbb1-867e-4d6d-969a-1d98bfe34cfb None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:16.413287 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:16.413668 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c91bfbb1-867e-4d6d-969a-1d98bfe34cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:16.422773 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1033/2035] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:16.423618 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33cc3b-9279-48bf-9880-ca06cf7af2c8 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:16.425055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ef33cc3b-9279-48bf-9880-ca06cf7af2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:16.431377 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bfbb1-867e-4d6d-969a-1d98bfe34cfb None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:16.439055 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d207b0-3bef-4563-8707-43205222b9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:16.439055 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d207b0-3bef-4563-8707-43205222b9df admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:16.439055 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d207b0-3bef-4563-8707-43205222b9df admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:16.439055 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d207b0-3bef-4563-8707-43205222b9df admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:16.439547 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d207b0-3bef-4563-8707-43205222b9df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:16.441026 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d207b0-3bef-4563-8707-43205222b9df admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:16.442686 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33cc3b-9279-48bf-9880-ca06cf7af2c8 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:16.445823 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:16.451919 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70cb79-f44d-466e-b663-527b04c104f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:16.451919 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70cb79-f44d-466e-b663-527b04c104f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:16.451919 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70cb79-f44d-466e-b663-527b04c104f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:16.451919 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70cb79-f44d-466e-b663-527b04c104f1 admin admin] PATH_INFO: `/v3/users/da2384dc3ccd487d898ac12d0588d23d` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:16.452484 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70cb79-f44d-466e-b663-527b04c104f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da2384dc3ccd487d898ac12d0588d23d)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:16.453384 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70cb79-f44d-466e-b663-527b04c104f1 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:16.455902 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1003/2036] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:16.456809 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d207b0-3bef-4563-8707-43205222b9df admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:16.458526 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d8d207b0-3bef-4563-8707-43205222b9df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:16.521981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d207b0-3bef-4563-8707-43205222b9df admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:16.526469 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7c97b-4596-4087-b3bf-91ec9e18df97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:16.527120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7c97b-4596-4087-b3bf-91ec9e18df97 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:16.527412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7c97b-4596-4087-b3bf-91ec9e18df97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:16.527720 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7c97b-4596-4087-b3bf-91ec9e18df97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:16.537157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7c97b-4596-4087-b3bf-91ec9e18df97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:16.538656 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7c97b-4596-4087-b3bf-91ec9e18df97 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:16.548976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1004/2037] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:16.549791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7c97b-4596-4087-b3bf-91ec9e18df97 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:16.559123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7c97b-4596-4087-b3bf-91ec9e18df97 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:16.563963 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc76fa-3165-40fe-909f-b7839033f433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:16.567301 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc76fa-3165-40fe-909f-b7839033f433 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:16.567301 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc76fa-3165-40fe-909f-b7839033f433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:16.567301 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc76fa-3165-40fe-909f-b7839033f433 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:16.567301 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc76fa-3165-40fe-909f-b7839033f433 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:29:16.567301 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc76fa-3165-40fe-909f-b7839033f433 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:16.567924 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc76fa-3165-40fe-909f-b7839033f433 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:16.592829 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1005/2038] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:29:16.595748 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc76fa-3165-40fe-909f-b7839033f433 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:16.607337 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc76fa-3165-40fe-909f-b7839033f433 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:16.616990 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2cea3-f98f-4c69-afdf-2993e398ce0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:16.618024 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2cea3-f98f-4c69-afdf-2993e398ce0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:16.619590 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2cea3-f98f-4c69-afdf-2993e398ce0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:16.619945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2cea3-f98f-4c69-afdf-2993e398ce0b admin admin] PATH_INFO: `/v3/projects/1218192cb1704799b5aab8812e84b334/users/eff8feae83ae43ba82cc5a58044cb7c3/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:16.653979 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2cea3-f98f-4c69-afdf-2993e398ce0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1218192cb1704799b5aab8812e84b334, user_id=eff8feae83ae43ba82cc5a58044cb7c3, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:16.653979 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2cea3-f98f-4c69-afdf-2993e398ce0b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:16.710901 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fe70cb79-f44d-466e-b663-527b04c104f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da2384dc3ccd487d898ac12d0588d23d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:16.724800 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1006/2039] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:16 2022] PUT /identity/v3/projects/1218192cb1704799b5aab8812e84b334/users/eff8feae83ae43ba82cc5a58044cb7c3/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:16.725436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2cea3-f98f-4c69-afdf-2993e398ce0b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:16.791402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2cea3-f98f-4c69-afdf-2993e398ce0b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:16.795256 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fe70cb79-f44d-466e-b663-527b04c104f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da2384dc3ccd487d898ac12d0588d23d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:16.796693 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343668f7-c66a-4a68-8626-7501fca53469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:16.798673 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343668f7-c66a-4a68-8626-7501fca53469 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:16.798673 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343668f7-c66a-4a68-8626-7501fca53469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:16.798673 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343668f7-c66a-4a68-8626-7501fca53469 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:16.799077 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343668f7-c66a-4a68-8626-7501fca53469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:16.801394 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343668f7-c66a-4a68-8626-7501fca53469 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:16.809247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fe70cb79-f44d-466e-b663-527b04c104f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da2384dc3ccd487d898ac12d0588d23d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:16.817379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fe70cb79-f44d-466e-b663-527b04c104f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da2384dc3ccd487d898ac12d0588d23d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:16.818229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fe70cb79-f44d-466e-b663-527b04c104f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da2384dc3ccd487d898ac12d0588d23d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:16.825552 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1034/2040] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:29:16 2022] DELETE /identity/v3/users/da2384dc3ccd487d898ac12d0588d23d => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:16.827005 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e258fde-b6be-4d55-b17c-9a2334471d19 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:16.827372 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e258fde-b6be-4d55-b17c-9a2334471d19 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:16.827725 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e258fde-b6be-4d55-b17c-9a2334471d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:16.854729 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-1e258fde-b6be-4d55-b17c-9a2334471d19 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:16.856311 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-1e258fde-b6be-4d55-b17c-9a2334471d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:16.947567 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1007/2041] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:29:16 2022] POST /identity/v3/projects => generated 393 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:16.951680 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343668f7-c66a-4a68-8626-7501fca53469 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:16.953377 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-343668f7-c66a-4a68-8626-7501fca53469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:16.959838 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1035/2042] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:16.971007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e258fde-b6be-4d55-b17c-9a2334471d19 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:16.973039 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-1e258fde-b6be-4d55-b17c-9a2334471d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:17.027137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343668f7-c66a-4a68-8626-7501fca53469 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:17.032617 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e258fde-b6be-4d55-b17c-9a2334471d19 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:17.034086 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d8552-c7d6-465d-b5db-6fd8acc22f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:17.035133 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d8552-c7d6-465d-b5db-6fd8acc22f4f admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:17.035435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d8552-c7d6-465d-b5db-6fd8acc22f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:17.035824 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d8552-c7d6-465d-b5db-6fd8acc22f4f admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:17.036932 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d8552-c7d6-465d-b5db-6fd8acc22f4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:17.038921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d8552-c7d6-465d-b5db-6fd8acc22f4f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:17.106172 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea003a-5342-4e07-9803-6eec141bd051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:17.106861 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea003a-5342-4e07-9803-6eec141bd051 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:17.107782 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea003a-5342-4e07-9803-6eec141bd051 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:17.108645 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea003a-5342-4e07-9803-6eec141bd051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:17.122255 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea003a-5342-4e07-9803-6eec141bd051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:17.124087 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea003a-5342-4e07-9803-6eec141bd051 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:17.130643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1008/2043] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:29:16 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:17.131839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d8552-c7d6-465d-b5db-6fd8acc22f4f admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:17.133648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-639d8552-c7d6-465d-b5db-6fd8acc22f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:17.140432 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1036/2044] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:17.141282 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea003a-5342-4e07-9803-6eec141bd051 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:17.148758 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d8552-c7d6-465d-b5db-6fd8acc22f4f admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:17.153389 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea003a-5342-4e07-9803-6eec141bd051 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:17.155938 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279b9d8-b91d-4065-9bbb-9f8881434c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:17.156975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279b9d8-b91d-4065-9bbb-9f8881434c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:17.157549 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279b9d8-b91d-4065-9bbb-9f8881434c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:17.157987 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279b9d8-b91d-4065-9bbb-9f8881434c23 admin admin] PATH_INFO: `/v3/projects/5b7b1f1cfcdb42c2b62f51f1c1828ac6` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:17.158889 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c235991-98b4-4503-9075-daf1ac9699c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:17.159452 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279b9d8-b91d-4065-9bbb-9f8881434c23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b7b1f1cfcdb42c2b62f51f1c1828ac6)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:17.159561 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c235991-98b4-4503-9075-daf1ac9699c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:17.159812 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c235991-98b4-4503-9075-daf1ac9699c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:17.160237 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c235991-98b4-4503-9075-daf1ac9699c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:17.161085 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c235991-98b4-4503-9075-daf1ac9699c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:17.161445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279b9d8-b91d-4065-9bbb-9f8881434c23 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:17.162803 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c235991-98b4-4503-9075-daf1ac9699c1 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:17.178575 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1037/2045] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:17.184062 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c235991-98b4-4503-9075-daf1ac9699c1 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:17.191835 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c235991-98b4-4503-9075-daf1ac9699c1 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:17.197880 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf3001-c29f-4091-be81-1e3d0ed7834a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:17.198845 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf3001-c29f-4091-be81-1e3d0ed7834a admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:17.199228 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf3001-c29f-4091-be81-1e3d0ed7834a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:17.199595 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf3001-c29f-4091-be81-1e3d0ed7834a admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:17.200423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf3001-c29f-4091-be81-1e3d0ed7834a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:17.202819 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf3001-c29f-4091-be81-1e3d0ed7834a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:17.215054 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1038/2046] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:29:17.219199 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf3001-c29f-4091-be81-1e3d0ed7834a admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:17.231683 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf3001-c29f-4091-be81-1e3d0ed7834a admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:17.236487 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fbf4a-88d0-4cb8-b604-f0a0735bb161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:17.237362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fbf4a-88d0-4cb8-b604-f0a0735bb161 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:17.237647 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fbf4a-88d0-4cb8-b604-f0a0735bb161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:17.237925 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fbf4a-88d0-4cb8-b604-f0a0735bb161 admin admin] PATH_INFO: `/v3/projects/57acf956a50c4aee98b31795b868d0ed/users/8ea65eaa5f014e059dd1539e0465ab34/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:17.253114 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fbf4a-88d0-4cb8-b604-f0a0735bb161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57acf956a50c4aee98b31795b868d0ed, user_id=8ea65eaa5f014e059dd1539e0465ab34, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:17.255790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fbf4a-88d0-4cb8-b604-f0a0735bb161 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:17.300859 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:17.366247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1039/2047] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:17 2022] PUT /identity/v3/projects/57acf956a50c4aee98b31795b868d0ed/users/8ea65eaa5f014e059dd1539e0465ab34/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:29:17.366247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fbf4a-88d0-4cb8-b604-f0a0735bb161 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:17.368623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a54fbf4a-88d0-4cb8-b604-f0a0735bb161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:17.377853 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4279b9d8-b91d-4065-9bbb-9f8881434c23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b7b1f1cfcdb42c2b62f51f1c1828ac6', 'request_id': 'req-4279b9d8-b91d-4065-9bbb-9f8881434c23'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:17.384818 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4279b9d8-b91d-4065-9bbb-9f8881434c23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b7b1f1cfcdb42c2b62f51f1c1828ac6', 'request_id': 'req-4279b9d8-b91d-4065-9bbb-9f8881434c23'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:17.439067 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fbf4a-88d0-4cb8-b604-f0a0735bb161 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:17.450550 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4279b9d8-b91d-4065-9bbb-9f8881434c23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b7b1f1cfcdb42c2b62f51f1c1828ac6', 'request_id': 'req-4279b9d8-b91d-4065-9bbb-9f8881434c23'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:17.463479 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4279b9d8-b91d-4065-9bbb-9f8881434c23 admin admin] The token cache is being invalidate because project 5b7b1f1cfcdb42c2b62f51f1c1828ac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:29:17.463766 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4279b9d8-b91d-4065-9bbb-9f8881434c23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:17.464432 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4279b9d8-b91d-4065-9bbb-9f8881434c23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:17.466276 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1009/2048] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:29:17 2022] DELETE /identity/v3/projects/5b7b1f1cfcdb42c2b62f51f1c1828ac6 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:17.467687 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8adc63-ccd1-4a0d-a11a-ef6f0ebefa45 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:17.467975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8adc63-ccd1-4a0d-a11a-ef6f0ebefa45 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:17.468256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8adc63-ccd1-4a0d-a11a-ef6f0ebefa45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:17.501474 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-1f8adc63-ccd1-4a0d-a11a-ef6f0ebefa45 None None] MFA Rules not processed for user `8ea65eaa5f014e059dd1539e0465ab34`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:17.502255 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ed4ff-b1e3-453f-a4d4-6622088798f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:17.503276 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ed4ff-b1e3-453f-a4d4-6622088798f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:17.503389 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1f8adc63-ccd1-4a0d-a11a-ef6f0ebefa45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:17.503496 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ed4ff-b1e3-453f-a4d4-6622088798f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:17.503675 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ed4ff-b1e3-453f-a4d4-6622088798f8 admin admin] PATH_INFO: `/v3/projects/854b0d57df0e4aeba2b1a21bbb7d1cde` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:17.505526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ed4ff-b1e3-453f-a4d4-6622088798f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=854b0d57df0e4aeba2b1a21bbb7d1cde)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:17.507837 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ed4ff-b1e3-453f-a4d4-6622088798f8 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:17.573366 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1010/2049] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:17.574830 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392f170-5396-431e-8ea5-24708e52be9b None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:17.575323 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392f170-5396-431e-8ea5-24708e52be9b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:17.575606 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392f170-5396-431e-8ea5-24708e52be9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:17.594769 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d392f170-5396-431e-8ea5-24708e52be9b None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:17.595991 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d392f170-5396-431e-8ea5-24708e52be9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:17.604847 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1011/2050] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:17.606030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392f170-5396-431e-8ea5-24708e52be9b None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:17.607512 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d392f170-5396-431e-8ea5-24708e52be9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:17.619847 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392f170-5396-431e-8ea5-24708e52be9b None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:17.624535 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9836f-dbf7-42ea-99f5-1685f61cffa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:17.625183 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9836f-dbf7-42ea-99f5-1685f61cffa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:17.625464 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9836f-dbf7-42ea-99f5-1685f61cffa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:17.625740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9836f-dbf7-42ea-99f5-1685f61cffa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:17.626460 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9836f-dbf7-42ea-99f5-1685f61cffa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:17.628634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9836f-dbf7-42ea-99f5-1685f61cffa1 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:17.677650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-217ed4ff-b1e3-453f-a4d4-6622088798f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '854b0d57df0e4aeba2b1a21bbb7d1cde', 'request_id': 'req-217ed4ff-b1e3-453f-a4d4-6622088798f8'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:17.752173 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1012/2051] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:29:17 2022] POST /identity/v3/projects => generated 391 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:17.752173 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8da3de-e784-418b-8ef1-9b67093a1353 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:17.752173 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8da3de-e784-418b-8ef1-9b67093a1353 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:17.752173 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8da3de-e784-418b-8ef1-9b67093a1353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:17.770168 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-ff8da3de-e784-418b-8ef1-9b67093a1353 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:17.771388 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ff8da3de-e784-418b-8ef1-9b67093a1353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:17.786556 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-217ed4ff-b1e3-453f-a4d4-6622088798f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '854b0d57df0e4aeba2b1a21bbb7d1cde', 'request_id': 'req-217ed4ff-b1e3-453f-a4d4-6622088798f8'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:17.793813 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-217ed4ff-b1e3-453f-a4d4-6622088798f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '854b0d57df0e4aeba2b1a21bbb7d1cde', 'request_id': 'req-217ed4ff-b1e3-453f-a4d4-6622088798f8'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:17.809497 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:17.811006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-217ed4ff-b1e3-453f-a4d4-6622088798f8 admin admin] The token cache is being invalidate because project 854b0d57df0e4aeba2b1a21bbb7d1cde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:29:17.811983 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-217ed4ff-b1e3-453f-a4d4-6622088798f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:17.812446 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-217ed4ff-b1e3-453f-a4d4-6622088798f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:17.818924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1040/2052] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:29:17 2022] DELETE /identity/v3/projects/854b0d57df0e4aeba2b1a21bbb7d1cde => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:17.819860 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ed4ff-b1e3-453f-a4d4-6622088798f8 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:17.822325 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-217ed4ff-b1e3-453f-a4d4-6622088798f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:17.860637 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1013/2053] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:17.860637 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac40da9-b098-428c-b789-bae25091e804 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:17.860637 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac40da9-b098-428c-b789-bae25091e804 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:17.860637 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac40da9-b098-428c-b789-bae25091e804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:17.887634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-5ac40da9-b098-428c-b789-bae25091e804 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:17.889453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5ac40da9-b098-428c-b789-bae25091e804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:17.900561 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ed4ff-b1e3-453f-a4d4-6622088798f8 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:17.905798 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125b065-f75a-4e4f-b9e7-96aaae1aa58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:17.906623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125b065-f75a-4e4f-b9e7-96aaae1aa58f admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:17.906971 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125b065-f75a-4e4f-b9e7-96aaae1aa58f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:17.907326 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125b065-f75a-4e4f-b9e7-96aaae1aa58f admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:17.907793 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1014/2054] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:17.908072 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125b065-f75a-4e4f-b9e7-96aaae1aa58f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:17.908642 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac40da9-b098-428c-b789-bae25091e804 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:17.910012 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125b065-f75a-4e4f-b9e7-96aaae1aa58f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:17.926865 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac40da9-b098-428c-b789-bae25091e804 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:17.934251 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832a535-18ca-435a-8877-b694d9f0f389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:17.935358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832a535-18ca-435a-8877-b694d9f0f389 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:17.935983 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832a535-18ca-435a-8877-b694d9f0f389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:17.936498 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832a535-18ca-435a-8877-b694d9f0f389 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:17.937770 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a832a535-18ca-435a-8877-b694d9f0f389 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:29:17.938260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a832a535-18ca-435a-8877-b694d9f0f389 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:17.940046 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a832a535-18ca-435a-8877-b694d9f0f389 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:17.956725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1015/2055] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:29:17.956725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d94028-6ca7-4647-b495-8271c073ab68 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:17.956725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d94028-6ca7-4647-b495-8271c073ab68 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:17.956725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d94028-6ca7-4647-b495-8271c073ab68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:17.979748 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-f6d94028-6ca7-4647-b495-8271c073ab68 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:17.981035 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f6d94028-6ca7-4647-b495-8271c073ab68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:17.991098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1016/2056] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:17.991895 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d94028-6ca7-4647-b495-8271c073ab68 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:17.995890 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:18.008355 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d94028-6ca7-4647-b495-8271c073ab68 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:18.013256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57883d47-6595-4514-93ff-efb257ad8ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:18.013968 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57883d47-6595-4514-93ff-efb257ad8ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:18.014495 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57883d47-6595-4514-93ff-efb257ad8ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:18.014790 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57883d47-6595-4514-93ff-efb257ad8ee1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:18.015524 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57883d47-6595-4514-93ff-efb257ad8ee1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:18.017921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57883d47-6595-4514-93ff-efb257ad8ee1 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:18.066109 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1041/2057] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:29:17 2022] POST /identity/v3/users => generated 302 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:18.278685 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125b065-f75a-4e4f-b9e7-96aaae1aa58f admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:18.278685 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125b065-f75a-4e4f-b9e7-96aaae1aa58f admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:18.278685 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed609bf-2290-4419-a7c1-53758ec96cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:18.278685 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed609bf-2290-4419-a7c1-53758ec96cef admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:18.279066 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed609bf-2290-4419-a7c1-53758ec96cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:18.279066 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed609bf-2290-4419-a7c1-53758ec96cef admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:18.279066 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed609bf-2290-4419-a7c1-53758ec96cef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:29:18.279066 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed609bf-2290-4419-a7c1-53758ec96cef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:18.279066 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed609bf-2290-4419-a7c1-53758ec96cef admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:18.279066 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1042/2058] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:29:18.279538 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed609bf-2290-4419-a7c1-53758ec96cef admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:18.287170 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed609bf-2290-4419-a7c1-53758ec96cef admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:18.292420 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad326b-2d5a-4dcb-a5b4-bae49091bd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:18.293074 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad326b-2d5a-4dcb-a5b4-bae49091bd90 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:18.293355 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad326b-2d5a-4dcb-a5b4-bae49091bd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:18.293637 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad326b-2d5a-4dcb-a5b4-bae49091bd90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:18.294354 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad326b-2d5a-4dcb-a5b4-bae49091bd90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:18.296256 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad326b-2d5a-4dcb-a5b4-bae49091bd90 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:18.489387 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1017/2059] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:29:17 2022] POST /identity/v3/projects => generated 373 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:18.489387 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57883d47-6595-4514-93ff-efb257ad8ee1 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:18.490018 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57883d47-6595-4514-93ff-efb257ad8ee1 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:18.494453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b6088-ff16-4441-91b6-4bf0053e243b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:18.495119 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b6088-ff16-4441-91b6-4bf0053e243b admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:18.495403 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b6088-ff16-4441-91b6-4bf0053e243b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:18.495678 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b6088-ff16-4441-91b6-4bf0053e243b admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:18.496400 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b6088-ff16-4441-91b6-4bf0053e243b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:18.498058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b6088-ff16-4441-91b6-4bf0053e243b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:18.511459 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1018/2060] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:18.511459 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b6088-ff16-4441-91b6-4bf0053e243b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:18.521777 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b6088-ff16-4441-91b6-4bf0053e243b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:18.544352 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9aa12f-be69-46ef-87bd-d38f15d4f339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:18.544352 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9aa12f-be69-46ef-87bd-d38f15d4f339 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:18.544352 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9aa12f-be69-46ef-87bd-d38f15d4f339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:18.544352 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9aa12f-be69-46ef-87bd-d38f15d4f339 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:18.544781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9aa12f-be69-46ef-87bd-d38f15d4f339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:18.544781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9aa12f-be69-46ef-87bd-d38f15d4f339 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:18.544956 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1043/2061] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:29:18 2022] POST /identity/v3/projects => generated 379 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:29:18.544956 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad326b-2d5a-4dcb-a5b4-bae49091bd90 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:18.630810 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad326b-2d5a-4dcb-a5b4-bae49091bd90 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:18.635840 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33adbf-b45e-4c02-a2e9-612592b3e3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:18.655911 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33adbf-b45e-4c02-a2e9-612592b3e3e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:18.655911 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33adbf-b45e-4c02-a2e9-612592b3e3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:18.655911 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33adbf-b45e-4c02-a2e9-612592b3e3e3 admin admin] PATH_INFO: `/v3/projects/76d963d1375b4ef6908f02e0ae7207b3/users/08aea42bf63041549b5404c3f94314c8/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:18.655911 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33adbf-b45e-4c02-a2e9-612592b3e3e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d963d1375b4ef6908f02e0ae7207b3, user_id=08aea42bf63041549b5404c3f94314c8, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:18.655911 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33adbf-b45e-4c02-a2e9-612592b3e3e3 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:18.686607 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1019/2062] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:29:18 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:18.686607 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9aa12f-be69-46ef-87bd-d38f15d4f339 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:18.695127 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9aa12f-be69-46ef-87bd-d38f15d4f339 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:18.700129 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4f21b-da49-459c-a85d-85dbb6ffa91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:18.700790 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4f21b-da49-459c-a85d-85dbb6ffa91c admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:18.701075 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4f21b-da49-459c-a85d-85dbb6ffa91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:18.701355 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4f21b-da49-459c-a85d-85dbb6ffa91c admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:18.702037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4f21b-da49-459c-a85d-85dbb6ffa91c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:18.703989 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4f21b-da49-459c-a85d-85dbb6ffa91c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:18.799686 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1044/2063] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:18 2022] PUT /identity/v3/projects/76d963d1375b4ef6908f02e0ae7207b3/users/08aea42bf63041549b5404c3f94314c8/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:18.799971 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1020/2064] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:29:18 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:18.801102 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4f21b-da49-459c-a85d-85dbb6ffa91c admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:18.801637 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33adbf-b45e-4c02-a2e9-612592b3e3e3 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:18.812421 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4f21b-da49-459c-a85d-85dbb6ffa91c admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:18.891339 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c62cfe-49e4-42ab-a00a-d9e013f494a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:18.892005 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c62cfe-49e4-42ab-a00a-d9e013f494a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:18.892292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c62cfe-49e4-42ab-a00a-d9e013f494a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:18.892569 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c62cfe-49e4-42ab-a00a-d9e013f494a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:18.893295 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c62cfe-49e4-42ab-a00a-d9e013f494a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:18.895353 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c62cfe-49e4-42ab-a00a-d9e013f494a4 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:18.898801 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33adbf-b45e-4c02-a2e9-612592b3e3e3 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:18.904398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e7f4a-5dc0-4f3c-84b4-88f3b14b97f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:18.905295 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e7f4a-5dc0-4f3c-84b4-88f3b14b97f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:18.905650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e7f4a-5dc0-4f3c-84b4-88f3b14b97f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:18.905998 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e7f4a-5dc0-4f3c-84b4-88f3b14b97f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:18.907272 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e7f4a-5dc0-4f3c-84b4-88f3b14b97f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:18.907411 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1021/2065] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:29:18.909612 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c62cfe-49e4-42ab-a00a-d9e013f494a4 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:18.913013 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e7f4a-5dc0-4f3c-84b4-88f3b14b97f2 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:18.921565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c62cfe-49e4-42ab-a00a-d9e013f494a4 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:18.926085 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1045/2066] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:18.927007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e7f4a-5dc0-4f3c-84b4-88f3b14b97f2 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:18.927801 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad4d45-5468-47e0-aacd-c21ba032f671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:18.928784 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad4d45-5468-47e0-aacd-c21ba032f671 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:18.929089 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad4d45-5468-47e0-aacd-c21ba032f671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:18.929344 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad4d45-5468-47e0-aacd-c21ba032f671 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:18.930072 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad4d45-5468-47e0-aacd-c21ba032f671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:18.934038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad4d45-5468-47e0-aacd-c21ba032f671 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:18.938599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e7f4a-5dc0-4f3c-84b4-88f3b14b97f2 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:18.944131 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c30f6-3457-4d34-9839-03f7d98fc56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:18.945134 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c30f6-3457-4d34-9839-03f7d98fc56e admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:18.945500 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c30f6-3457-4d34-9839-03f7d98fc56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:18.945725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1022/2067] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:18.947107 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c30f6-3457-4d34-9839-03f7d98fc56e admin admin] PATH_INFO: `/v3/projects/76d963d1375b4ef6908f02e0ae7207b3/users/08aea42bf63041549b5404c3f94314c8/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:18.947640 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad4d45-5468-47e0-aacd-c21ba032f671 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:18.949724 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c30f6-3457-4d34-9839-03f7d98fc56e admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d963d1375b4ef6908f02e0ae7207b3, user_id=08aea42bf63041549b5404c3f94314c8, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:18.952890 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c30f6-3457-4d34-9839-03f7d98fc56e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:18.959272 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad4d45-5468-47e0-aacd-c21ba032f671 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:18.967449 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51dc07b-a05d-4855-9b0e-7bb2839f76bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:18.968748 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dc07b-a05d-4855-9b0e-7bb2839f76bb admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:18.969187 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dc07b-a05d-4855-9b0e-7bb2839f76bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:18.970453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dc07b-a05d-4855-9b0e-7bb2839f76bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:18.971399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51dc07b-a05d-4855-9b0e-7bb2839f76bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:18.973198 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51dc07b-a05d-4855-9b0e-7bb2839f76bb admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:18.973504 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1046/2068] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:18 2022] PUT /identity/v3/projects/76d963d1375b4ef6908f02e0ae7207b3/users/08aea42bf63041549b5404c3f94314c8/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:18.974513 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c30f6-3457-4d34-9839-03f7d98fc56e admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:18.990833 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1023/2069] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:18.992304 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7f8da-c939-483b-a774-82d8b0d9482f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:18.992601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7f8da-c939-483b-a774-82d8b0d9482f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:18.994043 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7f8da-c939-483b-a774-82d8b0d9482f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:19.031713 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-2db7f8da-c939-483b-a774-82d8b0d9482f None None] MFA Rules not processed for user `eff8feae83ae43ba82cc5a58044cb7c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:19.033094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2db7f8da-c939-483b-a774-82d8b0d9482f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:19.106558 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c30f6-3457-4d34-9839-03f7d98fc56e admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:19.114481 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d60132-ea10-449f-ad30-5b38ef21c12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:19.114481 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d60132-ea10-449f-ad30-5b38ef21c12d admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:19.114481 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d60132-ea10-449f-ad30-5b38ef21c12d admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:19.114481 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d60132-ea10-449f-ad30-5b38ef21c12d admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:19.115166 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d60132-ea10-449f-ad30-5b38ef21c12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:19.116344 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d60132-ea10-449f-ad30-5b38ef21c12d admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:19.127921 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1047/2070] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:19.129537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4cbd5-fa5d-4951-9deb-3593c322aa40 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:19.129960 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4cbd5-fa5d-4951-9deb-3593c322aa40 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:19.130481 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4cbd5-fa5d-4951-9deb-3593c322aa40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:19.133298 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1024/2071] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:19.135389 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7f8da-c939-483b-a774-82d8b0d9482f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:19.152667 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7f8da-c939-483b-a774-82d8b0d9482f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:19.159388 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937f87b-0272-44b6-9bd7-5d3eb8515945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:19.160529 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937f87b-0272-44b6-9bd7-5d3eb8515945 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:19.160911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937f87b-0272-44b6-9bd7-5d3eb8515945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:19.161288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937f87b-0272-44b6-9bd7-5d3eb8515945 admin admin] PATH_INFO: `/v3/projects/b089b01afab141feaf44d8f85d1e7bee/users/e51158f7c7c44057883f044f7bcd1e62/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:19.172028 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:19.173425 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-c4c4cbd5-fa5d-4951-9deb-3593c322aa40 None None] MFA Rules not processed for user `08aea42bf63041549b5404c3f94314c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:19.178198 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c4c4cbd5-fa5d-4951-9deb-3593c322aa40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:19.204094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937f87b-0272-44b6-9bd7-5d3eb8515945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b089b01afab141feaf44d8f85d1e7bee, user_id=e51158f7c7c44057883f044f7bcd1e62, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:19.208734 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937f87b-0272-44b6-9bd7-5d3eb8515945 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:19.258241 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1048/2072] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:19.263123 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4cbd5-fa5d-4951-9deb-3593c322aa40 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:19.276627 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4cbd5-fa5d-4951-9deb-3593c322aa40 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:19.281594 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fade9-d57e-4f97-9471-fab62b1c85da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:19.282530 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fade9-d57e-4f97-9471-fab62b1c85da admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:19.282868 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fade9-d57e-4f97-9471-fab62b1c85da admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:19.283149 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fade9-d57e-4f97-9471-fab62b1c85da admin admin] PATH_INFO: `/v3/projects/1190694669b440f988fb4c304d2559c0/users/be65bedadc334ffe81e7e569c37bea87/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:19.300672 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fade9-d57e-4f97-9471-fab62b1c85da admin admin] RBAC: Authorizing `identity:create_grant(project_id=1190694669b440f988fb4c304d2559c0, user_id=be65bedadc334ffe81e7e569c37bea87, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:19.304242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fade9-d57e-4f97-9471-fab62b1c85da admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:19.314229 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1025/2073] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:19 2022] PUT /identity/v3/projects/b089b01afab141feaf44d8f85d1e7bee/users/e51158f7c7c44057883f044f7bcd1e62/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:19.314229 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937f87b-0272-44b6-9bd7-5d3eb8515945 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:19.315669 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d937f87b-0272-44b6-9bd7-5d3eb8515945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:19.387290 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937f87b-0272-44b6-9bd7-5d3eb8515945 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:19.389049 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1049/2074] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:19 2022] PUT /identity/v3/projects/1190694669b440f988fb4c304d2559c0/users/be65bedadc334ffe81e7e569c37bea87/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:19.393049 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fade9-d57e-4f97-9471-fab62b1c85da admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:19.403037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:19.403037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-be3fade9-d57e-4f97-9471-fab62b1c85da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:19.454857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05306a-e3a7-4c25-a1ee-474eeb622164 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:19.455569 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05306a-e3a7-4c25-a1ee-474eeb622164 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:19.455877 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05306a-e3a7-4c25-a1ee-474eeb622164 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:19.456155 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05306a-e3a7-4c25-a1ee-474eeb622164 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:19.463510 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fade9-d57e-4f97-9471-fab62b1c85da admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:19.463510 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741f30f-a519-452d-bdb7-96ba4aa457f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:19.463510 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741f30f-a519-452d-bdb7-96ba4aa457f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:19.463510 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741f30f-a519-452d-bdb7-96ba4aa457f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:19.463893 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741f30f-a519-452d-bdb7-96ba4aa457f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:19.523292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05306a-e3a7-4c25-a1ee-474eeb622164 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:19.525416 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05306a-e3a7-4c25-a1ee-474eeb622164 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:19.528165 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741f30f-a519-452d-bdb7-96ba4aa457f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:19.529701 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741f30f-a519-452d-bdb7-96ba4aa457f7 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:19.535755 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1026/2075] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:19.537250 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8bfaa-2943-4114-8742-d03fc2af1980 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:19.537617 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8bfaa-2943-4114-8742-d03fc2af1980 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:19.537959 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8bfaa-2943-4114-8742-d03fc2af1980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:19.542615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1050/2076] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:19.544085 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0033ef-c35e-4c64-a16d-bdbd09630d07 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:19.544450 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0033ef-c35e-4c64-a16d-bdbd09630d07 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:19.544803 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0033ef-c35e-4c64-a16d-bdbd09630d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:19.573646 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0c0033ef-c35e-4c64-a16d-bdbd09630d07 None None] MFA Rules not processed for user `be65bedadc334ffe81e7e569c37bea87`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:19.574752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-38a8bfaa-2943-4114-8742-d03fc2af1980 None None] MFA Rules not processed for user `e51158f7c7c44057883f044f7bcd1e62`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:19.575104 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0c0033ef-c35e-4c64-a16d-bdbd09630d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:19.576389 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-38a8bfaa-2943-4114-8742-d03fc2af1980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:19.685325 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1027/2077] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:19.686295 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8bfaa-2943-4114-8742-d03fc2af1980 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:19.693758 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1051/2078] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:19.699122 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0033ef-c35e-4c64-a16d-bdbd09630d07 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:19.704558 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8bfaa-2943-4114-8742-d03fc2af1980 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:19.709659 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13539b9e-ebe7-40d0-8983-e6f5c69fc7e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:19.710912 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13539b9e-ebe7-40d0-8983-e6f5c69fc7e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:19.711203 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13539b9e-ebe7-40d0-8983-e6f5c69fc7e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:19.711517 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13539b9e-ebe7-40d0-8983-e6f5c69fc7e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:19.715076 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-13539b9e-ebe7-40d0-8983-e6f5c69fc7e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:19.778045 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0033ef-c35e-4c64-a16d-bdbd09630d07 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:19.782846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26350db7-df7f-44f8-81c7-80b366b2b8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:19.783572 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26350db7-df7f-44f8-81c7-80b366b2b8f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:19.783852 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26350db7-df7f-44f8-81c7-80b366b2b8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:19.784138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26350db7-df7f-44f8-81c7-80b366b2b8f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:19.784970 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26350db7-df7f-44f8-81c7-80b366b2b8f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:19.786932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26350db7-df7f-44f8-81c7-80b366b2b8f5 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:19.792791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13539b9e-ebe7-40d0-8983-e6f5c69fc7e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:19.794439 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13539b9e-ebe7-40d0-8983-e6f5c69fc7e5 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:19.804240 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1028/2079] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:19.844089 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:20.067708 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:20.077557 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1052/2080] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:29:19 2022] POST /identity/v3/projects => generated 379 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:20.078709 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13539b9e-ebe7-40d0-8983-e6f5c69fc7e5 service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:20.091218 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13539b9e-ebe7-40d0-8983-e6f5c69fc7e5 service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:20.159649 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d08af-a441-4d54-8200-cab5da2613f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:20.160146 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d08af-a441-4d54-8200-cab5da2613f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:20.160427 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d08af-a441-4d54-8200-cab5da2613f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:20.160699 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d08af-a441-4d54-8200-cab5da2613f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:20.161556 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d08af-a441-4d54-8200-cab5da2613f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:20.163777 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d08af-a441-4d54-8200-cab5da2613f8 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:20.283506 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1029/2081] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:29:20 2022] POST /identity/v3/users => generated 296 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:20.284181 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26350db7-df7f-44f8-81c7-80b366b2b8f5 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:20.297268 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26350db7-df7f-44f8-81c7-80b366b2b8f5 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:20.301465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:20.306215 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eaa637-e7d4-42a7-bbd5-c32d675fa614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:20.310736 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eaa637-e7d4-42a7-bbd5-c32d675fa614 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:20.310736 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eaa637-e7d4-42a7-bbd5-c32d675fa614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:20.310736 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eaa637-e7d4-42a7-bbd5-c32d675fa614 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:20.310736 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eaa637-e7d4-42a7-bbd5-c32d675fa614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:20.312117 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eaa637-e7d4-42a7-bbd5-c32d675fa614 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:20.340390 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1053/2082] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:20.341119 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d08af-a441-4d54-8200-cab5da2613f8 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:20.343341 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eaa637-e7d4-42a7-bbd5-c32d675fa614 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:20.358926 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d08af-a441-4d54-8200-cab5da2613f8 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:20.367170 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc844b3-cf9c-48de-834d-32e9ab3036bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:20.368346 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc844b3-cf9c-48de-834d-32e9ab3036bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:20.369241 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc844b3-cf9c-48de-834d-32e9ab3036bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:20.369874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc844b3-cf9c-48de-834d-32e9ab3036bf admin admin] PATH_INFO: `/v3/projects/a610d974976441c8a5356bd09c9e10e9/users/546506a4a479462b8a1d5ec56c9149ac/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:20.387322 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc844b3-cf9c-48de-834d-32e9ab3036bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a610d974976441c8a5356bd09c9e10e9, user_id=546506a4a479462b8a1d5ec56c9149ac, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:20.390859 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc844b3-cf9c-48de-834d-32e9ab3036bf admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:20.409270 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eaa637-e7d4-42a7-bbd5-c32d675fa614 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:20.413375 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde9424-9382-460a-b5f5-adb873d8a770 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:20.414335 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde9424-9382-460a-b5f5-adb873d8a770 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:20.414827 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde9424-9382-460a-b5f5-adb873d8a770 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:20.415285 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde9424-9382-460a-b5f5-adb873d8a770 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:20.495851 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1030/2083] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:20 2022] PUT /identity/v3/projects/a610d974976441c8a5356bd09c9e10e9/users/546506a4a479462b8a1d5ec56c9149ac/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:20.495851 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc844b3-cf9c-48de-834d-32e9ab3036bf admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:20.506778 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde9424-9382-460a-b5f5-adb873d8a770 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:20.510998 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde9424-9382-460a-b5f5-adb873d8a770 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:20.527272 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1054/2084] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:29:20.584441 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc844b3-cf9c-48de-834d-32e9ab3036bf admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:20.598075 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2652469-f78e-4a75-b195-559fde13b3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:20.598877 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2652469-f78e-4a75-b195-559fde13b3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:20.599239 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2652469-f78e-4a75-b195-559fde13b3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:20.599599 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2652469-f78e-4a75-b195-559fde13b3f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:20.601475 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2652469-f78e-4a75-b195-559fde13b3f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:20.605242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:20.612802 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2652469-f78e-4a75-b195-559fde13b3f6 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:20.621299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1031/2085] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:20.622527 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde9424-9382-460a-b5f5-adb873d8a770 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:20.647610 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde9424-9382-460a-b5f5-adb873d8a770 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:20.663462 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aed478-40f7-4c06-b34c-263032e9c193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:20.664432 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aed478-40f7-4c06-b34c-263032e9c193 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:20.665541 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aed478-40f7-4c06-b34c-263032e9c193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:20.665877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aed478-40f7-4c06-b34c-263032e9c193 admin admin] PATH_INFO: `/v3/projects/a610d974976441c8a5356bd09c9e10e9/users/546506a4a479462b8a1d5ec56c9149ac/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:20.671860 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aed478-40f7-4c06-b34c-263032e9c193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a610d974976441c8a5356bd09c9e10e9, user_id=546506a4a479462b8a1d5ec56c9149ac, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:20.674618 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aed478-40f7-4c06-b34c-263032e9c193 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:20.704394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1055/2086] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:20 2022] PUT /identity/v3/projects/a610d974976441c8a5356bd09c9e10e9/users/546506a4a479462b8a1d5ec56c9149ac/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:20.705613 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874488f3-2014-4c6c-8a9b-acd5163ec7e5 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:20.705914 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874488f3-2014-4c6c-8a9b-acd5163ec7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:20.706368 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874488f3-2014-4c6c-8a9b-acd5163ec7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:20.740933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-874488f3-2014-4c6c-8a9b-acd5163ec7e5 None None] MFA Rules not processed for user `546506a4a479462b8a1d5ec56c9149ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:20.742151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-874488f3-2014-4c6c-8a9b-acd5163ec7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:20.822924 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1032/2087] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:20.841679 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aed478-40f7-4c06-b34c-263032e9c193 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:20.919093 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aed478-40f7-4c06-b34c-263032e9c193 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:20.923009 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45ba22-4ee7-4d22-8dda-f1de2a88c3b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:20.923659 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45ba22-4ee7-4d22-8dda-f1de2a88c3b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:20.923944 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45ba22-4ee7-4d22-8dda-f1de2a88c3b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:20.924223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45ba22-4ee7-4d22-8dda-f1de2a88c3b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:20.947907 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45ba22-4ee7-4d22-8dda-f1de2a88c3b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:20.949375 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45ba22-4ee7-4d22-8dda-f1de2a88c3b0 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:20.960239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1056/2088] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:21.674311 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30379026-f82b-4707-a052-e8668e03e20b None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:21.675242 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30379026-f82b-4707-a052-e8668e03e20b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:21.675853 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30379026-f82b-4707-a052-e8668e03e20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:21.710653 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-30379026-f82b-4707-a052-e8668e03e20b None None] MFA Rules not processed for user `eff8feae83ae43ba82cc5a58044cb7c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:21.727884 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-30379026-f82b-4707-a052-e8668e03e20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:21.731774 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45ba22-4ee7-4d22-8dda-f1de2a88c3b0 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:21.835695 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45ba22-4ee7-4d22-8dda-f1de2a88c3b0 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:21.839123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1033/2089] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:21.841983 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a360c2-ac7f-4a64-82f9-7e279d4dad24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:21.843259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a360c2-ac7f-4a64-82f9-7e279d4dad24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:21.843894 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a360c2-ac7f-4a64-82f9-7e279d4dad24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:21.844237 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a360c2-ac7f-4a64-82f9-7e279d4dad24 admin admin] PATH_INFO: `/v3/users/be65bedadc334ffe81e7e569c37bea87` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:21.845627 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a360c2-ac7f-4a64-82f9-7e279d4dad24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be65bedadc334ffe81e7e569c37bea87)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:21.847979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a360c2-ac7f-4a64-82f9-7e279d4dad24 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:22.068323 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:22.178635 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-66a360c2-ac7f-4a64-82f9-7e279d4dad24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be65bedadc334ffe81e7e569c37bea87'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:22.269825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-66a360c2-ac7f-4a64-82f9-7e279d4dad24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be65bedadc334ffe81e7e569c37bea87'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:22.288541 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-66a360c2-ac7f-4a64-82f9-7e279d4dad24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be65bedadc334ffe81e7e569c37bea87'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:22.304910 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-66a360c2-ac7f-4a64-82f9-7e279d4dad24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be65bedadc334ffe81e7e569c37bea87'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:22.306466 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-66a360c2-ac7f-4a64-82f9-7e279d4dad24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be65bedadc334ffe81e7e569c37bea87'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:22.314589 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1057/2090] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:29:21 2022] DELETE /identity/v3/users/be65bedadc334ffe81e7e569c37bea87 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:22.318929 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadf8e0-2655-4cfc-afa5-aedbb7b84cce None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:22.324031 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadf8e0-2655-4cfc-afa5-aedbb7b84cce None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:22.324031 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadf8e0-2655-4cfc-afa5-aedbb7b84cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:22.345856 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-9aadf8e0-2655-4cfc-afa5-aedbb7b84cce None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:22.347157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9aadf8e0-2655-4cfc-afa5-aedbb7b84cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:22.372529 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:22.418107 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1034/2091] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:22.425281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a360c2-ac7f-4a64-82f9-7e279d4dad24 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:22.427190 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-66a360c2-ac7f-4a64-82f9-7e279d4dad24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:22.496868 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a360c2-ac7f-4a64-82f9-7e279d4dad24 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:22.500497 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062ba43-4c02-40fa-901c-634e2978ed40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:22.501139 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062ba43-4c02-40fa-901c-634e2978ed40 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:22.501434 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062ba43-4c02-40fa-901c-634e2978ed40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:22.501959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062ba43-4c02-40fa-901c-634e2978ed40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:22.512348 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062ba43-4c02-40fa-901c-634e2978ed40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:22.513596 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062ba43-4c02-40fa-901c-634e2978ed40 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:22.523860 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1058/2092] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:22.992952 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbd901-0d44-4cbe-bb43-c519ef10d617 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:22.993395 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbd901-0d44-4cbe-bb43-c519ef10d617 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:22.993654 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbd901-0d44-4cbe-bb43-c519ef10d617 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:22.996003 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1035/2093] 10.222.0.13 () {54 vars in 921 bytes} [Tue Jul 5 21:29:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:29:23.007811 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b783197-f486-491e-b04d-46e1ce1d06af None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:23.008895 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b783197-f486-491e-b04d-46e1ce1d06af None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:23.009232 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b783197-f486-491e-b04d-46e1ce1d06af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:23.028706 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-4b783197-f486-491e-b04d-46e1ce1d06af None None] MFA Rules not processed for user `992db9dab5944769b192a868d6637a02`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:23.029288 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4b783197-f486-491e-b04d-46e1ce1d06af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:23.043961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbd901-0d44-4cbe-bb43-c519ef10d617 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:23.046104 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-68cbd901-0d44-4cbe-bb43-c519ef10d617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:23.078169 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbd901-0d44-4cbe-bb43-c519ef10d617 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:23.083585 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13edf4-0634-472a-a4e4-6f9fbee64183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:23.084672 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13edf4-0634-472a-a4e4-6f9fbee64183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:23.085144 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13edf4-0634-472a-a4e4-6f9fbee64183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:23.085680 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13edf4-0634-472a-a4e4-6f9fbee64183 admin admin] PATH_INFO: `/v3/projects/1190694669b440f988fb4c304d2559c0` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:23.088223 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13edf4-0634-472a-a4e4-6f9fbee64183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1190694669b440f988fb4c304d2559c0)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:23.092606 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13edf4-0634-472a-a4e4-6f9fbee64183 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:23.143697 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1059/2094] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Jul 5 21:29:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:23.156489 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b783197-f486-491e-b04d-46e1ce1d06af None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:23.158047 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4b783197-f486-491e-b04d-46e1ce1d06af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:23.171709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b783197-f486-491e-b04d-46e1ce1d06af None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:23.176838 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a9bc4-a885-441a-b983-48d3dceb2107 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992db9dab5944769b192a868d6637a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:23.177490 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a9bc4-a885-441a-b983-48d3dceb2107 service placement] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:23.177772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a9bc4-a885-441a-b983-48d3dceb2107 service placement] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:23.178053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a9bc4-a885-441a-b983-48d3dceb2107 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:23.188203 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a9bc4-a885-441a-b983-48d3dceb2107 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:23.192923 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a9bc4-a885-441a-b983-48d3dceb2107 service placement] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:23.203363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1060/2095] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:23.233934 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a9bc4-a885-441a-b983-48d3dceb2107 service placement] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:23.235868 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d17a9bc4-a885-441a-b983-48d3dceb2107 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:23.260009 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-cb13edf4-0634-472a-a4e4-6f9fbee64183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1190694669b440f988fb4c304d2559c0', 'request_id': 'req-cb13edf4-0634-472a-a4e4-6f9fbee64183'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:23.271483 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-cb13edf4-0634-472a-a4e4-6f9fbee64183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1190694669b440f988fb4c304d2559c0', 'request_id': 'req-cb13edf4-0634-472a-a4e4-6f9fbee64183'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:23.273489 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a9bc4-a885-441a-b983-48d3dceb2107 service placement] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:23.386212 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec44fa0-98cb-4552-ab8d-6fa3b0077c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:23.386899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-cb13edf4-0634-472a-a4e4-6f9fbee64183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1190694669b440f988fb4c304d2559c0', 'request_id': 'req-cb13edf4-0634-472a-a4e4-6f9fbee64183'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:23.387587 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec44fa0-98cb-4552-ab8d-6fa3b0077c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:23.388414 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec44fa0-98cb-4552-ab8d-6fa3b0077c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:23.389053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec44fa0-98cb-4552-ab8d-6fa3b0077c41 admin admin] PATH_INFO: `/v3/users/0e1b6f5fa3df4b829f521e1154a1f304` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:23.392067 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec44fa0-98cb-4552-ab8d-6fa3b0077c41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e1b6f5fa3df4b829f521e1154a1f304)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:23.395398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec44fa0-98cb-4552-ab8d-6fa3b0077c41 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:23.399663 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:23.410742 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-cb13edf4-0634-472a-a4e4-6f9fbee64183 admin admin] The token cache is being invalidate because project 1190694669b440f988fb4c304d2559c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:29:23.411035 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-cb13edf4-0634-472a-a4e4-6f9fbee64183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:23.411958 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-cb13edf4-0634-472a-a4e4-6f9fbee64183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:23.416393 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1036/2096] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:29:23 2022] DELETE /identity/v3/projects/1190694669b440f988fb4c304d2559c0 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:23.421286 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13edf4-0634-472a-a4e4-6f9fbee64183 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:23.426380 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-cb13edf4-0634-472a-a4e4-6f9fbee64183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:23.452773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13edf4-0634-472a-a4e4-6f9fbee64183 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:23.460016 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16615e01-6c76-43b1-bc65-a9a2d069b995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:23.460949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16615e01-6c76-43b1-bc65-a9a2d069b995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:23.462570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16615e01-6c76-43b1-bc65-a9a2d069b995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:23.462959 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16615e01-6c76-43b1-bc65-a9a2d069b995 admin admin] PATH_INFO: `/v3/users/546506a4a479462b8a1d5ec56c9149ac` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:23.464669 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16615e01-6c76-43b1-bc65-a9a2d069b995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=546506a4a479462b8a1d5ec56c9149ac)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:23.467321 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16615e01-6c76-43b1-bc65-a9a2d069b995 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:23.478928 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:23.635906 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-5ec44fa0-98cb-4552-ab8d-6fa3b0077c41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e1b6f5fa3df4b829f521e1154a1f304'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:23.712730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-5ec44fa0-98cb-4552-ab8d-6fa3b0077c41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e1b6f5fa3df4b829f521e1154a1f304'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:23.737883 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-5ec44fa0-98cb-4552-ab8d-6fa3b0077c41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e1b6f5fa3df4b829f521e1154a1f304'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:23.738082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-16615e01-6c76-43b1-bc65-a9a2d069b995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '546506a4a479462b8a1d5ec56c9149ac'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:23.740471 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-5ec44fa0-98cb-4552-ab8d-6fa3b0077c41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e1b6f5fa3df4b829f521e1154a1f304'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:23.741290 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-5ec44fa0-98cb-4552-ab8d-6fa3b0077c41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e1b6f5fa3df4b829f521e1154a1f304'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:23.748612 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-16615e01-6c76-43b1-bc65-a9a2d069b995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '546506a4a479462b8a1d5ec56c9149ac'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:23.753160 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1061/2097] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:29:23 2022] DELETE /identity/v3/users/0e1b6f5fa3df4b829f521e1154a1f304 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:23.762454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-16615e01-6c76-43b1-bc65-a9a2d069b995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '546506a4a479462b8a1d5ec56c9149ac'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:23.768067 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-16615e01-6c76-43b1-bc65-a9a2d069b995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '546506a4a479462b8a1d5ec56c9149ac'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:23.843040 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-16615e01-6c76-43b1-bc65-a9a2d069b995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '546506a4a479462b8a1d5ec56c9149ac'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:23.851793 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1037/2098] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:29:23 2022] DELETE /identity/v3/users/546506a4a479462b8a1d5ec56c9149ac => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:24.141861 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec44fa0-98cb-4552-ab8d-6fa3b0077c41 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:24.144176 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5ec44fa0-98cb-4552-ab8d-6fa3b0077c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:24.217816 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec44fa0-98cb-4552-ab8d-6fa3b0077c41 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:24.287246 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53f0c1-4f90-4d59-97d1-a606a8210870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:24.288237 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53f0c1-4f90-4d59-97d1-a606a8210870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:24.288459 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53f0c1-4f90-4d59-97d1-a606a8210870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:24.288719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53f0c1-4f90-4d59-97d1-a606a8210870 admin admin] PATH_INFO: `/v3/projects/d1aa7ef43ac148ae9adc05d9c78c4134` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:24.290164 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53f0c1-4f90-4d59-97d1-a606a8210870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1aa7ef43ac148ae9adc05d9c78c4134)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:24.292592 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53f0c1-4f90-4d59-97d1-a606a8210870 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:24.441760 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-9a53f0c1-4f90-4d59-97d1-a606a8210870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1aa7ef43ac148ae9adc05d9c78c4134', 'request_id': 'req-9a53f0c1-4f90-4d59-97d1-a606a8210870'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:24.516546 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-9a53f0c1-4f90-4d59-97d1-a606a8210870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1aa7ef43ac148ae9adc05d9c78c4134', 'request_id': 'req-9a53f0c1-4f90-4d59-97d1-a606a8210870'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:24.523943 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-9a53f0c1-4f90-4d59-97d1-a606a8210870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1aa7ef43ac148ae9adc05d9c78c4134', 'request_id': 'req-9a53f0c1-4f90-4d59-97d1-a606a8210870'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:24.525022 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16615e01-6c76-43b1-bc65-a9a2d069b995 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:24.526529 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-16615e01-6c76-43b1-bc65-a9a2d069b995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:24.536959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-9a53f0c1-4f90-4d59-97d1-a606a8210870 admin admin] The token cache is being invalidate because project d1aa7ef43ac148ae9adc05d9c78c4134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:29:24.537675 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-9a53f0c1-4f90-4d59-97d1-a606a8210870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:24.539145 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-9a53f0c1-4f90-4d59-97d1-a606a8210870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:24.540906 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1062/2099] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:29:24 2022] DELETE /identity/v3/projects/d1aa7ef43ac148ae9adc05d9c78c4134 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:24.542213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16615e01-6c76-43b1-bc65-a9a2d069b995 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:24.545771 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32867c-acec-41d9-a586-f97fd7caa6fc None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:24.546061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32867c-acec-41d9-a586-f97fd7caa6fc None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:24.546377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32867c-acec-41d9-a586-f97fd7caa6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:24.569991 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-1e32867c-acec-41d9-a586-f97fd7caa6fc None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:24.571986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-1e32867c-acec-41d9-a586-f97fd7caa6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:24.622572 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:24.638731 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1063/2100] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:24.647175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bacc29-12ac-42df-97e5-f862f7767438 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:24.647521 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bacc29-12ac-42df-97e5-f862f7767438 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:24.647810 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bacc29-12ac-42df-97e5-f862f7767438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:24.649649 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba6481-e52e-4028-af74-fdf8a1b2502d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:24.650598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba6481-e52e-4028-af74-fdf8a1b2502d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:24.651085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba6481-e52e-4028-af74-fdf8a1b2502d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:24.651574 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba6481-e52e-4028-af74-fdf8a1b2502d admin admin] PATH_INFO: `/v3/projects/a610d974976441c8a5356bd09c9e10e9` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:24.653385 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba6481-e52e-4028-af74-fdf8a1b2502d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a610d974976441c8a5356bd09c9e10e9)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:24.655986 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba6481-e52e-4028-af74-fdf8a1b2502d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:24.671455 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-40bacc29-12ac-42df-97e5-f862f7767438 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:24.672705 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-40bacc29-12ac-42df-97e5-f862f7767438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:24.686950 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1064/2101] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:24.688464 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bacc29-12ac-42df-97e5-f862f7767438 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:24.699236 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bacc29-12ac-42df-97e5-f862f7767438 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:24.704045 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a7524-a1db-4fd6-a659-ae857f9917ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:24.704739 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a7524-a1db-4fd6-a659-ae857f9917ca admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:24.705033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a7524-a1db-4fd6-a659-ae857f9917ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:24.705307 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a7524-a1db-4fd6-a659-ae857f9917ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:24.706043 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a7524-a1db-4fd6-a659-ae857f9917ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:29:24.706390 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a7524-a1db-4fd6-a659-ae857f9917ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:24.708001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a7524-a1db-4fd6-a659-ae857f9917ca admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:24.720807 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1065/2102] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:29:24.725313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a7524-a1db-4fd6-a659-ae857f9917ca admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:24.736257 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a7524-a1db-4fd6-a659-ae857f9917ca admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:24.741685 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f505af-aeb2-4caa-9e24-03f342386cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:24.742459 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f505af-aeb2-4caa-9e24-03f342386cfd admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:24.742802 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f505af-aeb2-4caa-9e24-03f342386cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:24.743161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f505af-aeb2-4caa-9e24-03f342386cfd admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:24.743868 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f505af-aeb2-4caa-9e24-03f342386cfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:24.745780 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f505af-aeb2-4caa-9e24-03f342386cfd admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:24.801439 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-cbba6481-e52e-4028-af74-fdf8a1b2502d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a610d974976441c8a5356bd09c9e10e9', 'request_id': 'req-cbba6481-e52e-4028-af74-fdf8a1b2502d'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:24.806981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-cbba6481-e52e-4028-af74-fdf8a1b2502d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a610d974976441c8a5356bd09c9e10e9', 'request_id': 'req-cbba6481-e52e-4028-af74-fdf8a1b2502d'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:24.848564 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1066/2103] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:29:24 2022] POST /identity/v3/projects => generated 405 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:29:24.849961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f505af-aeb2-4caa-9e24-03f342386cfd admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:24.900355 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-cbba6481-e52e-4028-af74-fdf8a1b2502d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a610d974976441c8a5356bd09c9e10e9', 'request_id': 'req-cbba6481-e52e-4028-af74-fdf8a1b2502d'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:24.913329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-cbba6481-e52e-4028-af74-fdf8a1b2502d admin admin] The token cache is being invalidate because project a610d974976441c8a5356bd09c9e10e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:29:24.913502 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f505af-aeb2-4caa-9e24-03f342386cfd admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:24.913600 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-cbba6481-e52e-4028-af74-fdf8a1b2502d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:24.914807 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-cbba6481-e52e-4028-af74-fdf8a1b2502d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:24.916387 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1038/2104] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:29:24 2022] DELETE /identity/v3/projects/a610d974976441c8a5356bd09c9e10e9 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:24.918876 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f20c6-e9a0-40c6-8321-aef9383a9184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:24.919995 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f20c6-e9a0-40c6-8321-aef9383a9184 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:24.920280 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f20c6-e9a0-40c6-8321-aef9383a9184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:24.920553 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f20c6-e9a0-40c6-8321-aef9383a9184 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:24.921004 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3629d-9cab-4aef-bf6d-24d54b12223e None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:24.921293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3629d-9cab-4aef-bf6d-24d54b12223e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:24.921402 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f20c6-e9a0-40c6-8321-aef9383a9184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:24.921574 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3629d-9cab-4aef-bf6d-24d54b12223e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:24.923246 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f20c6-e9a0-40c6-8321-aef9383a9184 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:24.947999 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-add3629d-9cab-4aef-bf6d-24d54b12223e None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:24.949247 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-add3629d-9cab-4aef-bf6d-24d54b12223e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:24.957290 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:24.957983 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1039/2105] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:29:24.965880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18479642-47c7-4c6e-bc3e-afb8bccc20ef None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:24.966192 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18479642-47c7-4c6e-bc3e-afb8bccc20ef None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:24.966474 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18479642-47c7-4c6e-bc3e-afb8bccc20ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:24.983976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-18479642-47c7-4c6e-bc3e-afb8bccc20ef None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:24.985173 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-18479642-47c7-4c6e-bc3e-afb8bccc20ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:24.993118 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1040/2106] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:29:24.999687 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18479642-47c7-4c6e-bc3e-afb8bccc20ef None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:25.009842 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18479642-47c7-4c6e-bc3e-afb8bccc20ef None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:25.014548 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc2cc2-78db-4605-b197-686821d9d89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:25.015193 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc2cc2-78db-4605-b197-686821d9d89e admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:25.015500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc2cc2-78db-4605-b197-686821d9d89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:25.015786 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc2cc2-78db-4605-b197-686821d9d89e admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:25.018270 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc2cc2-78db-4605-b197-686821d9d89e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:29:25.018586 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc2cc2-78db-4605-b197-686821d9d89e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:25.020201 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc2cc2-78db-4605-b197-686821d9d89e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:25.027834 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1067/2107] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:29:24 2022] POST /identity/v3/users => generated 303 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:29:25.029265 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f20c6-e9a0-40c6-8321-aef9383a9184 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:25.031030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-007f20c6-e9a0-40c6-8321-aef9383a9184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:25.037156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1041/2108] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:29:25.038223 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc2cc2-78db-4605-b197-686821d9d89e admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:25.048088 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f20c6-e9a0-40c6-8321-aef9383a9184 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:25.048977 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc2cc2-78db-4605-b197-686821d9d89e admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:25.052825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4606ee6-9128-46bd-9982-355c97f6bc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:25.053613 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720de1e2-3a84-495a-89dd-53006e20bda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:25.053898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4606ee6-9128-46bd-9982-355c97f6bc49 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:25.054215 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4606ee6-9128-46bd-9982-355c97f6bc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:25.054321 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720de1e2-3a84-495a-89dd-53006e20bda1 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:25.054498 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4606ee6-9128-46bd-9982-355c97f6bc49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:25.054619 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720de1e2-3a84-495a-89dd-53006e20bda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:25.054945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720de1e2-3a84-495a-89dd-53006e20bda1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:25.055511 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4606ee6-9128-46bd-9982-355c97f6bc49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:25.055727 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720de1e2-3a84-495a-89dd-53006e20bda1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:25.057124 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4606ee6-9128-46bd-9982-355c97f6bc49 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:25.057616 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720de1e2-3a84-495a-89dd-53006e20bda1 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:25.068732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1068/2109] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:25.073183 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4606ee6-9128-46bd-9982-355c97f6bc49 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:25.082808 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4606ee6-9128-46bd-9982-355c97f6bc49 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:25.088053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44903c-d00c-44c4-b7d4-efa7fa88d1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:25.088684 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44903c-d00c-44c4-b7d4-efa7fa88d1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:25.088965 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44903c-d00c-44c4-b7d4-efa7fa88d1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:25.089243 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44903c-d00c-44c4-b7d4-efa7fa88d1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:25.089953 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44903c-d00c-44c4-b7d4-efa7fa88d1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:25.091617 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44903c-d00c-44c4-b7d4-efa7fa88d1e8 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:25.101276 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1069/2110] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:25.105451 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44903c-d00c-44c4-b7d4-efa7fa88d1e8 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:25.116590 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44903c-d00c-44c4-b7d4-efa7fa88d1e8 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:25.122010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690f09e-c3c9-421a-ab3a-04ae583f675c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:25.124126 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690f09e-c3c9-421a-ab3a-04ae583f675c admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:25.124126 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690f09e-c3c9-421a-ab3a-04ae583f675c admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:25.124126 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690f09e-c3c9-421a-ab3a-04ae583f675c admin admin] PATH_INFO: `/v3/projects/e00320f0101540aab8ce733e689f1cee/users/a83eca978dbd4274af4063f5490919aa/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:25.139945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690f09e-c3c9-421a-ab3a-04ae583f675c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e00320f0101540aab8ce733e689f1cee, user_id=a83eca978dbd4274af4063f5490919aa, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:25.142774 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690f09e-c3c9-421a-ab3a-04ae583f675c admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:25.176094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1042/2111] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:29:25 2022] POST /identity/v3/projects => generated 361 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:29:25.177037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720de1e2-3a84-495a-89dd-53006e20bda1 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:25.178851 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-720de1e2-3a84-495a-89dd-53006e20bda1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:25.242831 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720de1e2-3a84-495a-89dd-53006e20bda1 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:25.247560 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fa87b-0a5e-4722-9d62-dbaac9db30fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:25.248431 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fa87b-0a5e-4722-9d62-dbaac9db30fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:25.248719 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fa87b-0a5e-4722-9d62-dbaac9db30fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:25.249000 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fa87b-0a5e-4722-9d62-dbaac9db30fb admin admin] PATH_INFO: `/v3/users/e51158f7c7c44057883f044f7bcd1e62` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:25.250245 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8fa87b-0a5e-4722-9d62-dbaac9db30fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e51158f7c7c44057883f044f7bcd1e62)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:25.252262 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1070/2112] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:25 2022] PUT /identity/v3/projects/e00320f0101540aab8ce733e689f1cee/users/a83eca978dbd4274af4063f5490919aa/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:29:25.252436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8fa87b-0a5e-4722-9d62-dbaac9db30fb admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:25.253034 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690f09e-c3c9-421a-ab3a-04ae583f675c admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:25.315918 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690f09e-c3c9-421a-ab3a-04ae583f675c admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:25.321248 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09409228-3d5e-44ff-a0c8-1a41640b022e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:25.322082 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09409228-3d5e-44ff-a0c8-1a41640b022e admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:25.322398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09409228-3d5e-44ff-a0c8-1a41640b022e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:25.322739 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09409228-3d5e-44ff-a0c8-1a41640b022e admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:25.323423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09409228-3d5e-44ff-a0c8-1a41640b022e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:25.325327 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09409228-3d5e-44ff-a0c8-1a41640b022e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:25.411566 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1071/2113] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:29:25 2022] POST /identity/v3/users => generated 281 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:25.412915 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4048a-fd8b-45d2-bd15-899aaaade24a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:25.413210 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4048a-fd8b-45d2-bd15-899aaaade24a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:25.413488 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4048a-fd8b-45d2-bd15-899aaaade24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:25.430681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-21b4048a-fd8b-45d2-bd15-899aaaade24a None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:25.431889 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-21b4048a-fd8b-45d2-bd15-899aaaade24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:25.439453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1072/2114] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:25.440207 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4048a-fd8b-45d2-bd15-899aaaade24a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:25.450811 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4048a-fd8b-45d2-bd15-899aaaade24a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:25.455798 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7f6b8-97fd-4e2c-ba51-d42a82dab9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:25.458502 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7f6b8-97fd-4e2c-ba51-d42a82dab9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:25.458502 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7f6b8-97fd-4e2c-ba51-d42a82dab9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:25.458502 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7f6b8-97fd-4e2c-ba51-d42a82dab9d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:25.458502 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7f6b8-97fd-4e2c-ba51-d42a82dab9d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:25.459690 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7f6b8-97fd-4e2c-ba51-d42a82dab9d6 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:25.473167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1073/2115] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:25.473167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7f6b8-97fd-4e2c-ba51-d42a82dab9d6 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:25.473393 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-39d7f6b8-97fd-4e2c-ba51-d42a82dab9d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:25.495182 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0c8fa87b-0a5e-4722-9d62-dbaac9db30fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e51158f7c7c44057883f044f7bcd1e62'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:25.502883 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0c8fa87b-0a5e-4722-9d62-dbaac9db30fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e51158f7c7c44057883f044f7bcd1e62'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:25.516545 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0c8fa87b-0a5e-4722-9d62-dbaac9db30fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e51158f7c7c44057883f044f7bcd1e62'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:25.518051 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0c8fa87b-0a5e-4722-9d62-dbaac9db30fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e51158f7c7c44057883f044f7bcd1e62'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:25.541121 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7f6b8-97fd-4e2c-ba51-d42a82dab9d6 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:25.544880 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2864edd-d36d-43e7-a865-bf8c128d9e69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:25.545706 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2864edd-d36d-43e7-a865-bf8c128d9e69 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:25.545853 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2864edd-d36d-43e7-a865-bf8c128d9e69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:25.546071 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2864edd-d36d-43e7-a865-bf8c128d9e69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:25.558785 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2864edd-d36d-43e7-a865-bf8c128d9e69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:25.560258 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2864edd-d36d-43e7-a865-bf8c128d9e69 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:25.570504 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1074/2116] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:25.571333 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2864edd-d36d-43e7-a865-bf8c128d9e69 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:25.580943 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2864edd-d36d-43e7-a865-bf8c128d9e69 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:25.591500 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577efb79-7473-4d19-8674-e50f8221ac38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:25.592351 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577efb79-7473-4d19-8674-e50f8221ac38 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:25.592619 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577efb79-7473-4d19-8674-e50f8221ac38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:25.592900 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577efb79-7473-4d19-8674-e50f8221ac38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:25.593671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577efb79-7473-4d19-8674-e50f8221ac38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:25.595933 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577efb79-7473-4d19-8674-e50f8221ac38 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:25.597100 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0c8fa87b-0a5e-4722-9d62-dbaac9db30fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e51158f7c7c44057883f044f7bcd1e62'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:25.605081 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1043/2117] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:29:25 2022] DELETE /identity/v3/users/e51158f7c7c44057883f044f7bcd1e62 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:25.607790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1075/2118] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:25.609884 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823919ec-1207-450e-9b10-d3270f6a519d None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:25.610382 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823919ec-1207-450e-9b10-d3270f6a519d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:25.610652 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823919ec-1207-450e-9b10-d3270f6a519d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:25.611411 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577efb79-7473-4d19-8674-e50f8221ac38 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:25.613448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-577efb79-7473-4d19-8674-e50f8221ac38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:25.627607 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577efb79-7473-4d19-8674-e50f8221ac38 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:25.629611 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-823919ec-1207-450e-9b10-d3270f6a519d None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:25.630949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-823919ec-1207-450e-9b10-d3270f6a519d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:25.693737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d4523-f697-4040-b28e-723801f4a706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:25.694669 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d4523-f697-4040-b28e-723801f4a706 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:25.695059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d4523-f697-4040-b28e-723801f4a706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:25.695366 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d4523-f697-4040-b28e-723801f4a706 admin admin] PATH_INFO: `/v3/projects/2e8902a5e5724680a05640ba5941de06/users/916ecbd204e84326a13655c751c40f61/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:25.703074 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1044/2119] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:25.713104 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823919ec-1207-450e-9b10-d3270f6a519d None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:25.714579 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d4523-f697-4040-b28e-723801f4a706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e8902a5e5724680a05640ba5941de06, user_id=916ecbd204e84326a13655c751c40f61, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:25.715426 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-823919ec-1207-450e-9b10-d3270f6a519d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:25.717544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d4523-f697-4040-b28e-723801f4a706 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:25.780228 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823919ec-1207-450e-9b10-d3270f6a519d None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:25.785838 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b7c24-120f-4b60-a916-e0472b6cba19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:25.786592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b7c24-120f-4b60-a916-e0472b6cba19 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:25.788816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b7c24-120f-4b60-a916-e0472b6cba19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:25.788816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b7c24-120f-4b60-a916-e0472b6cba19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:25.799590 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b7c24-120f-4b60-a916-e0472b6cba19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:25.801085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b7c24-120f-4b60-a916-e0472b6cba19 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:25.812907 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1045/2120] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:25.856961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1076/2121] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:25 2022] PUT /identity/v3/projects/2e8902a5e5724680a05640ba5941de06/users/916ecbd204e84326a13655c751c40f61/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:25.859900 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2926d-eb2e-434a-b559-d29026bd7dc4 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:25.860049 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2926d-eb2e-434a-b559-d29026bd7dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:25.860299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2926d-eb2e-434a-b559-d29026bd7dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:25.907832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-eee2926d-eb2e-434a-b559-d29026bd7dc4 None None] MFA Rules not processed for user `916ecbd204e84326a13655c751c40f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:25.909072 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-eee2926d-eb2e-434a-b559-d29026bd7dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:25.991592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1046/2122] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:26.027490 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d4523-f697-4040-b28e-723801f4a706 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:26.029354 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-cf6d4523-f697-4040-b28e-723801f4a706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:26.099741 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d4523-f697-4040-b28e-723801f4a706 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:26.103764 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a09670-0ca1-47bc-8e76-17e68da769f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:26.104460 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a09670-0ca1-47bc-8e76-17e68da769f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:26.104771 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a09670-0ca1-47bc-8e76-17e68da769f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:26.105216 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a09670-0ca1-47bc-8e76-17e68da769f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:26.115917 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a09670-0ca1-47bc-8e76-17e68da769f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:26.117919 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a09670-0ca1-47bc-8e76-17e68da769f7 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:26.137267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1077/2123] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:26.145728 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2926d-eb2e-434a-b559-d29026bd7dc4 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:26.224256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2926d-eb2e-434a-b559-d29026bd7dc4 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:26.230455 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fc35d-79b6-42d7-988e-99c58636293d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:26.231351 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fc35d-79b6-42d7-988e-99c58636293d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:26.231635 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fc35d-79b6-42d7-988e-99c58636293d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:26.232057 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fc35d-79b6-42d7-988e-99c58636293d admin admin] PATH_INFO: `/v3/users/916ecbd204e84326a13655c751c40f61` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:26.233292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fc35d-79b6-42d7-988e-99c58636293d admin admin] RBAC: Authorizing `identity:delete_user(user_id=916ecbd204e84326a13655c751c40f61)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:26.235286 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fc35d-79b6-42d7-988e-99c58636293d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:26.258657 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:26.376792 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a09670-0ca1-47bc-8e76-17e68da769f7 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:26.378596 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c4a09670-0ca1-47bc-8e76-17e68da769f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:26.393680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a09670-0ca1-47bc-8e76-17e68da769f7 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:26.401180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d17f45-30ec-4496-8877-3e6c9947d94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:26.402202 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d17f45-30ec-4496-8877-3e6c9947d94e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:26.402501 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d17f45-30ec-4496-8877-3e6c9947d94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:26.402789 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d17f45-30ec-4496-8877-3e6c9947d94e admin admin] PATH_INFO: `/v3/users/8ea65eaa5f014e059dd1539e0465ab34` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:26.404059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d17f45-30ec-4496-8877-3e6c9947d94e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ea65eaa5f014e059dd1539e0465ab34)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:26.405990 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d17f45-30ec-4496-8877-3e6c9947d94e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:26.450839 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c50fc35d-79b6-42d7-988e-99c58636293d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '916ecbd204e84326a13655c751c40f61'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:26.455065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:26.461373 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c50fc35d-79b6-42d7-988e-99c58636293d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '916ecbd204e84326a13655c751c40f61'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:26.474331 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c50fc35d-79b6-42d7-988e-99c58636293d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '916ecbd204e84326a13655c751c40f61'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:26.475135 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c50fc35d-79b6-42d7-988e-99c58636293d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '916ecbd204e84326a13655c751c40f61'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:26.540381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c50fc35d-79b6-42d7-988e-99c58636293d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '916ecbd204e84326a13655c751c40f61'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:26.546926 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1047/2124] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:29:26 2022] DELETE /identity/v3/users/916ecbd204e84326a13655c751c40f61 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:26.551208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efad406-52fe-4000-9303-4d191b7354c7 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:26.551493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efad406-52fe-4000-9303-4d191b7354c7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:26.551764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efad406-52fe-4000-9303-4d191b7354c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:26.571961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-9efad406-52fe-4000-9303-4d191b7354c7 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:26.573307 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9efad406-52fe-4000-9303-4d191b7354c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:26.581269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f1d17f45-30ec-4496-8877-3e6c9947d94e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ea65eaa5f014e059dd1539e0465ab34'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:26.654256 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f1d17f45-30ec-4496-8877-3e6c9947d94e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ea65eaa5f014e059dd1539e0465ab34'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:26.680432 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f1d17f45-30ec-4496-8877-3e6c9947d94e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ea65eaa5f014e059dd1539e0465ab34'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:26.682320 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1048/2125] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:29:26.683319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efad406-52fe-4000-9303-4d191b7354c7 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:26.684777 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9efad406-52fe-4000-9303-4d191b7354c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:26.705406 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efad406-52fe-4000-9303-4d191b7354c7 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:26.705721 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f1d17f45-30ec-4496-8877-3e6c9947d94e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ea65eaa5f014e059dd1539e0465ab34'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:26.706720 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f1d17f45-30ec-4496-8877-3e6c9947d94e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ea65eaa5f014e059dd1539e0465ab34'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:26.718539 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1078/2126] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:29:26 2022] DELETE /identity/v3/users/8ea65eaa5f014e059dd1539e0465ab34 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:29:26.720241 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d17f45-30ec-4496-8877-3e6c9947d94e admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:26.721599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f1d17f45-30ec-4496-8877-3e6c9947d94e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:26.721705 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30ce3a-eb53-4d30-8324-e4cd03b3360a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:26.722608 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30ce3a-eb53-4d30-8324-e4cd03b3360a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:26.723003 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30ce3a-eb53-4d30-8324-e4cd03b3360a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:26.723337 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30ce3a-eb53-4d30-8324-e4cd03b3360a admin admin] PATH_INFO: `/v3/projects/b089b01afab141feaf44d8f85d1e7bee` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:26.724546 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30ce3a-eb53-4d30-8324-e4cd03b3360a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b089b01afab141feaf44d8f85d1e7bee)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:26.726616 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30ce3a-eb53-4d30-8324-e4cd03b3360a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:26.784131 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d17f45-30ec-4496-8877-3e6c9947d94e admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:26.787766 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8dd0ce-9250-47db-a39b-26118e34d9ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:26.788408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dd0ce-9250-47db-a39b-26118e34d9ae service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:26.788690 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dd0ce-9250-47db-a39b-26118e34d9ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:26.788964 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dd0ce-9250-47db-a39b-26118e34d9ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:26.792225 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-be8dd0ce-9250-47db-a39b-26118e34d9ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:26.842845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ff30ce3a-eb53-4d30-8324-e4cd03b3360a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b089b01afab141feaf44d8f85d1e7bee', 'request_id': 'req-ff30ce3a-eb53-4d30-8324-e4cd03b3360a'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:26.849198 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ff30ce3a-eb53-4d30-8324-e4cd03b3360a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b089b01afab141feaf44d8f85d1e7bee', 'request_id': 'req-ff30ce3a-eb53-4d30-8324-e4cd03b3360a'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:26.863734 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8dd0ce-9250-47db-a39b-26118e34d9ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:26.865183 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8dd0ce-9250-47db-a39b-26118e34d9ae service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:26.881651 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1079/2127] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:26.881651 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255181b-f7d8-49e1-b00b-c9be44294245 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:26.881651 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255181b-f7d8-49e1-b00b-c9be44294245 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:26.881651 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255181b-f7d8-49e1-b00b-c9be44294245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:26.896164 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-7255181b-f7d8-49e1-b00b-c9be44294245 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:26.897429 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7255181b-f7d8-49e1-b00b-c9be44294245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:26.959250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1080/2128] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:26.974359 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255181b-f7d8-49e1-b00b-c9be44294245 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:27.022277 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ff30ce3a-eb53-4d30-8324-e4cd03b3360a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b089b01afab141feaf44d8f85d1e7bee', 'request_id': 'req-ff30ce3a-eb53-4d30-8324-e4cd03b3360a'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:27.030739 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255181b-f7d8-49e1-b00b-c9be44294245 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:27.033647 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec04d94-f518-4b77-9536-24d236c112ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:27.034336 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec04d94-f518-4b77-9536-24d236c112ba service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:27.034620 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec04d94-f518-4b77-9536-24d236c112ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:27.034896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec04d94-f518-4b77-9536-24d236c112ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:27.046290 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec04d94-f518-4b77-9536-24d236c112ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:27.048142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec04d94-f518-4b77-9536-24d236c112ba service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:27.049840 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ff30ce3a-eb53-4d30-8324-e4cd03b3360a admin admin] The token cache is being invalidate because project b089b01afab141feaf44d8f85d1e7bee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:29:27.050245 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ff30ce3a-eb53-4d30-8324-e4cd03b3360a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:27.053576 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ff30ce3a-eb53-4d30-8324-e4cd03b3360a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:27.062383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1049/2129] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:29:26 2022] DELETE /identity/v3/projects/b089b01afab141feaf44d8f85d1e7bee => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:27.063795 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1081/2130] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:29:27.064370 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a33bd2-d56b-42a9-8486-336b25d09e54 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:27.064720 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a33bd2-d56b-42a9-8486-336b25d09e54 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:27.065069 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a33bd2-d56b-42a9-8486-336b25d09e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:27.099200 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-62a33bd2-d56b-42a9-8486-336b25d09e54 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:27.100795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-62a33bd2-d56b-42a9-8486-336b25d09e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:27.115967 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1050/2131] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:27.124902 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917e00b-9964-4c39-9d18-0b99a5584f51 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:27.125199 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917e00b-9964-4c39-9d18-0b99a5584f51 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:27.125472 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917e00b-9964-4c39-9d18-0b99a5584f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:27.151753 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-7917e00b-9964-4c39-9d18-0b99a5584f51 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:27.154516 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7917e00b-9964-4c39-9d18-0b99a5584f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:27.170234 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a33bd2-d56b-42a9-8486-336b25d09e54 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:27.177105 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1082/2132] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:27.185840 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de00ff-6e93-41b0-bc00-8ac29737de40 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:27.186197 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a33bd2-d56b-42a9-8486-336b25d09e54 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:27.186562 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de00ff-6e93-41b0-bc00-8ac29737de40 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:27.187597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de00ff-6e93-41b0-bc00-8ac29737de40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:27.200329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e473ef-0e6d-4770-a2da-7745150c3a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:27.201842 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e473ef-0e6d-4770-a2da-7745150c3a67 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:27.203180 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e473ef-0e6d-4770-a2da-7745150c3a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:27.204813 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e473ef-0e6d-4770-a2da-7745150c3a67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:27.205578 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e473ef-0e6d-4770-a2da-7745150c3a67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:29:27.205883 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e473ef-0e6d-4770-a2da-7745150c3a67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:27.211152 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e473ef-0e6d-4770-a2da-7745150c3a67 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:27.233742 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1051/2133] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:29:27.237838 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e473ef-0e6d-4770-a2da-7745150c3a67 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:27.249143 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-71de00ff-6e93-41b0-bc00-8ac29737de40 None None] MFA Rules not processed for user `a83eca978dbd4274af4063f5490919aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:27.250613 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-71de00ff-6e93-41b0-bc00-8ac29737de40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:27.258777 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e473ef-0e6d-4770-a2da-7745150c3a67 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:27.265445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cd64d-ad89-4902-b237-d88e03d3dd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:27.266505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cd64d-ad89-4902-b237-d88e03d3dd67 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:27.266804 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cd64d-ad89-4902-b237-d88e03d3dd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:27.267090 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cd64d-ad89-4902-b237-d88e03d3dd67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:27.267794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cd64d-ad89-4902-b237-d88e03d3dd67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:27.269831 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cd64d-ad89-4902-b237-d88e03d3dd67 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:27.277992 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:27.333539 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1083/2134] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:27 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:27.337879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de00ff-6e93-41b0-bc00-8ac29737de40 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:27.339330 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-71de00ff-6e93-41b0-bc00-8ac29737de40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:27.362491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de00ff-6e93-41b0-bc00-8ac29737de40 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:27.374432 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc14b82-e63f-4709-97e9-c0ac25f67564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:27.375403 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc14b82-e63f-4709-97e9-c0ac25f67564 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:27.375876 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc14b82-e63f-4709-97e9-c0ac25f67564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:27.376373 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc14b82-e63f-4709-97e9-c0ac25f67564 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:27.377643 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc14b82-e63f-4709-97e9-c0ac25f67564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:27.380078 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc14b82-e63f-4709-97e9-c0ac25f67564 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:27.392289 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1052/2135] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:29:27 2022] POST /identity/v3/projects => generated 369 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:27.397081 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cd64d-ad89-4902-b237-d88e03d3dd67 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:27.477966 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cd64d-ad89-4902-b237-d88e03d3dd67 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:27.485342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a041d-bd9e-41ef-b6ac-707b3d1d3d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:27.486362 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a041d-bd9e-41ef-b6ac-707b3d1d3d4c admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:27.486793 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a041d-bd9e-41ef-b6ac-707b3d1d3d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:27.487307 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a041d-bd9e-41ef-b6ac-707b3d1d3d4c admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:27.488178 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a041d-bd9e-41ef-b6ac-707b3d1d3d4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:27.490492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a041d-bd9e-41ef-b6ac-707b3d1d3d4c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:27.494037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1084/2136] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:29:27 2022] POST /identity/v3/projects => generated 403 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:29:27.498093 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc14b82-e63f-4709-97e9-c0ac25f67564 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:27.574983 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1053/2137] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:29:27 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:27.576719 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a041d-bd9e-41ef-b6ac-707b3d1d3d4c admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:27.577358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-005a041d-bd9e-41ef-b6ac-707b3d1d3d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:27.588042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc14b82-e63f-4709-97e9-c0ac25f67564 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:27.595470 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a041d-bd9e-41ef-b6ac-707b3d1d3d4c admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:27.597658 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c65209-120d-4a6d-8daa-f48fe45584d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:27.598790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c65209-120d-4a6d-8daa-f48fe45584d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:27.598790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c65209-120d-4a6d-8daa-f48fe45584d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:27.598999 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c65209-120d-4a6d-8daa-f48fe45584d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:27.599598 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c65209-120d-4a6d-8daa-f48fe45584d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:27.601633 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c65209-120d-4a6d-8daa-f48fe45584d6 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:27.606442 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ca451-3044-4236-a5c2-09a5acec7a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:27.611367 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ca451-3044-4236-a5c2-09a5acec7a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:27.611367 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ca451-3044-4236-a5c2-09a5acec7a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:27.611367 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ca451-3044-4236-a5c2-09a5acec7a64 admin admin] PATH_INFO: `/v3/projects/2e8902a5e5724680a05640ba5941de06` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:27.611367 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ca451-3044-4236-a5c2-09a5acec7a64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e8902a5e5724680a05640ba5941de06)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:27.611648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ca451-3044-4236-a5c2-09a5acec7a64 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:27.715318 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1085/2138] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:29:27 2022] POST /identity/v3/users => generated 308 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:27.715418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c65209-120d-4a6d-8daa-f48fe45584d6 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:27.726817 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c65209-120d-4a6d-8daa-f48fe45584d6 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:27.738821 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608861d-1100-4504-8c35-140b38458802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:27.743040 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608861d-1100-4504-8c35-140b38458802 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:27.743471 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608861d-1100-4504-8c35-140b38458802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:27.743763 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608861d-1100-4504-8c35-140b38458802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:27.744514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7608861d-1100-4504-8c35-140b38458802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:27.746158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7608861d-1100-4504-8c35-140b38458802 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:27.760143 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1086/2139] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:27.761031 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608861d-1100-4504-8c35-140b38458802 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:27.763028 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-592ca451-3044-4236-a5c2-09a5acec7a64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e8902a5e5724680a05640ba5941de06', 'request_id': 'req-592ca451-3044-4236-a5c2-09a5acec7a64'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:27.763495 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7608861d-1100-4504-8c35-140b38458802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:27.769947 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-592ca451-3044-4236-a5c2-09a5acec7a64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e8902a5e5724680a05640ba5941de06', 'request_id': 'req-592ca451-3044-4236-a5c2-09a5acec7a64'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:27.777332 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608861d-1100-4504-8c35-140b38458802 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:27.834846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d48981-b5bb-4177-ac57-5f7c11c36170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:27.835720 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d48981-b5bb-4177-ac57-5f7c11c36170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:27.836131 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d48981-b5bb-4177-ac57-5f7c11c36170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:27.836418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d48981-b5bb-4177-ac57-5f7c11c36170 admin admin] PATH_INFO: `/v3/projects/57acf956a50c4aee98b31795b868d0ed` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:27.837631 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d48981-b5bb-4177-ac57-5f7c11c36170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57acf956a50c4aee98b31795b868d0ed)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:27.839673 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d48981-b5bb-4177-ac57-5f7c11c36170 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:27.863446 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-592ca451-3044-4236-a5c2-09a5acec7a64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e8902a5e5724680a05640ba5941de06', 'request_id': 'req-592ca451-3044-4236-a5c2-09a5acec7a64'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:27.878282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-592ca451-3044-4236-a5c2-09a5acec7a64 admin admin] The token cache is being invalidate because project 2e8902a5e5724680a05640ba5941de06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:29:27.878578 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-592ca451-3044-4236-a5c2-09a5acec7a64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:27.879353 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-592ca451-3044-4236-a5c2-09a5acec7a64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:27.881174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1054/2140] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:29:27 2022] DELETE /identity/v3/projects/2e8902a5e5724680a05640ba5941de06 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:27.881930 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ca451-3044-4236-a5c2-09a5acec7a64 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:27.883888 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-592ca451-3044-4236-a5c2-09a5acec7a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:27.897211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ca451-3044-4236-a5c2-09a5acec7a64 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:27.902557 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d799f8-52a3-4620-bc3b-4928919dbf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:27.903240 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d799f8-52a3-4620-bc3b-4928919dbf23 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:27.903527 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d799f8-52a3-4620-bc3b-4928919dbf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:27.903804 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d799f8-52a3-4620-bc3b-4928919dbf23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:27.904535 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d799f8-52a3-4620-bc3b-4928919dbf23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:27.906165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d799f8-52a3-4620-bc3b-4928919dbf23 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:27.917315 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1055/2141] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:27.917974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d799f8-52a3-4620-bc3b-4928919dbf23 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:27.919743 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-18d799f8-52a3-4620-bc3b-4928919dbf23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:27.933119 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d799f8-52a3-4620-bc3b-4928919dbf23 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:27.938379 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938908ef-3a9b-4ed2-b5df-8277b6e7e6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:27.938830 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938908ef-3a9b-4ed2-b5df-8277b6e7e6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:27.939115 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938908ef-3a9b-4ed2-b5df-8277b6e7e6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:27.939417 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938908ef-3a9b-4ed2-b5df-8277b6e7e6c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:27.940148 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938908ef-3a9b-4ed2-b5df-8277b6e7e6c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:27.941762 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938908ef-3a9b-4ed2-b5df-8277b6e7e6c7 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:27.952522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1056/2142] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:27.953912 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f595d25-bc51-40e4-80cf-474afff6d7ee None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:27.954219 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f595d25-bc51-40e4-80cf-474afff6d7ee None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:27.958715 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f595d25-bc51-40e4-80cf-474afff6d7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:27.972949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-1f595d25-bc51-40e4-80cf-474afff6d7ee None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:27.974161 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1f595d25-bc51-40e4-80cf-474afff6d7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:27.983029 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1057/2143] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:27.983792 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f595d25-bc51-40e4-80cf-474afff6d7ee None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:27.993423 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f595d25-bc51-40e4-80cf-474afff6d7ee None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:27.997975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60b4a3-5086-420a-a289-97140f9423da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:27.998862 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60b4a3-5086-420a-a289-97140f9423da admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:27.999140 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60b4a3-5086-420a-a289-97140f9423da admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:27.999412 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60b4a3-5086-420a-a289-97140f9423da admin admin] PATH_INFO: `/v3/projects/55d3426358124733a8727f586076ef43/users/e98e87c11da340f189c0de89635c2f3b/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:28.016814 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60b4a3-5086-420a-a289-97140f9423da admin admin] RBAC: Authorizing `identity:create_grant(project_id=55d3426358124733a8727f586076ef43, user_id=e98e87c11da340f189c0de89635c2f3b, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:28.019505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60b4a3-5086-420a-a289-97140f9423da admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:28.042847 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:28.115559 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1058/2144] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:27 2022] PUT /identity/v3/projects/55d3426358124733a8727f586076ef43/users/e98e87c11da340f189c0de89635c2f3b/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:28.116524 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60b4a3-5086-420a-a289-97140f9423da admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:28.125124 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-59d48981-b5bb-4177-ac57-5f7c11c36170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57acf956a50c4aee98b31795b868d0ed', 'request_id': 'req-59d48981-b5bb-4177-ac57-5f7c11c36170'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:28.179553 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60b4a3-5086-420a-a289-97140f9423da admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:28.188548 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-59d48981-b5bb-4177-ac57-5f7c11c36170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57acf956a50c4aee98b31795b868d0ed', 'request_id': 'req-59d48981-b5bb-4177-ac57-5f7c11c36170'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:28.195260 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-59d48981-b5bb-4177-ac57-5f7c11c36170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57acf956a50c4aee98b31795b868d0ed', 'request_id': 'req-59d48981-b5bb-4177-ac57-5f7c11c36170'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:28.210291 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-59d48981-b5bb-4177-ac57-5f7c11c36170 admin admin] The token cache is being invalidate because project 57acf956a50c4aee98b31795b868d0ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:29:28.210602 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-59d48981-b5bb-4177-ac57-5f7c11c36170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:28.211736 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-59d48981-b5bb-4177-ac57-5f7c11c36170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:28.213496 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1087/2145] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:29:27 2022] DELETE /identity/v3/projects/57acf956a50c4aee98b31795b868d0ed => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:28.214777 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83027b-86db-48da-926f-eeffafdc3ad6 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:28.215063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83027b-86db-48da-926f-eeffafdc3ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:28.215342 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83027b-86db-48da-926f-eeffafdc3ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:28.234933 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-4e83027b-86db-48da-926f-eeffafdc3ad6 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:28.236159 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4e83027b-86db-48da-926f-eeffafdc3ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:28.244687 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f1616-ab57-4e0d-b79a-0080c41ed16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:28.245587 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f1616-ab57-4e0d-b79a-0080c41ed16e admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:28.245875 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f1616-ab57-4e0d-b79a-0080c41ed16e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:28.246182 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f1616-ab57-4e0d-b79a-0080c41ed16e admin admin] PATH_INFO: `/v3/projects/4a15bd40c4c34c508213a14b3226e7e0/users/22021ae38abd4424ad3e19263c78155a/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:28.261599 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f1616-ab57-4e0d-b79a-0080c41ed16e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a15bd40c4c34c508213a14b3226e7e0, user_id=22021ae38abd4424ad3e19263c78155a, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:28.264424 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f1616-ab57-4e0d-b79a-0080c41ed16e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:28.299108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1088/2146] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:28.300100 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83027b-86db-48da-926f-eeffafdc3ad6 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:28.301387 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4e83027b-86db-48da-926f-eeffafdc3ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:28.313641 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83027b-86db-48da-926f-eeffafdc3ad6 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:28.318338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c90037-5f6d-496c-8fd1-ab917fc4b847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:28.318989 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c90037-5f6d-496c-8fd1-ab917fc4b847 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:28.319274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c90037-5f6d-496c-8fd1-ab917fc4b847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:28.319555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c90037-5f6d-496c-8fd1-ab917fc4b847 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:28.320498 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c90037-5f6d-496c-8fd1-ab917fc4b847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:28.322795 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c90037-5f6d-496c-8fd1-ab917fc4b847 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:28.333294 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1089/2147] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:28.334136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c90037-5f6d-496c-8fd1-ab917fc4b847 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:28.336316 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-44c90037-5f6d-496c-8fd1-ab917fc4b847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:28.342448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1059/2148] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:28 2022] PUT /identity/v3/projects/4a15bd40c4c34c508213a14b3226e7e0/users/22021ae38abd4424ad3e19263c78155a/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:28.353038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f1616-ab57-4e0d-b79a-0080c41ed16e admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:28.353157 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c90037-5f6d-496c-8fd1-ab917fc4b847 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:28.420101 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f88efa-f910-4a83-9290-3048aa406d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:28.420992 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f88efa-f910-4a83-9290-3048aa406d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:28.421333 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f88efa-f910-4a83-9290-3048aa406d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:28.421567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f88efa-f910-4a83-9290-3048aa406d0e admin admin] PATH_INFO: `/v3/users/08aea42bf63041549b5404c3f94314c8` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:28.422830 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f88efa-f910-4a83-9290-3048aa406d0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=08aea42bf63041549b5404c3f94314c8)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:28.424777 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f88efa-f910-4a83-9290-3048aa406d0e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:28.439174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f1616-ab57-4e0d-b79a-0080c41ed16e admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:28.444310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfcc10a-e98a-40d9-b3fa-2aa390313ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:28.444872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcc10a-e98a-40d9-b3fa-2aa390313ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:28.445209 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcc10a-e98a-40d9-b3fa-2aa390313ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:28.445491 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcc10a-e98a-40d9-b3fa-2aa390313ef6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:28.446275 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfcc10a-e98a-40d9-b3fa-2aa390313ef6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:29:28.446589 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfcc10a-e98a-40d9-b3fa-2aa390313ef6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:28.448217 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfcc10a-e98a-40d9-b3fa-2aa390313ef6 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:28.460493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1060/2149] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:29:28.461997 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfcc10a-e98a-40d9-b3fa-2aa390313ef6 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:28.472122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfcc10a-e98a-40d9-b3fa-2aa390313ef6 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:28.477699 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296d0af-c9df-492d-8fae-890684cd9de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:28.478717 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296d0af-c9df-492d-8fae-890684cd9de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:28.479145 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296d0af-c9df-492d-8fae-890684cd9de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:28.479434 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296d0af-c9df-492d-8fae-890684cd9de0 admin admin] PATH_INFO: `/v3/projects/55d3426358124733a8727f586076ef43/users/e98e87c11da340f189c0de89635c2f3b/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:28.485122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296d0af-c9df-492d-8fae-890684cd9de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55d3426358124733a8727f586076ef43, user_id=e98e87c11da340f189c0de89635c2f3b, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:28.485122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296d0af-c9df-492d-8fae-890684cd9de0 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:28.496207 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1061/2150] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:28 2022] PUT /identity/v3/projects/55d3426358124733a8727f586076ef43/users/e98e87c11da340f189c0de89635c2f3b/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:28.497561 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947e654-88d1-473c-a8b8-1a1a382e1ef8 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:28.497849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947e654-88d1-473c-a8b8-1a1a382e1ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:28.498160 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947e654-88d1-473c-a8b8-1a1a382e1ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:28.534552 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-7947e654-88d1-473c-a8b8-1a1a382e1ef8 None None] MFA Rules not processed for user `22021ae38abd4424ad3e19263c78155a`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:28.535902 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7947e654-88d1-473c-a8b8-1a1a382e1ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:28.703042 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1062/2151] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:28.703042 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947e654-88d1-473c-a8b8-1a1a382e1ef8 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:28.703042 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947e654-88d1-473c-a8b8-1a1a382e1ef8 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:28.703042 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4644ee-e667-4a5f-acca-4382b1c0b83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:28.703487 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4644ee-e667-4a5f-acca-4382b1c0b83c admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:28.703487 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4644ee-e667-4a5f-acca-4382b1c0b83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:28.703487 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4644ee-e667-4a5f-acca-4382b1c0b83c admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:28.703487 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4644ee-e667-4a5f-acca-4382b1c0b83c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:28.703487 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4644ee-e667-4a5f-acca-4382b1c0b83c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:28.716761 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:28.732069 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d8f88efa-f910-4a83-9290-3048aa406d0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08aea42bf63041549b5404c3f94314c8'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:28.808520 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1063/2152] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:29:28 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:28.808520 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4644ee-e667-4a5f-acca-4382b1c0b83c admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:28.808520 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2f4644ee-e667-4a5f-acca-4382b1c0b83c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:28.821233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d8f88efa-f910-4a83-9290-3048aa406d0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08aea42bf63041549b5404c3f94314c8'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:28.834704 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d8f88efa-f910-4a83-9290-3048aa406d0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08aea42bf63041549b5404c3f94314c8'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:28.843590 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d8f88efa-f910-4a83-9290-3048aa406d0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08aea42bf63041549b5404c3f94314c8'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:28.844413 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d8f88efa-f910-4a83-9290-3048aa406d0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08aea42bf63041549b5404c3f94314c8'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:28.852867 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1090/2153] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:29:28 2022] DELETE /identity/v3/users/08aea42bf63041549b5404c3f94314c8 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:28.855915 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f88efa-f910-4a83-9290-3048aa406d0e admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:28.855915 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d8f88efa-f910-4a83-9290-3048aa406d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:28.869567 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4644ee-e667-4a5f-acca-4382b1c0b83c admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:28.911508 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:28.930179 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e742f-060c-49a1-88d4-d6d69f7aad7b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '436d7cc587bc4b2a8a3242fc39876ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:28.931271 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e742f-060c-49a1-88d4-d6d69f7aad7b service glance] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:28.931564 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e742f-060c-49a1-88d4-d6d69f7aad7b service glance] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:28.931847 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e742f-060c-49a1-88d4-d6d69f7aad7b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:28.934443 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-597e742f-060c-49a1-88d4-d6d69f7aad7b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:28.947317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f88efa-f910-4a83-9290-3048aa406d0e admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:28.954290 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5302f-14b7-40ac-96a1-d620105ddb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:28.955293 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5302f-14b7-40ac-96a1-d620105ddb11 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:28.955655 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5302f-14b7-40ac-96a1-d620105ddb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:28.955848 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5302f-14b7-40ac-96a1-d620105ddb11 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:28.956618 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d5302f-14b7-40ac-96a1-d620105ddb11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:28.959020 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d5302f-14b7-40ac-96a1-d620105ddb11 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:29.029565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e742f-060c-49a1-88d4-d6d69f7aad7b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:29.031050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e742f-060c-49a1-88d4-d6d69f7aad7b service glance] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:29.042157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1064/2154] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:28 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:29.045856 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1091/2155] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:29:28 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:29.048891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e742f-060c-49a1-88d4-d6d69f7aad7b service glance] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:29.063810 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e742f-060c-49a1-88d4-d6d69f7aad7b service glance] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:29.073120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f910e-38b3-4b22-b855-2d17bcfa8c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:29.073901 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f910e-38b3-4b22-b855-2d17bcfa8c29 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:29.074619 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f910e-38b3-4b22-b855-2d17bcfa8c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:29.074990 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f910e-38b3-4b22-b855-2d17bcfa8c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:29.075837 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f910e-38b3-4b22-b855-2d17bcfa8c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:29.078055 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f910e-38b3-4b22-b855-2d17bcfa8c29 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:29.093385 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1065/2156] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:29.097319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5302f-14b7-40ac-96a1-d620105ddb11 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:29.112915 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5302f-14b7-40ac-96a1-d620105ddb11 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:29.119161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9fc94-0c57-47d2-99b1-9127b1db472c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:29.119844 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9fc94-0c57-47d2-99b1-9127b1db472c admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:29.120141 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9fc94-0c57-47d2-99b1-9127b1db472c admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:29.120400 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9fc94-0c57-47d2-99b1-9127b1db472c admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:29.121138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9fc94-0c57-47d2-99b1-9127b1db472c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:29.122825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9fc94-0c57-47d2-99b1-9127b1db472c admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:29.139185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1092/2157] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:29:29.140285 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f910e-38b3-4b22-b855-2d17bcfa8c29 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:29.154570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f910e-38b3-4b22-b855-2d17bcfa8c29 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:29.162111 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c756c-019a-4108-986e-ef3dcf4cd9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:29.167536 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c756c-019a-4108-986e-ef3dcf4cd9ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:29.167536 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c756c-019a-4108-986e-ef3dcf4cd9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:29.167536 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c756c-019a-4108-986e-ef3dcf4cd9ff admin admin] PATH_INFO: `/v3/projects/8dc33d10596e489582f5cd32f9865f5b/users/f2f69a04a45a42549ba2b0d68bbdb663/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:29.183720 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c756c-019a-4108-986e-ef3dcf4cd9ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc33d10596e489582f5cd32f9865f5b, user_id=f2f69a04a45a42549ba2b0d68bbdb663, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:29.187135 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c756c-019a-4108-986e-ef3dcf4cd9ff admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:29.283562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1066/2158] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:29 2022] PUT /identity/v3/projects/8dc33d10596e489582f5cd32f9865f5b/users/f2f69a04a45a42549ba2b0d68bbdb663/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:29.294605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adc886-e699-4fb8-9c07-5db66056376c None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:29.299336 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adc886-e699-4fb8-9c07-5db66056376c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:29.299336 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adc886-e699-4fb8-9c07-5db66056376c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:29.367772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d7adc886-e699-4fb8-9c07-5db66056376c None None] MFA Rules not processed for user `f2f69a04a45a42549ba2b0d68bbdb663`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:29.369669 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d7adc886-e699-4fb8-9c07-5db66056376c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:29.506516 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1093/2159] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:29.519357 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c756c-019a-4108-986e-ef3dcf4cd9ff admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:29.521604 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c70c756c-019a-4108-986e-ef3dcf4cd9ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:29.581141 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c756c-019a-4108-986e-ef3dcf4cd9ff admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:29.584951 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccca8e4-1313-46d7-a220-2af4dcf0699a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:29.590974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccca8e4-1313-46d7-a220-2af4dcf0699a service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:29.590974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccca8e4-1313-46d7-a220-2af4dcf0699a service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:29.590974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccca8e4-1313-46d7-a220-2af4dcf0699a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:29.598591 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccca8e4-1313-46d7-a220-2af4dcf0699a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:29.600064 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccca8e4-1313-46d7-a220-2af4dcf0699a service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:29.612493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1067/2160] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:29.620535 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:29.621924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adc886-e699-4fb8-9c07-5db66056376c None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:29.632024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d7adc886-e699-4fb8-9c07-5db66056376c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:29.717793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adc886-e699-4fb8-9c07-5db66056376c None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:29.723280 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecf638-bb57-4f4c-8a5b-c98ad82b36e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:29.724381 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecf638-bb57-4f4c-8a5b-c98ad82b36e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:29.724738 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecf638-bb57-4f4c-8a5b-c98ad82b36e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:29.725087 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecf638-bb57-4f4c-8a5b-c98ad82b36e7 admin admin] PATH_INFO: `/v3/projects/76d963d1375b4ef6908f02e0ae7207b3` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:29.726614 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecf638-bb57-4f4c-8a5b-c98ad82b36e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76d963d1375b4ef6908f02e0ae7207b3)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:29.728870 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecf638-bb57-4f4c-8a5b-c98ad82b36e7 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:29.878113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:29.879934 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e7ecf638-bb57-4f4c-8a5b-c98ad82b36e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76d963d1375b4ef6908f02e0ae7207b3', 'request_id': 'req-e7ecf638-bb57-4f4c-8a5b-c98ad82b36e7'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:29.996877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e7ecf638-bb57-4f4c-8a5b-c98ad82b36e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76d963d1375b4ef6908f02e0ae7207b3', 'request_id': 'req-e7ecf638-bb57-4f4c-8a5b-c98ad82b36e7'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:30.005028 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e7ecf638-bb57-4f4c-8a5b-c98ad82b36e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76d963d1375b4ef6908f02e0ae7207b3', 'request_id': 'req-e7ecf638-bb57-4f4c-8a5b-c98ad82b36e7'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:30.036738 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e7ecf638-bb57-4f4c-8a5b-c98ad82b36e7 admin admin] The token cache is being invalidate because project 76d963d1375b4ef6908f02e0ae7207b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:29:30.037164 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e7ecf638-bb57-4f4c-8a5b-c98ad82b36e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:30.038040 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e7ecf638-bb57-4f4c-8a5b-c98ad82b36e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:30.039889 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1094/2161] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:29:29 2022] DELETE /identity/v3/projects/76d963d1375b4ef6908f02e0ae7207b3 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:30.045376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172d54b-7bfd-4311-84c1-b8610780a8ec None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:30.045899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172d54b-7bfd-4311-84c1-b8610780a8ec None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:30.045899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172d54b-7bfd-4311-84c1-b8610780a8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:30.064435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-0172d54b-7bfd-4311-84c1-b8610780a8ec None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:30.065708 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0172d54b-7bfd-4311-84c1-b8610780a8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:30.129094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1068/2162] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:30.137683 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78edd3-daec-4299-bb43-f19ea3f52e2a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:30.137975 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78edd3-daec-4299-bb43-f19ea3f52e2a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:30.138292 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78edd3-daec-4299-bb43-f19ea3f52e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:30.157330 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0e78edd3-daec-4299-bb43-f19ea3f52e2a None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:30.159626 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0e78edd3-daec-4299-bb43-f19ea3f52e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:30.166921 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1095/2163] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:30.171418 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172d54b-7bfd-4311-84c1-b8610780a8ec None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:30.181867 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172d54b-7bfd-4311-84c1-b8610780a8ec None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:30.187101 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b4cb6-9c3b-4e1f-9117-a0598e27e6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:30.187807 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b4cb6-9c3b-4e1f-9117-a0598e27e6ab admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:30.188517 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b4cb6-9c3b-4e1f-9117-a0598e27e6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:30.188517 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b4cb6-9c3b-4e1f-9117-a0598e27e6ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:30.189184 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b4cb6-9c3b-4e1f-9117-a0598e27e6ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:29:30.189492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b4cb6-9c3b-4e1f-9117-a0598e27e6ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:30.191115 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b4cb6-9c3b-4e1f-9117-a0598e27e6ab admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:30.217832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1069/2164] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:29:30.220319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78edd3-daec-4299-bb43-f19ea3f52e2a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:30.229832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78edd3-daec-4299-bb43-f19ea3f52e2a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:30.234661 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca814d0a-c387-4270-966c-a5283871550c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:30.235347 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca814d0a-c387-4270-966c-a5283871550c admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:30.235684 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca814d0a-c387-4270-966c-a5283871550c admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:30.235917 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca814d0a-c387-4270-966c-a5283871550c admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:30.236621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca814d0a-c387-4270-966c-a5283871550c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:30.238601 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca814d0a-c387-4270-966c-a5283871550c admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:30.375793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1096/2165] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:29:30 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:30.380263 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b4cb6-9c3b-4e1f-9117-a0598e27e6ab admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:30.392095 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b4cb6-9c3b-4e1f-9117-a0598e27e6ab admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:30.457222 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56ffbc-8388-450a-a561-f632e0a474e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:30.457944 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56ffbc-8388-450a-a561-f632e0a474e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:30.458384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56ffbc-8388-450a-a561-f632e0a474e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:30.458663 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56ffbc-8388-450a-a561-f632e0a474e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:30.459375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56ffbc-8388-450a-a561-f632e0a474e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:30.462440 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56ffbc-8388-450a-a561-f632e0a474e0 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:30.546067 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfccf1d-1723-4739-810d-d8f11cb16c25 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:30.546445 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfccf1d-1723-4739-810d-d8f11cb16c25 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:30.546737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfccf1d-1723-4739-810d-d8f11cb16c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:30.559217 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:30.566526 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1070/2166] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:29:30 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:30.570581 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56ffbc-8388-450a-a561-f632e0a474e0 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:30.578753 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-9bfccf1d-1723-4739-810d-d8f11cb16c25 None None] MFA Rules not processed for user `e98e87c11da340f189c0de89635c2f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:30.580014 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-9bfccf1d-1723-4739-810d-d8f11cb16c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:30.582666 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56ffbc-8388-450a-a561-f632e0a474e0 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:30.588629 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da0780-e9b9-43af-9fdc-66280d8bb5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:30.589731 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da0780-e9b9-43af-9fdc-66280d8bb5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:30.590139 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da0780-e9b9-43af-9fdc-66280d8bb5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:30.590932 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da0780-e9b9-43af-9fdc-66280d8bb5c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:30.591816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da0780-e9b9-43af-9fdc-66280d8bb5c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:30.593361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da0780-e9b9-43af-9fdc-66280d8bb5c6 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:30.609168 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1071/2167] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:29:30.610842 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da0780-e9b9-43af-9fdc-66280d8bb5c6 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:30.622155 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da0780-e9b9-43af-9fdc-66280d8bb5c6 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:30.627301 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26587f6-0771-420c-b693-23c592858662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:30.628211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26587f6-0771-420c-b693-23c592858662 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:30.628500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26587f6-0771-420c-b693-23c592858662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:30.628787 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26587f6-0771-420c-b693-23c592858662 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:30.629639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26587f6-0771-420c-b693-23c592858662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:30.631467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26587f6-0771-420c-b693-23c592858662 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:30.644193 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1072/2168] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:30.648923 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26587f6-0771-420c-b693-23c592858662 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:30.658921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26587f6-0771-420c-b693-23c592858662 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:30.662755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1097/2169] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:30 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:29:30.663974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9c721-6e27-4449-9ea3-1c405e62c16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:30.664945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9c721-6e27-4449-9ea3-1c405e62c16a admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:30.665410 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9c721-6e27-4449-9ea3-1c405e62c16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:30.665525 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9c721-6e27-4449-9ea3-1c405e62c16a admin admin] PATH_INFO: `/v3/projects/8f3bed6ecb7a4030837d79cb18779dbb/users/d3fa39addadd422197266ce88ac8f8df/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:30.682520 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9c721-6e27-4449-9ea3-1c405e62c16a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3bed6ecb7a4030837d79cb18779dbb, user_id=d3fa39addadd422197266ce88ac8f8df, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:30.689335 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9c721-6e27-4449-9ea3-1c405e62c16a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:30.811659 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c11f11-14a2-49bf-88dc-1442758e89b2 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:30.816250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c11f11-14a2-49bf-88dc-1442758e89b2 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:30.816250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c11f11-14a2-49bf-88dc-1442758e89b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:30.821979 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1073/2170] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:30 2022] PUT /identity/v3/projects/8f3bed6ecb7a4030837d79cb18779dbb/users/d3fa39addadd422197266ce88ac8f8df/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:29:30.843704 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b8c11f11-14a2-49bf-88dc-1442758e89b2 None None] MFA Rules not processed for user `d3fa39addadd422197266ce88ac8f8df`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:30.845349 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b8c11f11-14a2-49bf-88dc-1442758e89b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:30.912379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1098/2171] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:30.917607 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9c721-6e27-4449-9ea3-1c405e62c16a admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:30.987703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9c721-6e27-4449-9ea3-1c405e62c16a admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:30.993265 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b458fd7-897a-4ebc-8e23-65692b685f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:30.993930 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b458fd7-897a-4ebc-8e23-65692b685f77 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:30.994244 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b458fd7-897a-4ebc-8e23-65692b685f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:30.994531 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b458fd7-897a-4ebc-8e23-65692b685f77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:30.995232 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b458fd7-897a-4ebc-8e23-65692b685f77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:30.997205 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b458fd7-897a-4ebc-8e23-65692b685f77 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:31.095418 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1074/2172] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:29:30 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:31.099161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c11f11-14a2-49bf-88dc-1442758e89b2 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:31.110395 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c11f11-14a2-49bf-88dc-1442758e89b2 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:31.121383 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:31.177646 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762236ee-3e6b-496b-aa1f-d2ddacdc178e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:31.178504 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762236ee-3e6b-496b-aa1f-d2ddacdc178e admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:31.178949 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762236ee-3e6b-496b-aa1f-d2ddacdc178e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:31.179714 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762236ee-3e6b-496b-aa1f-d2ddacdc178e admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:31.181096 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762236ee-3e6b-496b-aa1f-d2ddacdc178e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:31.183214 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762236ee-3e6b-496b-aa1f-d2ddacdc178e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:31.334144 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1099/2173] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:29:31 2022] POST /identity/v3/users => generated 299 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:31.338187 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b458fd7-897a-4ebc-8e23-65692b685f77 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:31.349906 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b458fd7-897a-4ebc-8e23-65692b685f77 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:31.360052 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75697a-7d26-4e85-bb20-054bf3b2d4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:31.365695 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75697a-7d26-4e85-bb20-054bf3b2d4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:31.365695 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75697a-7d26-4e85-bb20-054bf3b2d4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:31.365695 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75697a-7d26-4e85-bb20-054bf3b2d4a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:31.365695 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75697a-7d26-4e85-bb20-054bf3b2d4a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:31.365695 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75697a-7d26-4e85-bb20-054bf3b2d4a0 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:31.376663 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1075/2174] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:31.380730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762236ee-3e6b-496b-aa1f-d2ddacdc178e admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:31.394817 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762236ee-3e6b-496b-aa1f-d2ddacdc178e admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:31.399760 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda27f9-7b1a-41ec-a237-de6e0e5d9125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:31.400768 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda27f9-7b1a-41ec-a237-de6e0e5d9125 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:31.401020 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda27f9-7b1a-41ec-a237-de6e0e5d9125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:31.401780 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda27f9-7b1a-41ec-a237-de6e0e5d9125 admin admin] PATH_INFO: `/v3/projects/12d09e2209eb4281bf6dea636b78c529/users/8d1bb6ae8f274c92bb8ebfa2535ef650/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:31.426069 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda27f9-7b1a-41ec-a237-de6e0e5d9125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12d09e2209eb4281bf6dea636b78c529, user_id=8d1bb6ae8f274c92bb8ebfa2535ef650, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:31.426069 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda27f9-7b1a-41ec-a237-de6e0e5d9125 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:31.543101 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1100/2175] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:31 2022] PUT /identity/v3/projects/12d09e2209eb4281bf6dea636b78c529/users/8d1bb6ae8f274c92bb8ebfa2535ef650/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:31.546463 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75697a-7d26-4e85-bb20-054bf3b2d4a0 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:31.560459 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75697a-7d26-4e85-bb20-054bf3b2d4a0 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:31.632270 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc60b2-3730-4bce-94e7-22be7eb1d0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:31.633061 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc60b2-3730-4bce-94e7-22be7eb1d0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:31.633332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc60b2-3730-4bce-94e7-22be7eb1d0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:31.633611 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc60b2-3730-4bce-94e7-22be7eb1d0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:31.634385 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc60b2-3730-4bce-94e7-22be7eb1d0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:31.636330 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc60b2-3730-4bce-94e7-22be7eb1d0a1 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:31.649961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1076/2176] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:29:31.651253 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda27f9-7b1a-41ec-a237-de6e0e5d9125 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:31.662362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda27f9-7b1a-41ec-a237-de6e0e5d9125 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:31.668251 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a366f-08a9-46c1-a631-4d3275b09f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:31.669300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a366f-08a9-46c1-a631-4d3275b09f50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:31.669986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a366f-08a9-46c1-a631-4d3275b09f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:31.670684 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a366f-08a9-46c1-a631-4d3275b09f50 admin admin] PATH_INFO: `/v3/projects/12d09e2209eb4281bf6dea636b78c529/users/8d1bb6ae8f274c92bb8ebfa2535ef650/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:31.672736 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a366f-08a9-46c1-a631-4d3275b09f50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12d09e2209eb4281bf6dea636b78c529, user_id=8d1bb6ae8f274c92bb8ebfa2535ef650, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:31.675444 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a366f-08a9-46c1-a631-4d3275b09f50 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:31.687765 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1101/2177] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:31 2022] PUT /identity/v3/projects/12d09e2209eb4281bf6dea636b78c529/users/8d1bb6ae8f274c92bb8ebfa2535ef650/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:31.698163 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97170bf9-c314-4cec-98b2-ebf406efc9cb None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:31.698553 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97170bf9-c314-4cec-98b2-ebf406efc9cb None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:31.698840 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97170bf9-c314-4cec-98b2-ebf406efc9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:31.730995 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-97170bf9-c314-4cec-98b2-ebf406efc9cb None None] MFA Rules not processed for user `8d1bb6ae8f274c92bb8ebfa2535ef650`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:31.733610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-97170bf9-c314-4cec-98b2-ebf406efc9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:31.813205 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1077/2178] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:31.824730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a366f-08a9-46c1-a631-4d3275b09f50 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:31.826469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3e5a366f-08a9-46c1-a631-4d3275b09f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:31.888712 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a366f-08a9-46c1-a631-4d3275b09f50 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:31.892447 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc91db-8aae-4138-94fd-d1bdd23536fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:31.893371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc91db-8aae-4138-94fd-d1bdd23536fa service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:31.893823 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc91db-8aae-4138-94fd-d1bdd23536fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:31.894108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc91db-8aae-4138-94fd-d1bdd23536fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:31.905351 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc91db-8aae-4138-94fd-d1bdd23536fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:31.906931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc91db-8aae-4138-94fd-d1bdd23536fa service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:31.918027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1102/2179] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:31.926264 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:32.105116 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97170bf9-c314-4cec-98b2-ebf406efc9cb None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:32.107381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-97170bf9-c314-4cec-98b2-ebf406efc9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:32.186481 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97170bf9-c314-4cec-98b2-ebf406efc9cb None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:32.191311 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bccd4b1-f2a4-4342-ad82-db814c10d339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:32.192174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccd4b1-f2a4-4342-ad82-db814c10d339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:32.192453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccd4b1-f2a4-4342-ad82-db814c10d339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:32.192758 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccd4b1-f2a4-4342-ad82-db814c10d339 admin admin] PATH_INFO: `/v3/users/a83eca978dbd4274af4063f5490919aa` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:32.194146 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bccd4b1-f2a4-4342-ad82-db814c10d339 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a83eca978dbd4274af4063f5490919aa)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:32.196677 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bccd4b1-f2a4-4342-ad82-db814c10d339 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:32.295785 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:32.423179 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9bccd4b1-f2a4-4342-ad82-db814c10d339 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a83eca978dbd4274af4063f5490919aa'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:32.432273 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9bccd4b1-f2a4-4342-ad82-db814c10d339 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a83eca978dbd4274af4063f5490919aa'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:32.449719 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9bccd4b1-f2a4-4342-ad82-db814c10d339 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a83eca978dbd4274af4063f5490919aa'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:32.450751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9bccd4b1-f2a4-4342-ad82-db814c10d339 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a83eca978dbd4274af4063f5490919aa'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:32.493978 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9bccd4b1-f2a4-4342-ad82-db814c10d339 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a83eca978dbd4274af4063f5490919aa'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:32.505570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1078/2180] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:29:32 2022] DELETE /identity/v3/users/a83eca978dbd4274af4063f5490919aa => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:32.774391 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc91db-8aae-4138-94fd-d1bdd23536fa service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:32.781369 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc91db-8aae-4138-94fd-d1bdd23536fa service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:32.873122 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59456906-e02d-447b-880a-a5a589409b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:32.875109 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59456906-e02d-447b-880a-a5a589409b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:32.875477 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59456906-e02d-447b-880a-a5a589409b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:32.875824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59456906-e02d-447b-880a-a5a589409b26 admin admin] PATH_INFO: `/v3/projects/e00320f0101540aab8ce733e689f1cee` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:32.878344 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59456906-e02d-447b-880a-a5a589409b26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e00320f0101540aab8ce733e689f1cee)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:32.880292 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59456906-e02d-447b-880a-a5a589409b26 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:33.001806 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bccd4b1-f2a4-4342-ad82-db814c10d339 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:33.003752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9bccd4b1-f2a4-4342-ad82-db814c10d339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:33.012424 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-59456906-e02d-447b-880a-a5a589409b26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e00320f0101540aab8ce733e689f1cee', 'request_id': 'req-59456906-e02d-447b-880a-a5a589409b26'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:33.019262 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bccd4b1-f2a4-4342-ad82-db814c10d339 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:33.077489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:33.081198 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6a68c-dad0-4f78-9e16-3cadec13fa19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:33.082064 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6a68c-dad0-4f78-9e16-3cadec13fa19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:33.082374 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6a68c-dad0-4f78-9e16-3cadec13fa19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:33.082735 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6a68c-dad0-4f78-9e16-3cadec13fa19 admin admin] PATH_INFO: `/v3/users/d3fa39addadd422197266ce88ac8f8df` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:33.084061 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d6a68c-dad0-4f78-9e16-3cadec13fa19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3fa39addadd422197266ce88ac8f8df)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:33.086254 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d6a68c-dad0-4f78-9e16-3cadec13fa19 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:33.103134 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-59456906-e02d-447b-880a-a5a589409b26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e00320f0101540aab8ce733e689f1cee', 'request_id': 'req-59456906-e02d-447b-880a-a5a589409b26'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:33.109158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-59456906-e02d-447b-880a-a5a589409b26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e00320f0101540aab8ce733e689f1cee', 'request_id': 'req-59456906-e02d-447b-880a-a5a589409b26'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:33.121332 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-59456906-e02d-447b-880a-a5a589409b26 admin admin] The token cache is being invalidate because project e00320f0101540aab8ce733e689f1cee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:29:33.121620 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-59456906-e02d-447b-880a-a5a589409b26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:33.122343 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-59456906-e02d-447b-880a-a5a589409b26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:33.123886 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1103/2181] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:29:32 2022] DELETE /identity/v3/projects/e00320f0101540aab8ce733e689f1cee => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:33.127957 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59456906-e02d-447b-880a-a5a589409b26 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:33.129354 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-59456906-e02d-447b-880a-a5a589409b26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:33.141886 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59456906-e02d-447b-880a-a5a589409b26 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:33.146538 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4945b0-3538-4596-b59f-b4bd5bb2204d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:33.148440 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4945b0-3538-4596-b59f-b4bd5bb2204d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:33.148440 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4945b0-3538-4596-b59f-b4bd5bb2204d admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:33.148740 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4945b0-3538-4596-b59f-b4bd5bb2204d admin admin] PATH_INFO: `/v3/users/e98e87c11da340f189c0de89635c2f3b` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:33.150018 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4945b0-3538-4596-b59f-b4bd5bb2204d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e98e87c11da340f189c0de89635c2f3b)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:33.151992 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4945b0-3538-4596-b59f-b4bd5bb2204d admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:33.301457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e6d6a68c-dad0-4f78-9e16-3cadec13fa19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3fa39addadd422197266ce88ac8f8df'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:33.309148 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e6d6a68c-dad0-4f78-9e16-3cadec13fa19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3fa39addadd422197266ce88ac8f8df'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:33.321322 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e6d6a68c-dad0-4f78-9e16-3cadec13fa19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3fa39addadd422197266ce88ac8f8df'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:33.322056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e6d6a68c-dad0-4f78-9e16-3cadec13fa19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3fa39addadd422197266ce88ac8f8df'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:33.389034 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6c4945b0-3538-4596-b59f-b4bd5bb2204d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e98e87c11da340f189c0de89635c2f3b'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:33.401651 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e6d6a68c-dad0-4f78-9e16-3cadec13fa19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3fa39addadd422197266ce88ac8f8df'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:33.408728 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1079/2182] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:29:33 2022] DELETE /identity/v3/users/d3fa39addadd422197266ce88ac8f8df => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:29:33.412832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05901b3-cd64-407f-91e9-b27e2519bc2f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:33.413229 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05901b3-cd64-407f-91e9-b27e2519bc2f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:33.414137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05901b3-cd64-407f-91e9-b27e2519bc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:33.432227 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-c05901b3-cd64-407f-91e9-b27e2519bc2f None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:33.433392 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c05901b3-cd64-407f-91e9-b27e2519bc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:33.478629 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:33.479596 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6c4945b0-3538-4596-b59f-b4bd5bb2204d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e98e87c11da340f189c0de89635c2f3b'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:33.492825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6c4945b0-3538-4596-b59f-b4bd5bb2204d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e98e87c11da340f189c0de89635c2f3b'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:33.498979 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1080/2183] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:29:33.500617 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6c4945b0-3538-4596-b59f-b4bd5bb2204d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e98e87c11da340f189c0de89635c2f3b'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:33.501579 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6c4945b0-3538-4596-b59f-b4bd5bb2204d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e98e87c11da340f189c0de89635c2f3b'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:33.508658 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1104/2184] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:29:33 2022] DELETE /identity/v3/users/e98e87c11da340f189c0de89635c2f3b => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:29:33.514154 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05901b3-cd64-407f-91e9-b27e2519bc2f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:33.515558 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c05901b3-cd64-407f-91e9-b27e2519bc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:33.589501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05901b3-cd64-407f-91e9-b27e2519bc2f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:33.656399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf3889-19c0-4bf4-9d5c-d889b600cbe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:33.656399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf3889-19c0-4bf4-9d5c-d889b600cbe1 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:33.656399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf3889-19c0-4bf4-9d5c-d889b600cbe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:33.656784 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf3889-19c0-4bf4-9d5c-d889b600cbe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:33.658587 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6fcf3889-19c0-4bf4-9d5c-d889b600cbe1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:33.728787 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf3889-19c0-4bf4-9d5c-d889b600cbe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:33.730307 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf3889-19c0-4bf4-9d5c-d889b600cbe1 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:33.740034 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1081/2185] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:33.796799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4945b0-3538-4596-b59f-b4bd5bb2204d admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:33.798423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6c4945b0-3538-4596-b59f-b4bd5bb2204d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:33.814632 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4945b0-3538-4596-b59f-b4bd5bb2204d admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:33.819553 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f94c7f-adad-494e-bb48-77d9ad3979cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:33.822646 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f94c7f-adad-494e-bb48-77d9ad3979cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:33.822646 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f94c7f-adad-494e-bb48-77d9ad3979cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:33.822646 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f94c7f-adad-494e-bb48-77d9ad3979cd admin admin] PATH_INFO: `/v3/projects/55d3426358124733a8727f586076ef43` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:33.823803 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f94c7f-adad-494e-bb48-77d9ad3979cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=55d3426358124733a8727f586076ef43)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:33.826677 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f94c7f-adad-494e-bb48-77d9ad3979cd admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:33.902160 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf3889-19c0-4bf4-9d5c-d889b600cbe1 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:33.903366 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6fcf3889-19c0-4bf4-9d5c-d889b600cbe1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:33.931364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf3889-19c0-4bf4-9d5c-d889b600cbe1 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:33.931364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c2626-87f3-4f5d-8822-ced27f5f9c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:33.931364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c2626-87f3-4f5d-8822-ced27f5f9c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:33.931364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c2626-87f3-4f5d-8822-ced27f5f9c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:33.931815 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c2626-87f3-4f5d-8822-ced27f5f9c0e admin admin] PATH_INFO: `/v3/users/f2f69a04a45a42549ba2b0d68bbdb663` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:33.931815 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c2626-87f3-4f5d-8822-ced27f5f9c0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2f69a04a45a42549ba2b0d68bbdb663)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:33.931815 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c2626-87f3-4f5d-8822-ced27f5f9c0e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:33.997061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-44f94c7f-adad-494e-bb48-77d9ad3979cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55d3426358124733a8727f586076ef43', 'request_id': 'req-44f94c7f-adad-494e-bb48-77d9ad3979cd'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:34.114985 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-44f94c7f-adad-494e-bb48-77d9ad3979cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55d3426358124733a8727f586076ef43', 'request_id': 'req-44f94c7f-adad-494e-bb48-77d9ad3979cd'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:34.129148 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-44f94c7f-adad-494e-bb48-77d9ad3979cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55d3426358124733a8727f586076ef43', 'request_id': 'req-44f94c7f-adad-494e-bb48-77d9ad3979cd'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:34.143258 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-44f94c7f-adad-494e-bb48-77d9ad3979cd admin admin] The token cache is being invalidate because project 55d3426358124733a8727f586076ef43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:29:34.143603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-44f94c7f-adad-494e-bb48-77d9ad3979cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:34.144270 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-44f94c7f-adad-494e-bb48-77d9ad3979cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:34.147229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1105/2186] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:29:33 2022] DELETE /identity/v3/projects/55d3426358124733a8727f586076ef43 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:34.152537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29010f8d-c50a-493d-aaec-3e5efaea381a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:34.153021 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29010f8d-c50a-493d-aaec-3e5efaea381a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:34.166291 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29010f8d-c50a-493d-aaec-3e5efaea381a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:34.173322 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-29010f8d-c50a-493d-aaec-3e5efaea381a None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:34.174595 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-29010f8d-c50a-493d-aaec-3e5efaea381a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:34.194166 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:34.236252 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1106/2187] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:29:34.245521 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65fd71d-6258-4664-ac97-7f10c5807033 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:34.245723 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65fd71d-6258-4664-ac97-7f10c5807033 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:34.246046 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65fd71d-6258-4664-ac97-7f10c5807033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:34.250613 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e95c2626-87f3-4f5d-8822-ced27f5f9c0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2f69a04a45a42549ba2b0d68bbdb663'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:34.258989 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e95c2626-87f3-4f5d-8822-ced27f5f9c0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2f69a04a45a42549ba2b0d68bbdb663'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:34.265041 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f65fd71d-6258-4664-ac97-7f10c5807033 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:34.266314 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f65fd71d-6258-4664-ac97-7f10c5807033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:34.271282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e95c2626-87f3-4f5d-8822-ced27f5f9c0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2f69a04a45a42549ba2b0d68bbdb663'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:34.272250 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e95c2626-87f3-4f5d-8822-ced27f5f9c0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2f69a04a45a42549ba2b0d68bbdb663'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:34.275794 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1107/2188] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:29:34.279770 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65fd71d-6258-4664-ac97-7f10c5807033 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:34.289246 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65fd71d-6258-4664-ac97-7f10c5807033 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:34.302237 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10fde8-c908-4831-b2d7-4eb949f822d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:34.302237 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10fde8-c908-4831-b2d7-4eb949f822d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:34.302237 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10fde8-c908-4831-b2d7-4eb949f822d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:34.302237 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10fde8-c908-4831-b2d7-4eb949f822d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:34.302608 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10fde8-c908-4831-b2d7-4eb949f822d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:29:34.302608 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10fde8-c908-4831-b2d7-4eb949f822d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:34.302608 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10fde8-c908-4831-b2d7-4eb949f822d0 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:34.312809 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1108/2189] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:29:34.314148 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10fde8-c908-4831-b2d7-4eb949f822d0 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:34.320028 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ff10fde8-c908-4831-b2d7-4eb949f822d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:34.334218 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10fde8-c908-4831-b2d7-4eb949f822d0 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:34.340117 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df698e95-7d16-4d72-a0e4-ff207e7aee26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:34.341014 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df698e95-7d16-4d72-a0e4-ff207e7aee26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:34.341212 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df698e95-7d16-4d72-a0e4-ff207e7aee26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:34.341492 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df698e95-7d16-4d72-a0e4-ff207e7aee26 admin admin] PATH_INFO: `/v3/projects/8f3bed6ecb7a4030837d79cb18779dbb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:34.342710 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df698e95-7d16-4d72-a0e4-ff207e7aee26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f3bed6ecb7a4030837d79cb18779dbb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:34.344643 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df698e95-7d16-4d72-a0e4-ff207e7aee26 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:34.345447 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e95c2626-87f3-4f5d-8822-ced27f5f9c0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2f69a04a45a42549ba2b0d68bbdb663'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:34.355818 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1082/2190] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:29:33 2022] DELETE /identity/v3/users/f2f69a04a45a42549ba2b0d68bbdb663 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:34.356630 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c2626-87f3-4f5d-8822-ced27f5f9c0e admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:34.358260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e95c2626-87f3-4f5d-8822-ced27f5f9c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:34.427048 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c2626-87f3-4f5d-8822-ced27f5f9c0e admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:34.432090 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e8a40-725a-45cb-801c-f59ce61b87dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:34.432751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e8a40-725a-45cb-801c-f59ce61b87dc admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:34.433116 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e8a40-725a-45cb-801c-f59ce61b87dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:34.433976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e8a40-725a-45cb-801c-f59ce61b87dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:34.434668 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e8a40-725a-45cb-801c-f59ce61b87dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:34.436673 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e8a40-725a-45cb-801c-f59ce61b87dc admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:34.495735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-df698e95-7d16-4d72-a0e4-ff207e7aee26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f3bed6ecb7a4030837d79cb18779dbb', 'request_id': 'req-df698e95-7d16-4d72-a0e4-ff207e7aee26'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:34.556728 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1083/2191] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:29:34 2022] POST /identity/v3/projects => generated 371 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:34.558756 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea6085-fe18-4f5d-8517-fbc785ac4078 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:34.559243 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea6085-fe18-4f5d-8517-fbc785ac4078 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:34.559517 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea6085-fe18-4f5d-8517-fbc785ac4078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:34.579166 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-5cea6085-fe18-4f5d-8517-fbc785ac4078 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:34.580629 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5cea6085-fe18-4f5d-8517-fbc785ac4078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:34.600098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-df698e95-7d16-4d72-a0e4-ff207e7aee26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f3bed6ecb7a4030837d79cb18779dbb', 'request_id': 'req-df698e95-7d16-4d72-a0e4-ff207e7aee26'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:34.610411 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-df698e95-7d16-4d72-a0e4-ff207e7aee26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f3bed6ecb7a4030837d79cb18779dbb', 'request_id': 'req-df698e95-7d16-4d72-a0e4-ff207e7aee26'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:34.620833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:34.629189 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-df698e95-7d16-4d72-a0e4-ff207e7aee26 admin admin] The token cache is being invalidate because project 8f3bed6ecb7a4030837d79cb18779dbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:29:34.629602 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-df698e95-7d16-4d72-a0e4-ff207e7aee26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:34.630744 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-df698e95-7d16-4d72-a0e4-ff207e7aee26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:34.633777 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1109/2192] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:29:34 2022] DELETE /identity/v3/projects/8f3bed6ecb7a4030837d79cb18779dbb => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:34.634756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df698e95-7d16-4d72-a0e4-ff207e7aee26 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:34.638371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-df698e95-7d16-4d72-a0e4-ff207e7aee26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:34.720065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1084/2193] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:34.720065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea6085-fe18-4f5d-8517-fbc785ac4078 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:34.720065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5cea6085-fe18-4f5d-8517-fbc785ac4078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:34.720065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea6085-fe18-4f5d-8517-fbc785ac4078 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:34.720745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645fa43-a286-4d77-9f50-4c902af3bce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:34.720745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645fa43-a286-4d77-9f50-4c902af3bce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:34.720745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645fa43-a286-4d77-9f50-4c902af3bce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:34.720745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645fa43-a286-4d77-9f50-4c902af3bce2 admin admin] PATH_INFO: `/v3/users/8d1bb6ae8f274c92bb8ebfa2535ef650` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:34.721288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645fa43-a286-4d77-9f50-4c902af3bce2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d1bb6ae8f274c92bb8ebfa2535ef650)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:34.721288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645fa43-a286-4d77-9f50-4c902af3bce2 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:34.727088 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df698e95-7d16-4d72-a0e4-ff207e7aee26 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:34.731880 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cc556-4d8e-483b-bd5a-236173d05935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:34.732553 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cc556-4d8e-483b-bd5a-236173d05935 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:34.732830 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cc556-4d8e-483b-bd5a-236173d05935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:34.733110 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cc556-4d8e-483b-bd5a-236173d05935 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:34.733809 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9cc556-4d8e-483b-bd5a-236173d05935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:34.735794 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9cc556-4d8e-483b-bd5a-236173d05935 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:34.934780 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c645fa43-a286-4d77-9f50-4c902af3bce2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d1bb6ae8f274c92bb8ebfa2535ef650'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:34.941575 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c645fa43-a286-4d77-9f50-4c902af3bce2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d1bb6ae8f274c92bb8ebfa2535ef650'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:34.953999 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c645fa43-a286-4d77-9f50-4c902af3bce2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d1bb6ae8f274c92bb8ebfa2535ef650'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:34.954820 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c645fa43-a286-4d77-9f50-4c902af3bce2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d1bb6ae8f274c92bb8ebfa2535ef650'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:34.977076 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1110/2194] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:29:34 2022] POST /identity/v3/users => generated 286 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:34.977076 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cc556-4d8e-483b-bd5a-236173d05935 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:34.977076 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ea9cc556-4d8e-483b-bd5a-236173d05935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:35.016533 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c645fa43-a286-4d77-9f50-4c902af3bce2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d1bb6ae8f274c92bb8ebfa2535ef650'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:35.023702 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1085/2195] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:29:34 2022] DELETE /identity/v3/users/8d1bb6ae8f274c92bb8ebfa2535ef650 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:35.024700 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645fa43-a286-4d77-9f50-4c902af3bce2 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:35.035110 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c645fa43-a286-4d77-9f50-4c902af3bce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:35.041877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cc556-4d8e-483b-bd5a-236173d05935 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:35.095418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148921d-21bf-4ff0-9108-8309e20d1b2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:35.096078 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148921d-21bf-4ff0-9108-8309e20d1b2d service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:35.096363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148921d-21bf-4ff0-9108-8309e20d1b2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:35.096925 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148921d-21bf-4ff0-9108-8309e20d1b2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:35.098494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f148921d-21bf-4ff0-9108-8309e20d1b2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:35.114032 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645fa43-a286-4d77-9f50-4c902af3bce2 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:35.120018 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd400f1-19e3-4aa6-8315-5d17b07208ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:35.120618 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd400f1-19e3-4aa6-8315-5d17b07208ce admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:35.121001 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd400f1-19e3-4aa6-8315-5d17b07208ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:35.121373 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd400f1-19e3-4aa6-8315-5d17b07208ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:35.122282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd400f1-19e3-4aa6-8315-5d17b07208ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:35.123996 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd400f1-19e3-4aa6-8315-5d17b07208ce admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:35.137357 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1086/2196] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:35.141196 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd400f1-19e3-4aa6-8315-5d17b07208ce admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:35.151388 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd400f1-19e3-4aa6-8315-5d17b07208ce admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:35.156550 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fe277-ec18-4e46-8948-79b21ddcb5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:35.157224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fe277-ec18-4e46-8948-79b21ddcb5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:35.157511 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fe277-ec18-4e46-8948-79b21ddcb5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:35.157790 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fe277-ec18-4e46-8948-79b21ddcb5c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:35.158629 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976fe277-ec18-4e46-8948-79b21ddcb5c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:35.160290 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976fe277-ec18-4e46-8948-79b21ddcb5c9 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:35.170935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1087/2197] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:35.174188 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148921d-21bf-4ff0-9108-8309e20d1b2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:35.175089 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fe277-ec18-4e46-8948-79b21ddcb5c9 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:35.175931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148921d-21bf-4ff0-9108-8309e20d1b2d service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:35.187154 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fe277-ec18-4e46-8948-79b21ddcb5c9 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:35.189570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1111/2198] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:35.191440 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f157c64-0684-4b58-a685-696e36129947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:35.192378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f157c64-0684-4b58-a685-696e36129947 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:35.192659 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f157c64-0684-4b58-a685-696e36129947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:35.192938 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f157c64-0684-4b58-a685-696e36129947 admin admin] PATH_INFO: `/v3/projects/94ec02e15bb04ebabe231564b69dcdca/users/570a533b3e4b4648a0c8c1960f3dbadd/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:35.208333 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f157c64-0684-4b58-a685-696e36129947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94ec02e15bb04ebabe231564b69dcdca, user_id=570a533b3e4b4648a0c8c1960f3dbadd, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:35.211955 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f157c64-0684-4b58-a685-696e36129947 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:35.318099 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1088/2199] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:35 2022] PUT /identity/v3/projects/94ec02e15bb04ebabe231564b69dcdca/users/570a533b3e4b4648a0c8c1960f3dbadd/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:29:35.330293 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99651639-2b91-4c47-80d7-0296acb777a4 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:35.331251 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99651639-2b91-4c47-80d7-0296acb777a4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:35.331633 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99651639-2b91-4c47-80d7-0296acb777a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:35.368526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-99651639-2b91-4c47-80d7-0296acb777a4 None None] MFA Rules not processed for user `570a533b3e4b4648a0c8c1960f3dbadd`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:35.370454 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-99651639-2b91-4c47-80d7-0296acb777a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:35.444136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1112/2200] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:35.449973 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f157c64-0684-4b58-a685-696e36129947 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:35.492928 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99651639-2b91-4c47-80d7-0296acb777a4 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:35.494802 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-99651639-2b91-4c47-80d7-0296acb777a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:35.536511 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f157c64-0684-4b58-a685-696e36129947 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:35.559333 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b92b5-ffde-48a1-a657-a585ee8e2c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:35.560094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b92b5-ffde-48a1-a657-a585ee8e2c9c admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:35.560375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b92b5-ffde-48a1-a657-a585ee8e2c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:35.560648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b92b5-ffde-48a1-a657-a585ee8e2c9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:35.561364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b92b5-ffde-48a1-a657-a585ee8e2c9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:35.563592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b92b5-ffde-48a1-a657-a585ee8e2c9c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:35.583924 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:35.613249 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99651639-2b91-4c47-80d7-0296acb777a4 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:35.619708 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c18d5-abc4-4fda-8065-5a4eae269d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:35.620579 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c18d5-abc4-4fda-8065-5a4eae269d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:35.620857 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c18d5-abc4-4fda-8065-5a4eae269d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:35.621173 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c18d5-abc4-4fda-8065-5a4eae269d4e admin admin] PATH_INFO: `/v3/projects/12d09e2209eb4281bf6dea636b78c529` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:35.622383 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c18d5-abc4-4fda-8065-5a4eae269d4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=12d09e2209eb4281bf6dea636b78c529)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:35.624452 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c18d5-abc4-4fda-8065-5a4eae269d4e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:35.647187 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1089/2201] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:29:35 2022] POST /identity/v3/projects => generated 371 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:35.650744 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b92b5-ffde-48a1-a657-a585ee8e2c9c admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:35.721621 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b92b5-ffde-48a1-a657-a585ee8e2c9c admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:35.726857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737d96e-f41a-45fc-b726-a86268192116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:35.727559 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737d96e-f41a-45fc-b726-a86268192116 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:35.727851 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737d96e-f41a-45fc-b726-a86268192116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:35.728128 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737d96e-f41a-45fc-b726-a86268192116 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:35.728822 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9737d96e-f41a-45fc-b726-a86268192116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:35.730774 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9737d96e-f41a-45fc-b726-a86268192116 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:35.766846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-297c18d5-abc4-4fda-8065-5a4eae269d4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12d09e2209eb4281bf6dea636b78c529', 'request_id': 'req-297c18d5-abc4-4fda-8065-5a4eae269d4e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:35.807230 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1090/2202] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:29:35 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:29:35.808294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737d96e-f41a-45fc-b726-a86268192116 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:35.810217 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9737d96e-f41a-45fc-b726-a86268192116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:35.825896 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737d96e-f41a-45fc-b726-a86268192116 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:35.892292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7314ff-b7c3-4a8f-b044-cd5d674f7530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:35.893160 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7314ff-b7c3-4a8f-b044-cd5d674f7530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:35.893445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7314ff-b7c3-4a8f-b044-cd5d674f7530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:35.893721 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7314ff-b7c3-4a8f-b044-cd5d674f7530 admin admin] PATH_INFO: `/v3/projects/8dc33d10596e489582f5cd32f9865f5b` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:35.895432 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7314ff-b7c3-4a8f-b044-cd5d674f7530 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dc33d10596e489582f5cd32f9865f5b)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:35.896757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-297c18d5-abc4-4fda-8065-5a4eae269d4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12d09e2209eb4281bf6dea636b78c529', 'request_id': 'req-297c18d5-abc4-4fda-8065-5a4eae269d4e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:35.897054 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7314ff-b7c3-4a8f-b044-cd5d674f7530 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:35.903879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-297c18d5-abc4-4fda-8065-5a4eae269d4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12d09e2209eb4281bf6dea636b78c529', 'request_id': 'req-297c18d5-abc4-4fda-8065-5a4eae269d4e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:35.921511 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-297c18d5-abc4-4fda-8065-5a4eae269d4e admin admin] The token cache is being invalidate because project 12d09e2209eb4281bf6dea636b78c529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:29:35.922450 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-297c18d5-abc4-4fda-8065-5a4eae269d4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:35.923361 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-297c18d5-abc4-4fda-8065-5a4eae269d4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:35.926187 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1113/2203] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:29:35 2022] DELETE /identity/v3/projects/12d09e2209eb4281bf6dea636b78c529 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:35.927690 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c18d5-abc4-4fda-8065-5a4eae269d4e admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:35.930997 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-297c18d5-abc4-4fda-8065-5a4eae269d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:35.945623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c18d5-abc4-4fda-8065-5a4eae269d4e admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:35.950603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8c542-d14b-4126-bb86-aaf1930c31ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:35.951283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8c542-d14b-4126-bb86-aaf1930c31ff admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:35.951566 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8c542-d14b-4126-bb86-aaf1930c31ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:35.951845 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8c542-d14b-4126-bb86-aaf1930c31ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:35.952585 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8c542-d14b-4126-bb86-aaf1930c31ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:35.954234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8c542-d14b-4126-bb86-aaf1930c31ff admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:35.966481 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1114/2204] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:35.970508 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59206d-c1d5-4f8d-b188-b1e7bd977c9a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:35.970869 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59206d-c1d5-4f8d-b188-b1e7bd977c9a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:35.971351 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59206d-c1d5-4f8d-b188-b1e7bd977c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:35.995673 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-2d59206d-c1d5-4f8d-b188-b1e7bd977c9a None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:35.996826 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2d59206d-c1d5-4f8d-b188-b1e7bd977c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:36.006534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1115/2205] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:36.008012 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59206d-c1d5-4f8d-b188-b1e7bd977c9a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:36.023154 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59206d-c1d5-4f8d-b188-b1e7bd977c9a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:36.031034 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ea010-332f-4df8-b567-d1839ac7fde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:36.032297 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ea010-332f-4df8-b567-d1839ac7fde2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:36.032581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ea010-332f-4df8-b567-d1839ac7fde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:36.032858 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ea010-332f-4df8-b567-d1839ac7fde2 admin admin] PATH_INFO: `/v3/projects/214f788969b34a0b8a95c2348c5dc82f/users/d5dd0f21dc66459ab9de179ae3c7cbb6/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:36.039832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0e7314ff-b7c3-4a8f-b044-cd5d674f7530 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dc33d10596e489582f5cd32f9865f5b', 'request_id': 'req-0e7314ff-b7c3-4a8f-b044-cd5d674f7530'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:36.047757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0e7314ff-b7c3-4a8f-b044-cd5d674f7530 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dc33d10596e489582f5cd32f9865f5b', 'request_id': 'req-0e7314ff-b7c3-4a8f-b044-cd5d674f7530'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:36.056792 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ea010-332f-4df8-b567-d1839ac7fde2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=214f788969b34a0b8a95c2348c5dc82f, user_id=d5dd0f21dc66459ab9de179ae3c7cbb6, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:36.059550 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ea010-332f-4df8-b567-d1839ac7fde2 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:36.135697 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0e7314ff-b7c3-4a8f-b044-cd5d674f7530 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dc33d10596e489582f5cd32f9865f5b', 'request_id': 'req-0e7314ff-b7c3-4a8f-b044-cd5d674f7530'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:36.138267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1116/2206] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:36 2022] PUT /identity/v3/projects/214f788969b34a0b8a95c2348c5dc82f/users/d5dd0f21dc66459ab9de179ae3c7cbb6/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:36.142008 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0e7314ff-b7c3-4a8f-b044-cd5d674f7530 admin admin] The token cache is being invalidate because project 8dc33d10596e489582f5cd32f9865f5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:29:36.142327 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0e7314ff-b7c3-4a8f-b044-cd5d674f7530 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:36.142436 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2404d-4d93-43d9-8f8f-c2e86a4df073 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:36.142666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2404d-4d93-43d9-8f8f-c2e86a4df073 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:36.142953 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2404d-4d93-43d9-8f8f-c2e86a4df073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:36.143131 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-0e7314ff-b7c3-4a8f-b044-cd5d674f7530 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:36.144688 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1091/2207] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:29:35 2022] DELETE /identity/v3/projects/8dc33d10596e489582f5cd32f9865f5b => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:36.145494 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7314ff-b7c3-4a8f-b044-cd5d674f7530 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:36.146824 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0e7314ff-b7c3-4a8f-b044-cd5d674f7530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:36.164296 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0ea2404d-4d93-43d9-8f8f-c2e86a4df073 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:36.165564 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0ea2404d-4d93-43d9-8f8f-c2e86a4df073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:36.214812 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7314ff-b7c3-4a8f-b044-cd5d674f7530 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:36.220564 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:36.248988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1117/2208] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:36.250571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7948d4-7832-462e-afd5-825cfd77c17d None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:36.250906 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7948d4-7832-462e-afd5-825cfd77c17d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:36.251443 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7948d4-7832-462e-afd5-825cfd77c17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:36.270608 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-aa7948d4-7832-462e-afd5-825cfd77c17d None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:36.271839 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-aa7948d4-7832-462e-afd5-825cfd77c17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:36.280845 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1118/2209] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:36.281666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7948d4-7832-462e-afd5-825cfd77c17d None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:36.287910 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d774d-608b-4522-94ba-cf6b4520e1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:36.289251 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d774d-608b-4522-94ba-cf6b4520e1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:36.289538 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d774d-608b-4522-94ba-cf6b4520e1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:36.289908 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d774d-608b-4522-94ba-cf6b4520e1a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:36.290682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d774d-608b-4522-94ba-cf6b4520e1a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:36.291862 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7948d4-7832-462e-afd5-825cfd77c17d None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:36.292340 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d774d-608b-4522-94ba-cf6b4520e1a7 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:36.296696 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3b616-523c-49a1-bc11-c01d447434f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:36.297350 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3b616-523c-49a1-bc11-c01d447434f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:36.297634 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3b616-523c-49a1-bc11-c01d447434f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:36.297946 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3b616-523c-49a1-bc11-c01d447434f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:36.298737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3b616-523c-49a1-bc11-c01d447434f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:29:36.302885 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3b616-523c-49a1-bc11-c01d447434f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:36.302885 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3b616-523c-49a1-bc11-c01d447434f6 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:36.306863 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1092/2210] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:36.306863 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ecd1d-fc06-4f0a-aab2-564e4604b0e9 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:36.306863 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ecd1d-fc06-4f0a-aab2-564e4604b0e9 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:36.306863 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ecd1d-fc06-4f0a-aab2-564e4604b0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:36.317140 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1119/2211] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:29:36.317833 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3b616-523c-49a1-bc11-c01d447434f6 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:36.325018 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-992ecd1d-fc06-4f0a-aab2-564e4604b0e9 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:36.326930 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-992ecd1d-fc06-4f0a-aab2-564e4604b0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:36.330612 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3b616-523c-49a1-bc11-c01d447434f6 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:36.343159 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1093/2212] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:36.343159 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ecd1d-fc06-4f0a-aab2-564e4604b0e9 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:36.344803 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c5204-69e1-4e55-9d71-1a4f0b9e63a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:36.346403 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c5204-69e1-4e55-9d71-1a4f0b9e63a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:36.347174 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c5204-69e1-4e55-9d71-1a4f0b9e63a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:36.347694 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c5204-69e1-4e55-9d71-1a4f0b9e63a0 admin admin] PATH_INFO: `/v3/projects/214f788969b34a0b8a95c2348c5dc82f/users/d5dd0f21dc66459ab9de179ae3c7cbb6/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:36.353703 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c5204-69e1-4e55-9d71-1a4f0b9e63a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=214f788969b34a0b8a95c2348c5dc82f, user_id=d5dd0f21dc66459ab9de179ae3c7cbb6, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:36.357362 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ecd1d-fc06-4f0a-aab2-564e4604b0e9 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:36.359022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c5204-69e1-4e55-9d71-1a4f0b9e63a0 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:36.364795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9c91a-eb60-47bf-b261-55db86470dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:36.365971 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9c91a-eb60-47bf-b261-55db86470dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:36.367082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9c91a-eb60-47bf-b261-55db86470dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:36.367541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9c91a-eb60-47bf-b261-55db86470dd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:36.368740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9c91a-eb60-47bf-b261-55db86470dd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:36.372149 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9c91a-eb60-47bf-b261-55db86470dd3 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:36.379494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1120/2213] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:36 2022] PUT /identity/v3/projects/214f788969b34a0b8a95c2348c5dc82f/users/d5dd0f21dc66459ab9de179ae3c7cbb6/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:36.380802 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c5204-69e1-4e55-9d71-1a4f0b9e63a0 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:36.455359 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c5204-69e1-4e55-9d71-1a4f0b9e63a0 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:36.461182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052ada9-c0d2-4547-8fed-58258a44069d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:36.461985 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052ada9-c0d2-4547-8fed-58258a44069d admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:36.462395 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052ada9-c0d2-4547-8fed-58258a44069d admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:36.462757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052ada9-c0d2-4547-8fed-58258a44069d admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:36.463759 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a052ada9-c0d2-4547-8fed-58258a44069d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:29:36.464139 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a052ada9-c0d2-4547-8fed-58258a44069d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:36.465858 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a052ada9-c0d2-4547-8fed-58258a44069d admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:36.472448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1094/2214] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:29:36 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:36.474721 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a5b39-dc0b-4915-a7cb-3b52610ce931 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:36.474721 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a5b39-dc0b-4915-a7cb-3b52610ce931 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:36.474721 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a5b39-dc0b-4915-a7cb-3b52610ce931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:36.482260 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1121/2215] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:29:36.482260 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052ada9-c0d2-4547-8fed-58258a44069d admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:36.496111 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052ada9-c0d2-4547-8fed-58258a44069d admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:36.505435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-e56a5b39-dc0b-4915-a7cb-3b52610ce931 None None] MFA Rules not processed for user `d5dd0f21dc66459ab9de179ae3c7cbb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:36.506625 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e56a5b39-dc0b-4915-a7cb-3b52610ce931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:36.574053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90fd5f-8020-4870-a5b7-d289d7954456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:36.575085 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90fd5f-8020-4870-a5b7-d289d7954456 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:36.575434 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90fd5f-8020-4870-a5b7-d289d7954456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:36.575924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90fd5f-8020-4870-a5b7-d289d7954456 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:36.576800 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90fd5f-8020-4870-a5b7-d289d7954456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:36.579036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90fd5f-8020-4870-a5b7-d289d7954456 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:36.610285 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1095/2216] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:36 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:36.611352 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a5b39-dc0b-4915-a7cb-3b52610ce931 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:36.628252 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a5b39-dc0b-4915-a7cb-3b52610ce931 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:36.633140 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a3a95-2650-424a-94be-df3512e54ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:36.635282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a3a95-2650-424a-94be-df3512e54ffa admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:36.635282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a3a95-2650-424a-94be-df3512e54ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:36.635282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a3a95-2650-424a-94be-df3512e54ffa admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:36.635282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a3a95-2650-424a-94be-df3512e54ffa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:36.637201 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a3a95-2650-424a-94be-df3512e54ffa admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:36.667689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1122/2217] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:29:36 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:36.667689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90fd5f-8020-4870-a5b7-d289d7954456 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:36.667689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ad90fd5f-8020-4870-a5b7-d289d7954456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:36.722339 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1096/2218] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:29:36 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:36.722339 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a3a95-2650-424a-94be-df3512e54ffa admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:36.722655 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90fd5f-8020-4870-a5b7-d289d7954456 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:36.774200 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c5fa2-0d8d-42ab-97e0-5fbb795805d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:36.774867 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c5fa2-0d8d-42ab-97e0-5fbb795805d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:36.775159 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c5fa2-0d8d-42ab-97e0-5fbb795805d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:36.775445 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c5fa2-0d8d-42ab-97e0-5fbb795805d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:36.785208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a3a95-2650-424a-94be-df3512e54ffa admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:36.790098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5fa68-ad98-4b57-9788-2e3a4c89bb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:36.790793 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5fa68-ad98-4b57-9788-2e3a4c89bb3f admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:36.791075 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5fa68-ad98-4b57-9788-2e3a4c89bb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:36.791350 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5fa68-ad98-4b57-9788-2e3a4c89bb3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:36.792078 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5fa68-ad98-4b57-9788-2e3a4c89bb3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:36.793680 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5fa68-ad98-4b57-9788-2e3a4c89bb3f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:36.804088 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1097/2219] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:36.809381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5fa68-ad98-4b57-9788-2e3a4c89bb3f admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:36.814587 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5fa68-ad98-4b57-9788-2e3a4c89bb3f admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:36.819241 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470093e4-f671-4965-9e33-2ce03ba6f542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:36.820381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470093e4-f671-4965-9e33-2ce03ba6f542 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:36.820665 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470093e4-f671-4965-9e33-2ce03ba6f542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:36.820938 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470093e4-f671-4965-9e33-2ce03ba6f542 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:36.821653 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470093e4-f671-4965-9e33-2ce03ba6f542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:36.823605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470093e4-f671-4965-9e33-2ce03ba6f542 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:36.841911 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c5fa2-0d8d-42ab-97e0-5fbb795805d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:36.843408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c5fa2-0d8d-42ab-97e0-5fbb795805d2 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:36.854236 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1123/2220] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:36 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:36.855387 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c5fa2-0d8d-42ab-97e0-5fbb795805d2 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:36.865162 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c5fa2-0d8d-42ab-97e0-5fbb795805d2 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:36.873007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fd83b-c412-4090-b35a-a5371dc36425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:36.873711 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fd83b-c412-4090-b35a-a5371dc36425 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:36.874000 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fd83b-c412-4090-b35a-a5371dc36425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:36.874359 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fd83b-c412-4090-b35a-a5371dc36425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:36.875095 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2fd83b-c412-4090-b35a-a5371dc36425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:36.876960 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2fd83b-c412-4090-b35a-a5371dc36425 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:36.887856 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1124/2221] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:29:36.891776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fd83b-c412-4090-b35a-a5371dc36425 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:36.901991 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fd83b-c412-4090-b35a-a5371dc36425 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:36.906933 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb09da-bd85-4ab3-b60a-3c2c389facf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:36.907812 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb09da-bd85-4ab3-b60a-3c2c389facf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:36.908100 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb09da-bd85-4ab3-b60a-3c2c389facf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:36.908374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb09da-bd85-4ab3-b60a-3c2c389facf9 admin admin] PATH_INFO: `/v3/projects/4608d69ab3344d38bef440a4d1bc5816/users/3531dac5a1dd4ae8a4fda67b70219838/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:36.918808 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1098/2222] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:29:36 2022] POST /identity/v3/users => generated 282 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:36.922965 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470093e4-f671-4965-9e33-2ce03ba6f542 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:36.925976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb09da-bd85-4ab3-b60a-3c2c389facf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4608d69ab3344d38bef440a4d1bc5816, user_id=3531dac5a1dd4ae8a4fda67b70219838, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:36.929451 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb09da-bd85-4ab3-b60a-3c2c389facf9 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:36.934206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470093e4-f671-4965-9e33-2ce03ba6f542 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:36.941223 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8158de6-cc6b-4129-a96f-d649f77a72c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:36.943072 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8158de6-cc6b-4129-a96f-d649f77a72c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:36.943072 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8158de6-cc6b-4129-a96f-d649f77a72c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:36.943072 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8158de6-cc6b-4129-a96f-d649f77a72c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:36.943349 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8158de6-cc6b-4129-a96f-d649f77a72c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:36.945003 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8158de6-cc6b-4129-a96f-d649f77a72c5 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:36.958153 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1099/2223] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:29:36.960147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8158de6-cc6b-4129-a96f-d649f77a72c5 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:36.970415 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8158de6-cc6b-4129-a96f-d649f77a72c5 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:36.975136 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc85240-047a-4dd7-8dc7-67d370a4f2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:36.976316 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc85240-047a-4dd7-8dc7-67d370a4f2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:36.976756 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc85240-047a-4dd7-8dc7-67d370a4f2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:36.977200 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc85240-047a-4dd7-8dc7-67d370a4f2b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:36.977963 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc85240-047a-4dd7-8dc7-67d370a4f2b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:36.979589 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc85240-047a-4dd7-8dc7-67d370a4f2b0 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:36.989761 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1100/2224] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:29:36.994556 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc85240-047a-4dd7-8dc7-67d370a4f2b0 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:37.004836 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc85240-047a-4dd7-8dc7-67d370a4f2b0 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:37.010098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2900d-ced8-4c53-ac04-e0f89d1d3bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:37.011010 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2900d-ced8-4c53-ac04-e0f89d1d3bd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:37.011291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2900d-ced8-4c53-ac04-e0f89d1d3bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:37.011566 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2900d-ced8-4c53-ac04-e0f89d1d3bd0 admin admin] PATH_INFO: `/v3/projects/19ade96ffea9473ab159ddb2e5c72073/users/88745462d3454e53b8beb72b9f4bbc03/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:37.023539 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1125/2225] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:36 2022] PUT /identity/v3/projects/4608d69ab3344d38bef440a4d1bc5816/users/3531dac5a1dd4ae8a4fda67b70219838/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:29:37.041946 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2900d-ced8-4c53-ac04-e0f89d1d3bd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19ade96ffea9473ab159ddb2e5c72073, user_id=88745462d3454e53b8beb72b9f4bbc03, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:37.045182 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2900d-ced8-4c53-ac04-e0f89d1d3bd0 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:37.079686 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb09da-bd85-4ab3-b60a-3c2c389facf9 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:37.122211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1101/2226] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:29:36 2022] PUT /identity/v3/projects/19ade96ffea9473ab159ddb2e5c72073/users/88745462d3454e53b8beb72b9f4bbc03/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:29:37.123798 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26275f31-87d4-43c8-b070-ded062716616 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:37.124171 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26275f31-87d4-43c8-b070-ded062716616 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:37.124508 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26275f31-87d4-43c8-b070-ded062716616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:37.159739 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb09da-bd85-4ab3-b60a-3c2c389facf9 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:37.160552 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-26275f31-87d4-43c8-b070-ded062716616 None None] MFA Rules not processed for user `3531dac5a1dd4ae8a4fda67b70219838`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:37.161714 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-26275f31-87d4-43c8-b070-ded062716616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:37.173112 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:37.221372 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9764e-0500-454d-a907-f83e04bdc905 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:37.222098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9764e-0500-454d-a907-f83e04bdc905 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:37.222414 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9764e-0500-454d-a907-f83e04bdc905 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:37.222689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9764e-0500-454d-a907-f83e04bdc905 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:37.224671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-fec9764e-0500-454d-a907-f83e04bdc905 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:37.247221 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1102/2227] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:37.248637 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a85b9-d2c8-4f8a-9f46-4069bdfeea3c None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:37.249238 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a85b9-d2c8-4f8a-9f46-4069bdfeea3c None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:37.249800 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a85b9-d2c8-4f8a-9f46-4069bdfeea3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:37.270375 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:37.280511 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-394a85b9-d2c8-4f8a-9f46-4069bdfeea3c None None] MFA Rules not processed for user `88745462d3454e53b8beb72b9f4bbc03`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:37.281649 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-394a85b9-d2c8-4f8a-9f46-4069bdfeea3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:37.289204 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9764e-0500-454d-a907-f83e04bdc905 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:37.290754 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9764e-0500-454d-a907-f83e04bdc905 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:37.300038 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1126/2228] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:37.300877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9764e-0500-454d-a907-f83e04bdc905 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:37.302271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-fec9764e-0500-454d-a907-f83e04bdc905 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:37.312924 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9764e-0500-454d-a907-f83e04bdc905 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:37.319068 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24c298-cca1-4769-a15b-0cdf89303a39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:37.320426 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24c298-cca1-4769-a15b-0cdf89303a39 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:37.320787 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24c298-cca1-4769-a15b-0cdf89303a39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:37.321141 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24c298-cca1-4769-a15b-0cdf89303a39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:37.334859 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24c298-cca1-4769-a15b-0cdf89303a39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:37.337289 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24c298-cca1-4769-a15b-0cdf89303a39 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:37.348706 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1127/2229] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:37.365457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1103/2230] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:37 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:37.381646 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24c298-cca1-4769-a15b-0cdf89303a39 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:37.381811 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a85b9-d2c8-4f8a-9f46-4069bdfeea3c None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:37.391145 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24c298-cca1-4769-a15b-0cdf89303a39 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:37.395421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a87af-275d-458a-a2af-e6bf1af10f50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:37.396065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a87af-275d-458a-a2af-e6bf1af10f50 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:37.396339 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a87af-275d-458a-a2af-e6bf1af10f50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:37.396650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a87af-275d-458a-a2af-e6bf1af10f50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:37.406472 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a87af-275d-458a-a2af-e6bf1af10f50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:37.407919 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a87af-275d-458a-a2af-e6bf1af10f50 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:37.419708 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1128/2231] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:37 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:37.419907 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:37.449584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a85b9-d2c8-4f8a-9f46-4069bdfeea3c None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:37.454323 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80ec81-b495-4097-bbbd-f2e1c535fef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:37.455231 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80ec81-b495-4097-bbbd-f2e1c535fef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:37.455548 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80ec81-b495-4097-bbbd-f2e1c535fef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:37.455881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80ec81-b495-4097-bbbd-f2e1c535fef1 admin admin] PATH_INFO: `/v3/users/3531dac5a1dd4ae8a4fda67b70219838` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:37.457035 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80ec81-b495-4097-bbbd-f2e1c535fef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3531dac5a1dd4ae8a4fda67b70219838)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:37.459529 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80ec81-b495-4097-bbbd-f2e1c535fef1 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:37.491343 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:37.632991 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-7f80ec81-b495-4097-bbbd-f2e1c535fef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3531dac5a1dd4ae8a4fda67b70219838'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:37.640011 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-7f80ec81-b495-4097-bbbd-f2e1c535fef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3531dac5a1dd4ae8a4fda67b70219838'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:37.652862 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-7f80ec81-b495-4097-bbbd-f2e1c535fef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3531dac5a1dd4ae8a4fda67b70219838'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:37.653643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-7f80ec81-b495-4097-bbbd-f2e1c535fef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3531dac5a1dd4ae8a4fda67b70219838'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:37.766022 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-7f80ec81-b495-4097-bbbd-f2e1c535fef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3531dac5a1dd4ae8a4fda67b70219838'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:37.775310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1104/2232] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:29:37 2022] DELETE /identity/v3/users/3531dac5a1dd4ae8a4fda67b70219838 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:29:37.779688 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1e151-c859-4b55-b4d6-b50085977c16 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:37.780036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1e151-c859-4b55-b4d6-b50085977c16 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:37.780311 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1e151-c859-4b55-b4d6-b50085977c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:37.799314 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-3db1e151-c859-4b55-b4d6-b50085977c16 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:37.800538 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3db1e151-c859-4b55-b4d6-b50085977c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:37.863752 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1129/2233] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:29:37.875717 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80ec81-b495-4097-bbbd-f2e1c535fef1 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:37.877466 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7f80ec81-b495-4097-bbbd-f2e1c535fef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:37.941184 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80ec81-b495-4097-bbbd-f2e1c535fef1 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:37.946751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65c917-44dd-4015-a749-a7fe76ea1451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:37.947683 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65c917-44dd-4015-a749-a7fe76ea1451 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:37.947683 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65c917-44dd-4015-a749-a7fe76ea1451 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:37.947953 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65c917-44dd-4015-a749-a7fe76ea1451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:37.958616 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65c917-44dd-4015-a749-a7fe76ea1451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:37.960847 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65c917-44dd-4015-a749-a7fe76ea1451 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:37.971558 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1105/2234] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:29:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:29:38.188683 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:38.268962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=78,keystone:INSERT=5,keystone:DELETE=17 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:38.454430 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1e151-c859-4b55-b4d6-b50085977c16 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:38.455953 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3db1e151-c859-4b55-b4d6-b50085977c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:38.468666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1e151-c859-4b55-b4d6-b50085977c16 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:38.473362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b076bd-2b87-42ed-937c-19bb230d2084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:38.474255 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b076bd-2b87-42ed-937c-19bb230d2084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:38.474539 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b076bd-2b87-42ed-937c-19bb230d2084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:38.474815 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b076bd-2b87-42ed-937c-19bb230d2084 admin admin] PATH_INFO: `/v3/projects/4608d69ab3344d38bef440a4d1bc5816` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:38.476074 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b076bd-2b87-42ed-937c-19bb230d2084 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4608d69ab3344d38bef440a4d1bc5816)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:38.478199 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b076bd-2b87-42ed-937c-19bb230d2084 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:38.567349 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c0b076bd-2b87-42ed-937c-19bb230d2084 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4608d69ab3344d38bef440a4d1bc5816', 'request_id': 'req-c0b076bd-2b87-42ed-937c-19bb230d2084'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:38.630401 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c0b076bd-2b87-42ed-937c-19bb230d2084 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4608d69ab3344d38bef440a4d1bc5816', 'request_id': 'req-c0b076bd-2b87-42ed-937c-19bb230d2084'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:38.637234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c0b076bd-2b87-42ed-937c-19bb230d2084 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4608d69ab3344d38bef440a4d1bc5816', 'request_id': 'req-c0b076bd-2b87-42ed-937c-19bb230d2084'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:38.648646 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c0b076bd-2b87-42ed-937c-19bb230d2084 admin admin] The token cache is being invalidate because project 4608d69ab3344d38bef440a4d1bc5816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:29:38.648936 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c0b076bd-2b87-42ed-937c-19bb230d2084 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:38.649578 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c0b076bd-2b87-42ed-937c-19bb230d2084 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:29:38.651175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1130/2235] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:29:38 2022] DELETE /identity/v3/projects/4608d69ab3344d38bef440a4d1bc5816 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:29:38.705124 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:38.729512 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:38.876961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:38.951934 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:39.096591 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:39.468838 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:39.613554 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:39.802064 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:39.863036 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:39.936962 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:39.991760 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:40.388287 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:40.491516 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:41.113806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:41.251582 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:41.842408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:41.947179 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:42.321928 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:42.390722 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:42.714026 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:42.774396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:43.008595 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:43.357292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:43.853580 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:44.105033 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:44.411277 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:45.459894 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:45.547581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:45.611821 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc292f29-c4d6-47e8-9dbf-ff574ed8dc62 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:45.612107 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc292f29-c4d6-47e8-9dbf-ff574ed8dc62 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:45.612388 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc292f29-c4d6-47e8-9dbf-ff574ed8dc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:45.631162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-cc292f29-c4d6-47e8-9dbf-ff574ed8dc62 None None] MFA Rules not processed for user `eff8feae83ae43ba82cc5a58044cb7c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:45.633005 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-cc292f29-c4d6-47e8-9dbf-ff574ed8dc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:45.687386 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1106/2236] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:29:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:29:46.047492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:46.450719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:46.505434 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:46.977463 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:47.212707 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:48.338875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:49.127472 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:50.287619 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:51.281752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:52.110730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:52.603426 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:53.292730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:53.382930 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:54.235665 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:54.326905 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:54.690407 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:54.771030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:55.350032 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:55.748118 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:00.789661 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b076bd-2b87-42ed-937c-19bb230d2084 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:00.791335 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c0b076bd-2b87-42ed-937c-19bb230d2084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:00.885502 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b076bd-2b87-42ed-937c-19bb230d2084 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:00.890635 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bd97d-72ce-4dde-a343-7fdc2ecbd05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:00.891516 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bd97d-72ce-4dde-a343-7fdc2ecbd05f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:00.891859 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bd97d-72ce-4dde-a343-7fdc2ecbd05f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:00.892213 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bd97d-72ce-4dde-a343-7fdc2ecbd05f admin admin] PATH_INFO: `/v3/users/22021ae38abd4424ad3e19263c78155a` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:00.893320 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03bd97d-72ce-4dde-a343-7fdc2ecbd05f admin admin] RBAC: Authorizing `identity:delete_user(user_id=22021ae38abd4424ad3e19263c78155a)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:00.895426 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03bd97d-72ce-4dde-a343-7fdc2ecbd05f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:00.903323 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:01.192314 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c03bd97d-72ce-4dde-a343-7fdc2ecbd05f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22021ae38abd4424ad3e19263c78155a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:01.273187 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c03bd97d-72ce-4dde-a343-7fdc2ecbd05f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22021ae38abd4424ad3e19263c78155a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:01.287598 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c03bd97d-72ce-4dde-a343-7fdc2ecbd05f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22021ae38abd4424ad3e19263c78155a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:01.295280 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c03bd97d-72ce-4dde-a343-7fdc2ecbd05f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22021ae38abd4424ad3e19263c78155a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:01.296004 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c03bd97d-72ce-4dde-a343-7fdc2ecbd05f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22021ae38abd4424ad3e19263c78155a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:01.302560 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1131/2237] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:30:00 2022] DELETE /identity/v3/users/22021ae38abd4424ad3e19263c78155a => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:30:01.307935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c42f9d-39ef-4a1f-b310-6eb91c647c79 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:01.311702 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c42f9d-39ef-4a1f-b310-6eb91c647c79 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:01.311702 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c42f9d-39ef-4a1f-b310-6eb91c647c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:01.326719 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-35c42f9d-39ef-4a1f-b310-6eb91c647c79 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:01.328014 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-35c42f9d-39ef-4a1f-b310-6eb91c647c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:01.371411 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:01.389842 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1107/2238] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:30:01.400319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bd97d-72ce-4dde-a343-7fdc2ecbd05f admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:01.401763 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c03bd97d-72ce-4dde-a343-7fdc2ecbd05f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:01.460392 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bd97d-72ce-4dde-a343-7fdc2ecbd05f admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:01.464540 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a645e03-8b09-4613-a788-5c6265d423d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:01.465211 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a645e03-8b09-4613-a788-5c6265d423d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:01.465521 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a645e03-8b09-4613-a788-5c6265d423d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:01.465797 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a645e03-8b09-4613-a788-5c6265d423d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:01.478159 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a645e03-8b09-4613-a788-5c6265d423d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:01.478159 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a645e03-8b09-4613-a788-5c6265d423d2 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:01.488492 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1132/2239] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:30:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:30:01.975066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c42f9d-39ef-4a1f-b310-6eb91c647c79 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:01.977678 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-35c42f9d-39ef-4a1f-b310-6eb91c647c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:01.994966 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c42f9d-39ef-4a1f-b310-6eb91c647c79 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:02.000497 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce581548-1724-4f25-b8b7-a318bbb525fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:02.011896 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce581548-1724-4f25-b8b7-a318bbb525fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:02.011896 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce581548-1724-4f25-b8b7-a318bbb525fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:02.012205 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce581548-1724-4f25-b8b7-a318bbb525fe admin admin] PATH_INFO: `/v3/projects/4a15bd40c4c34c508213a14b3226e7e0` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:02.013515 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce581548-1724-4f25-b8b7-a318bbb525fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a15bd40c4c34c508213a14b3226e7e0)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:02.015604 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce581548-1724-4f25-b8b7-a318bbb525fe admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:02.153392 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ce581548-1724-4f25-b8b7-a318bbb525fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a15bd40c4c34c508213a14b3226e7e0', 'request_id': 'req-ce581548-1724-4f25-b8b7-a318bbb525fe'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:02.159343 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ce581548-1724-4f25-b8b7-a318bbb525fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a15bd40c4c34c508213a14b3226e7e0', 'request_id': 'req-ce581548-1724-4f25-b8b7-a318bbb525fe'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:02.220959 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ce581548-1724-4f25-b8b7-a318bbb525fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a15bd40c4c34c508213a14b3226e7e0', 'request_id': 'req-ce581548-1724-4f25-b8b7-a318bbb525fe'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:02.233140 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ce581548-1724-4f25-b8b7-a318bbb525fe admin admin] The token cache is being invalidate because project 4a15bd40c4c34c508213a14b3226e7e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:30:02.233427 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ce581548-1724-4f25-b8b7-a318bbb525fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:02.234061 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ce581548-1724-4f25-b8b7-a318bbb525fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:02.235631 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1108/2240] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:30:01 2022] DELETE /identity/v3/projects/4a15bd40c4c34c508213a14b3226e7e0 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:30:02.240465 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4af8da-5702-4f95-8636-72e137dc6ac9 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:02.240978 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4af8da-5702-4f95-8636-72e137dc6ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:02.241084 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4af8da-5702-4f95-8636-72e137dc6ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:02.261030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-8b4af8da-5702-4f95-8636-72e137dc6ac9 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:02.262347 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8b4af8da-5702-4f95-8636-72e137dc6ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:02.332628 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1133/2241] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:02.340987 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1243b3-0c6d-404e-afc2-48380c826618 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:02.341507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1243b3-0c6d-404e-afc2-48380c826618 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:02.341688 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1243b3-0c6d-404e-afc2-48380c826618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:02.363370 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-bf1243b3-0c6d-404e-afc2-48380c826618 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:02.364811 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-bf1243b3-0c6d-404e-afc2-48380c826618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:02.373894 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1109/2242] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:02.378448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4af8da-5702-4f95-8636-72e137dc6ac9 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:02.389842 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4af8da-5702-4f95-8636-72e137dc6ac9 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:02.397609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69458135-8b76-41a2-a993-e69550fd1a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:02.398317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69458135-8b76-41a2-a993-e69550fd1a06 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:02.399145 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69458135-8b76-41a2-a993-e69550fd1a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:02.399740 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69458135-8b76-41a2-a993-e69550fd1a06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:02.400513 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69458135-8b76-41a2-a993-e69550fd1a06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:02.400824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69458135-8b76-41a2-a993-e69550fd1a06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:02.402484 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69458135-8b76-41a2-a993-e69550fd1a06 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:02.421765 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1134/2243] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:30:02.422945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1243b3-0c6d-404e-afc2-48380c826618 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:02.433072 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1243b3-0c6d-404e-afc2-48380c826618 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:02.438699 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efdf81-452e-4bbb-9df6-c9d2eaf89ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:02.439483 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efdf81-452e-4bbb-9df6-c9d2eaf89ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:02.439763 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efdf81-452e-4bbb-9df6-c9d2eaf89ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:02.440062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efdf81-452e-4bbb-9df6-c9d2eaf89ec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:02.440756 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3efdf81-452e-4bbb-9df6-c9d2eaf89ec2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:02.442706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3efdf81-452e-4bbb-9df6-c9d2eaf89ec2 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:02.534178 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1110/2244] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:30:02 2022] POST /identity/v3/projects => generated 399 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:30:02.538571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69458135-8b76-41a2-a993-e69550fd1a06 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:02.549169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69458135-8b76-41a2-a993-e69550fd1a06 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:02.559959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:02.610945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1366d05-9f33-43fc-a9c0-68358a3f21db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:02.611685 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1366d05-9f33-43fc-a9c0-68358a3f21db admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:02.611976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1366d05-9f33-43fc-a9c0-68358a3f21db admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:02.612256 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1366d05-9f33-43fc-a9c0-68358a3f21db admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:02.612978 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1366d05-9f33-43fc-a9c0-68358a3f21db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:02.614944 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1366d05-9f33-43fc-a9c0-68358a3f21db admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:02.730330 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1135/2245] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:30:02 2022] POST /identity/v3/users => generated 300 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:30:02.734478 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efdf81-452e-4bbb-9df6-c9d2eaf89ec2 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:02.745829 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efdf81-452e-4bbb-9df6-c9d2eaf89ec2 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:02.751641 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedc0b7-cd9a-47cc-b05f-3be689017c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:02.752165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedc0b7-cd9a-47cc-b05f-3be689017c12 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:02.752454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedc0b7-cd9a-47cc-b05f-3be689017c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:02.752733 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedc0b7-cd9a-47cc-b05f-3be689017c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:02.753473 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eedc0b7-cd9a-47cc-b05f-3be689017c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:02.755242 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eedc0b7-cd9a-47cc-b05f-3be689017c12 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:02.768520 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1111/2246] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:30:02.773407 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1366d05-9f33-43fc-a9c0-68358a3f21db admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:02.784265 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1366d05-9f33-43fc-a9c0-68358a3f21db admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:02.789184 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5aa5e0-79cc-446a-9460-27389d1dfe73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:02.790008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5aa5e0-79cc-446a-9460-27389d1dfe73 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:02.790330 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5aa5e0-79cc-446a-9460-27389d1dfe73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:02.790677 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5aa5e0-79cc-446a-9460-27389d1dfe73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:02.791486 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5aa5e0-79cc-446a-9460-27389d1dfe73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:02.794241 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5aa5e0-79cc-446a-9460-27389d1dfe73 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:02.804537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1136/2247] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:30:02.809470 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedc0b7-cd9a-47cc-b05f-3be689017c12 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:02.820167 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedc0b7-cd9a-47cc-b05f-3be689017c12 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:02.828141 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e3841-beff-4bd8-b197-ec9f5cd21dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:02.834833 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e3841-beff-4bd8-b197-ec9f5cd21dc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:02.834833 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e3841-beff-4bd8-b197-ec9f5cd21dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:02.834833 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e3841-beff-4bd8-b197-ec9f5cd21dc8 admin admin] PATH_INFO: `/v3/projects/89b2dceb58ec4c7d82ee845b171542b3/users/579c4082b5e54e7087feff13f3d5d544/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:02.845318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e3841-beff-4bd8-b197-ec9f5cd21dc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89b2dceb58ec4c7d82ee845b171542b3, user_id=579c4082b5e54e7087feff13f3d5d544, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:02.848118 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e3841-beff-4bd8-b197-ec9f5cd21dc8 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:02.957829 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1112/2248] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:30:02 2022] PUT /identity/v3/projects/89b2dceb58ec4c7d82ee845b171542b3/users/579c4082b5e54e7087feff13f3d5d544/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:30:02.970059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25ff47-69e4-4bb3-98e8-512d8d737aa9 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:02.971062 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25ff47-69e4-4bb3-98e8-512d8d737aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:02.971571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25ff47-69e4-4bb3-98e8-512d8d737aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:03.009293 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-bf25ff47-69e4-4bb3-98e8-512d8d737aa9 None None] MFA Rules not processed for user `579c4082b5e54e7087feff13f3d5d544`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:03.010562 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-bf25ff47-69e4-4bb3-98e8-512d8d737aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:03.088566 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1137/2249] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:30:03.099591 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e3841-beff-4bd8-b197-ec9f5cd21dc8 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:03.101361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-339e3841-beff-4bd8-b197-ec9f5cd21dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:03.182881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e3841-beff-4bd8-b197-ec9f5cd21dc8 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:03.187633 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7ffb7-989f-459e-b3e0-59dcca6977f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:03.188347 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7ffb7-989f-459e-b3e0-59dcca6977f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:03.189436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7ffb7-989f-459e-b3e0-59dcca6977f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:03.189436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7ffb7-989f-459e-b3e0-59dcca6977f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:03.200346 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7ffb7-989f-459e-b3e0-59dcca6977f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:03.201894 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7ffb7-989f-459e-b3e0-59dcca6977f7 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:03.215096 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1113/2250] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:30:03 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:30:06.689860 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad968a1a-c31f-4e5f-86d0-e01144cbed96 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:06.690419 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad968a1a-c31f-4e5f-86d0-e01144cbed96 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:06.690534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad968a1a-c31f-4e5f-86d0-e01144cbed96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:06.709437 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-ad968a1a-c31f-4e5f-86d0-e01144cbed96 None None] MFA Rules not processed for user `db2792db73c24a75a449894faf6fbf73`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:06.711434 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ad968a1a-c31f-4e5f-86d0-e01144cbed96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:06.768137 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1138/2251] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:10.940382 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7ffb7-989f-459e-b3e0-59dcca6977f7 service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:10.965596 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:11.052167 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7ffb7-989f-459e-b3e0-59dcca6977f7 service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:11.058998 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e2bbb-ce19-440b-83d6-be78292af797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:11.060472 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e2bbb-ce19-440b-83d6-be78292af797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:11.060765 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e2bbb-ce19-440b-83d6-be78292af797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:11.061135 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e2bbb-ce19-440b-83d6-be78292af797 admin admin] PATH_INFO: `/v3/users/579c4082b5e54e7087feff13f3d5d544` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:11.062915 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e2bbb-ce19-440b-83d6-be78292af797 admin admin] RBAC: Authorizing `identity:delete_user(user_id=579c4082b5e54e7087feff13f3d5d544)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:11.065070 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e2bbb-ce19-440b-83d6-be78292af797 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:11.298650 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-fd2e2bbb-ce19-440b-83d6-be78292af797 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '579c4082b5e54e7087feff13f3d5d544'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:11.307223 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-fd2e2bbb-ce19-440b-83d6-be78292af797 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '579c4082b5e54e7087feff13f3d5d544'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:11.323767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-fd2e2bbb-ce19-440b-83d6-be78292af797 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '579c4082b5e54e7087feff13f3d5d544'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:11.324530 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-fd2e2bbb-ce19-440b-83d6-be78292af797 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '579c4082b5e54e7087feff13f3d5d544'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:11.416926 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-fd2e2bbb-ce19-440b-83d6-be78292af797 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '579c4082b5e54e7087feff13f3d5d544'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:11.423887 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1114/2252] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:30:10 2022] DELETE /identity/v3/users/579c4082b5e54e7087feff13f3d5d544 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:30:11.435385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1dc6b-f705-4f22-9a36-c33a14f1b1f4 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:11.435858 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1dc6b-f705-4f22-9a36-c33a14f1b1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:11.435949 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1dc6b-f705-4f22-9a36-c33a14f1b1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:11.500498 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:11.528903 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-50a1dc6b-f705-4f22-9a36-c33a14f1b1f4 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:11.530719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-50a1dc6b-f705-4f22-9a36-c33a14f1b1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:11.696321 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1139/2253] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:30:11.706176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e2bbb-ce19-440b-83d6-be78292af797 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:11.707825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-fd2e2bbb-ce19-440b-83d6-be78292af797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:11.833818 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1517a7d-8e3a-4d95-a038-b1db74138f76 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:11.834126 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1517a7d-8e3a-4d95-a038-b1db74138f76 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:11.834424 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1517a7d-8e3a-4d95-a038-b1db74138f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:11.838775 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:11.840935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e2bbb-ce19-440b-83d6-be78292af797 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:11.848232 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cb5bb-b127-4b1c-99e6-0c7590e0ffd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:11.849340 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cb5bb-b127-4b1c-99e6-0c7590e0ffd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:11.853028 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cb5bb-b127-4b1c-99e6-0c7590e0ffd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:11.853028 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cb5bb-b127-4b1c-99e6-0c7590e0ffd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:11.857257 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-a1517a7d-8e3a-4d95-a038-b1db74138f76 None None] MFA Rules not processed for user `063ce3b820a74d648d709ab6ac4d7be2`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:11.858682 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a1517a7d-8e3a-4d95-a038-b1db74138f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:11.861211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54cb5bb-b127-4b1c-99e6-0c7590e0ffd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:11.863049 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54cb5bb-b127-4b1c-99e6-0c7590e0ffd5 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:11.885706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1115/2254] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:30:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:30:11.943095 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1140/2255] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Jul 5 21:30:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:11.992548 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cb5bb-b127-4b1c-99e6-0c7590e0ffd5 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:11.994793 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e54cb5bb-b127-4b1c-99e6-0c7590e0ffd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:12.076551 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cb5bb-b127-4b1c-99e6-0c7590e0ffd5 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:12.082086 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68d468-1b51-4b06-b68d-c05daaf62e55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '441be62a077444b9b9f78714e24a760a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:12.082770 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68d468-1b51-4b06-b68d-c05daaf62e55 service swift] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:12.083063 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68d468-1b51-4b06-b68d-c05daaf62e55 service swift] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:12.083529 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68d468-1b51-4b06-b68d-c05daaf62e55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:12.094368 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca68d468-1b51-4b06-b68d-c05daaf62e55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:12.096261 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca68d468-1b51-4b06-b68d-c05daaf62e55 service swift] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:12.105862 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1116/2256] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Jul 5 21:30:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 21:30:12.496201 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1517a7d-8e3a-4d95-a038-b1db74138f76 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:12.497777 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a1517a7d-8e3a-4d95-a038-b1db74138f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:12.521411 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1517a7d-8e3a-4d95-a038-b1db74138f76 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:12.541757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b6e7a-9384-41cb-84d1-f75e19f686c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:12.543119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b6e7a-9384-41cb-84d1-f75e19f686c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:12.543569 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b6e7a-9384-41cb-84d1-f75e19f686c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:12.544020 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b6e7a-9384-41cb-84d1-f75e19f686c2 admin admin] PATH_INFO: `/v3/projects/89b2dceb58ec4c7d82ee845b171542b3` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:12.560312 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b6e7a-9384-41cb-84d1-f75e19f686c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89b2dceb58ec4c7d82ee845b171542b3)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:12.565059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b6e7a-9384-41cb-84d1-f75e19f686c2 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:12.725790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f63b6e7a-9384-41cb-84d1-f75e19f686c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89b2dceb58ec4c7d82ee845b171542b3', 'request_id': 'req-f63b6e7a-9384-41cb-84d1-f75e19f686c2'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:12.845367 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f63b6e7a-9384-41cb-84d1-f75e19f686c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89b2dceb58ec4c7d82ee845b171542b3', 'request_id': 'req-f63b6e7a-9384-41cb-84d1-f75e19f686c2'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:12.853670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:12.860250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f63b6e7a-9384-41cb-84d1-f75e19f686c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89b2dceb58ec4c7d82ee845b171542b3', 'request_id': 'req-f63b6e7a-9384-41cb-84d1-f75e19f686c2'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:12.875757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f63b6e7a-9384-41cb-84d1-f75e19f686c2 admin admin] The token cache is being invalidate because project 89b2dceb58ec4c7d82ee845b171542b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:30:12.876155 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f63b6e7a-9384-41cb-84d1-f75e19f686c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:12.877034 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f63b6e7a-9384-41cb-84d1-f75e19f686c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:12.888854 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1141/2257] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:30:12 2022] DELETE /identity/v3/projects/89b2dceb58ec4c7d82ee845b171542b3 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:30:21.107277 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88adce-7b75-4313-b6b2-4855a881e5d7 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:21.107895 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88adce-7b75-4313-b6b2-4855a881e5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:21.107895 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88adce-7b75-4313-b6b2-4855a881e5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:21.127671 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-3f88adce-7b75-4313-b6b2-4855a881e5d7 None None] MFA Rules not processed for user `1f329dcc462c425c8a9ab50e799e4edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:21.130224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3f88adce-7b75-4313-b6b2-4855a881e5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:21.221301 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1117/2258] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:22.967452 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b6e7a-9384-41cb-84d1-f75e19f686c2 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:22.969105 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f63b6e7a-9384-41cb-84d1-f75e19f686c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:23.061773 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b6e7a-9384-41cb-84d1-f75e19f686c2 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:23.068598 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838c336-f4c1-47ab-b303-7c86655d4f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:23.080377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838c336-f4c1-47ab-b303-7c86655d4f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:23.080377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838c336-f4c1-47ab-b303-7c86655d4f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:23.080377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838c336-f4c1-47ab-b303-7c86655d4f13 admin admin] PATH_INFO: `/v3/users/88745462d3454e53b8beb72b9f4bbc03` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:23.080377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838c336-f4c1-47ab-b303-7c86655d4f13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88745462d3454e53b8beb72b9f4bbc03)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:23.080377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838c336-f4c1-47ab-b303-7c86655d4f13 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:23.324401 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7838c336-f4c1-47ab-b303-7c86655d4f13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88745462d3454e53b8beb72b9f4bbc03'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:23.392069 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7838c336-f4c1-47ab-b303-7c86655d4f13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88745462d3454e53b8beb72b9f4bbc03'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:23.408365 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7838c336-f4c1-47ab-b303-7c86655d4f13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88745462d3454e53b8beb72b9f4bbc03'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:23.416625 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7838c336-f4c1-47ab-b303-7c86655d4f13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88745462d3454e53b8beb72b9f4bbc03'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:23.417559 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-7838c336-f4c1-47ab-b303-7c86655d4f13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88745462d3454e53b8beb72b9f4bbc03'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:23.424795 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1142/2259] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:30:22 2022] DELETE /identity/v3/users/88745462d3454e53b8beb72b9f4bbc03 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:30:23.429469 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4bce9-2ef6-4ffd-a9f7-283d1f4d5365 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:23.430571 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4bce9-2ef6-4ffd-a9f7-283d1f4d5365 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:23.440305 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4bce9-2ef6-4ffd-a9f7-283d1f4d5365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:23.459089 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-8df4bce9-2ef6-4ffd-a9f7-283d1f4d5365 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:23.461166 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8df4bce9-2ef6-4ffd-a9f7-283d1f4d5365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:23.546776 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1118/2260] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:23.558187 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838c336-f4c1-47ab-b303-7c86655d4f13 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:23.559667 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7838c336-f4c1-47ab-b303-7c86655d4f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:23.658401 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838c336-f4c1-47ab-b303-7c86655d4f13 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:23.663824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf727b-3d9c-4be4-875d-0772db81f994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:23.669065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf727b-3d9c-4be4-875d-0772db81f994 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:23.669065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf727b-3d9c-4be4-875d-0772db81f994 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:23.669065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf727b-3d9c-4be4-875d-0772db81f994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:23.680599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf727b-3d9c-4be4-875d-0772db81f994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:23.682388 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf727b-3d9c-4be4-875d-0772db81f994 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:23.695441 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1143/2261] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:30:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:30:24.403279 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4bce9-2ef6-4ffd-a9f7-283d1f4d5365 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:24.405403 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8df4bce9-2ef6-4ffd-a9f7-283d1f4d5365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:24.424169 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4bce9-2ef6-4ffd-a9f7-283d1f4d5365 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:24.430702 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd3640-f965-446d-9b9a-da6a386ef9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:24.432843 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd3640-f965-446d-9b9a-da6a386ef9e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:24.433331 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd3640-f965-446d-9b9a-da6a386ef9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:24.433804 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd3640-f965-446d-9b9a-da6a386ef9e6 admin admin] PATH_INFO: `/v3/projects/19ade96ffea9473ab159ddb2e5c72073` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:24.435287 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd3640-f965-446d-9b9a-da6a386ef9e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19ade96ffea9473ab159ddb2e5c72073)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:24.440741 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd3640-f965-446d-9b9a-da6a386ef9e6 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:24.472305 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:24.594510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-a3fd3640-f965-446d-9b9a-da6a386ef9e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19ade96ffea9473ab159ddb2e5c72073', 'request_id': 'req-a3fd3640-f965-446d-9b9a-da6a386ef9e6'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:24.600805 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-a3fd3640-f965-446d-9b9a-da6a386ef9e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19ade96ffea9473ab159ddb2e5c72073', 'request_id': 'req-a3fd3640-f965-446d-9b9a-da6a386ef9e6'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:24.671266 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf727b-3d9c-4be4-875d-0772db81f994 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:24.672834 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6adf727b-3d9c-4be4-875d-0772db81f994 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:24.697540 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf727b-3d9c-4be4-875d-0772db81f994 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:24.702659 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:24.732207 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-a3fd3640-f965-446d-9b9a-da6a386ef9e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19ade96ffea9473ab159ddb2e5c72073', 'request_id': 'req-a3fd3640-f965-446d-9b9a-da6a386ef9e6'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:24.752085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-a3fd3640-f965-446d-9b9a-da6a386ef9e6 admin admin] The token cache is being invalidate because project 19ade96ffea9473ab159ddb2e5c72073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:30:24.752939 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-a3fd3640-f965-446d-9b9a-da6a386ef9e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:24.754232 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-a3fd3640-f965-446d-9b9a-da6a386ef9e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:24.756616 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1119/2262] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:30:24 2022] DELETE /identity/v3/projects/19ade96ffea9473ab159ddb2e5c72073 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:30:24.761709 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573cc0d-3fce-429c-bd4b-8fb54814f161 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:24.762368 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573cc0d-3fce-429c-bd4b-8fb54814f161 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:24.763140 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573cc0d-3fce-429c-bd4b-8fb54814f161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:24.795653 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f39dee-8c38-4784-a35b-1f220fcd2a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:24.796720 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f39dee-8c38-4784-a35b-1f220fcd2a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:24.797026 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f39dee-8c38-4784-a35b-1f220fcd2a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:24.797385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f39dee-8c38-4784-a35b-1f220fcd2a5e admin admin] PATH_INFO: `/v3/users/570a533b3e4b4648a0c8c1960f3dbadd` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:24.799559 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f39dee-8c38-4784-a35b-1f220fcd2a5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=570a533b3e4b4648a0c8c1960f3dbadd)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:24.812268 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f39dee-8c38-4784-a35b-1f220fcd2a5e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:24.829217 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-2573cc0d-3fce-429c-bd4b-8fb54814f161 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:24.831612 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2573cc0d-3fce-429c-bd4b-8fb54814f161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:24.851694 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1120/2263] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:24.860129 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f86db-26ff-4e13-adad-5bca3082e38d None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:24.860510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f86db-26ff-4e13-adad-5bca3082e38d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:24.860855 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f86db-26ff-4e13-adad-5bca3082e38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:24.884799 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-b72f86db-26ff-4e13-adad-5bca3082e38d None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:24.887384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b72f86db-26ff-4e13-adad-5bca3082e38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:24.899414 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1121/2264] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:30:24.904087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f86db-26ff-4e13-adad-5bca3082e38d None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:24.916645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f86db-26ff-4e13-adad-5bca3082e38d None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:24.924520 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157764c-5008-4e4b-a534-3c813821c957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:24.928816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157764c-5008-4e4b-a534-3c813821c957 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:24.928816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157764c-5008-4e4b-a534-3c813821c957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:24.928816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157764c-5008-4e4b-a534-3c813821c957 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:24.929561 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157764c-5008-4e4b-a534-3c813821c957 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:24.930136 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157764c-5008-4e4b-a534-3c813821c957 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:24.932198 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157764c-5008-4e4b-a534-3c813821c957 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:24.954308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1122/2265] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:30:24.958037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157764c-5008-4e4b-a534-3c813821c957 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:24.969175 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157764c-5008-4e4b-a534-3c813821c957 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:24.976779 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e99392-e493-4a41-a29e-9e643e5ce763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:24.977452 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e99392-e493-4a41-a29e-9e643e5ce763 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:24.977760 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e99392-e493-4a41-a29e-9e643e5ce763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:24.978030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e99392-e493-4a41-a29e-9e643e5ce763 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:24.978809 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e99392-e493-4a41-a29e-9e643e5ce763 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:24.980734 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e99392-e493-4a41-a29e-9e643e5ce763 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:25.105524 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1123/2266] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:30:24 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:30:25.109565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e99392-e493-4a41-a29e-9e643e5ce763 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:25.149936 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-06f39dee-8c38-4784-a35b-1f220fcd2a5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '570a533b3e4b4648a0c8c1960f3dbadd'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:25.208713 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e99392-e493-4a41-a29e-9e643e5ce763 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:25.220350 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfefe2-ae2e-4de2-b23b-369b53ea994b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:25.221212 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfefe2-ae2e-4de2-b23b-369b53ea994b admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:25.221767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfefe2-ae2e-4de2-b23b-369b53ea994b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:25.222214 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-06f39dee-8c38-4784-a35b-1f220fcd2a5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '570a533b3e4b4648a0c8c1960f3dbadd'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:25.222407 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfefe2-ae2e-4de2-b23b-369b53ea994b admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:25.223244 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfefe2-ae2e-4de2-b23b-369b53ea994b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:25.225937 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfefe2-ae2e-4de2-b23b-369b53ea994b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:25.267124 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-06f39dee-8c38-4784-a35b-1f220fcd2a5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '570a533b3e4b4648a0c8c1960f3dbadd'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:25.281777 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-06f39dee-8c38-4784-a35b-1f220fcd2a5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '570a533b3e4b4648a0c8c1960f3dbadd'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:25.282688 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-06f39dee-8c38-4784-a35b-1f220fcd2a5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '570a533b3e4b4648a0c8c1960f3dbadd'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:25.300819 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1144/2267] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:30:24 2022] DELETE /identity/v3/users/570a533b3e4b4648a0c8c1960f3dbadd => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:30:25.303824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a1f6b-f4dd-49cf-84e2-9c5b11ab3bb9 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:25.304374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a1f6b-f4dd-49cf-84e2-9c5b11ab3bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:25.304953 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a1f6b-f4dd-49cf-84e2-9c5b11ab3bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:25.322345 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1124/2268] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:30:25 2022] POST /identity/v3/users => generated 287 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:30:25.327314 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfefe2-ae2e-4de2-b23b-369b53ea994b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:25.329049 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-37cfefe2-ae2e-4de2-b23b-369b53ea994b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:25.335945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-6f8a1f6b-f4dd-49cf-84e2-9c5b11ab3bb9 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:25.337272 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6f8a1f6b-f4dd-49cf-84e2-9c5b11ab3bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:25.354181 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfefe2-ae2e-4de2-b23b-369b53ea994b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:25.390047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:25.418462 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1145/2269] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:25.425868 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a1f6b-f4dd-49cf-84e2-9c5b11ab3bb9 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:25.427614 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6f8a1f6b-f4dd-49cf-84e2-9c5b11ab3bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:25.435382 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7facfbd3-34b0-4dac-b37f-f40b2b797209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:25.436084 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facfbd3-34b0-4dac-b37f-f40b2b797209 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:25.436368 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facfbd3-34b0-4dac-b37f-f40b2b797209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:25.436655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facfbd3-34b0-4dac-b37f-f40b2b797209 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:25.437468 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7facfbd3-34b0-4dac-b37f-f40b2b797209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:25.439258 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7facfbd3-34b0-4dac-b37f-f40b2b797209 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:25.450819 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1125/2270] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:30:25.454821 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7facfbd3-34b0-4dac-b37f-f40b2b797209 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:25.465849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7facfbd3-34b0-4dac-b37f-f40b2b797209 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:25.468811 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:25.471759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5776267-631b-4fe4-a457-0bdbeeea5777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:25.478288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5776267-631b-4fe4-a457-0bdbeeea5777 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:25.478288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5776267-631b-4fe4-a457-0bdbeeea5777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:25.478288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5776267-631b-4fe4-a457-0bdbeeea5777 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:25.478288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5776267-631b-4fe4-a457-0bdbeeea5777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:25.478288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5776267-631b-4fe4-a457-0bdbeeea5777 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:25.493733 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1126/2271] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:30:25.499121 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a1f6b-f4dd-49cf-84e2-9c5b11ab3bb9 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:25.500633 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5776267-631b-4fe4-a457-0bdbeeea5777 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:25.505461 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1b0ee-5810-4754-8053-a5d72c8ce7c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:25.506257 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1b0ee-5810-4754-8053-a5d72c8ce7c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:25.506912 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1b0ee-5810-4754-8053-a5d72c8ce7c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:25.507362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1b0ee-5810-4754-8053-a5d72c8ce7c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:25.516865 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5776267-631b-4fe4-a457-0bdbeeea5777 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:25.519846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1b0ee-5810-4754-8053-a5d72c8ce7c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:25.522279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1b0ee-5810-4754-8053-a5d72c8ce7c8 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:25.522757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca239db1-0f18-41c9-85db-244dde4e2044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:25.523823 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca239db1-0f18-41c9-85db-244dde4e2044 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:25.524291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca239db1-0f18-41c9-85db-244dde4e2044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:25.524733 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca239db1-0f18-41c9-85db-244dde4e2044 admin admin] PATH_INFO: `/v3/projects/229d22f0b88540a28b4760b603651007/users/0fe315cf964248049eacf8c88040448a/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:25.534697 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1146/2272] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:30:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:30:25.549687 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca239db1-0f18-41c9-85db-244dde4e2044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=229d22f0b88540a28b4760b603651007, user_id=0fe315cf964248049eacf8c88040448a, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:25.553911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca239db1-0f18-41c9-85db-244dde4e2044 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:25.674487 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1127/2273] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:30:25 2022] PUT /identity/v3/projects/229d22f0b88540a28b4760b603651007/users/0fe315cf964248049eacf8c88040448a/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:30:25.730051 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297aff1-a394-438c-9105-028ef42053b6 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:25.730656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297aff1-a394-438c-9105-028ef42053b6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:25.730656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297aff1-a394-438c-9105-028ef42053b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:25.785471 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-1297aff1-a394-438c-9105-028ef42053b6 None None] MFA Rules not processed for user `0fe315cf964248049eacf8c88040448a`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:25.787621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-1297aff1-a394-438c-9105-028ef42053b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:25.922621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1147/2274] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:25.936728 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca239db1-0f18-41c9-85db-244dde4e2044 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:25.938773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ca239db1-0f18-41c9-85db-244dde4e2044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:26.053017 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca239db1-0f18-41c9-85db-244dde4e2044 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:26.058213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba196d96-1965-4f38-8c40-07f8a7dccbf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:26.073379 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba196d96-1965-4f38-8c40-07f8a7dccbf0 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:26.073888 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba196d96-1965-4f38-8c40-07f8a7dccbf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:26.074445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba196d96-1965-4f38-8c40-07f8a7dccbf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:26.101986 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba196d96-1965-4f38-8c40-07f8a7dccbf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:26.101986 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba196d96-1965-4f38-8c40-07f8a7dccbf0 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:26.114751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1128/2275] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:30:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:30:26.297364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297aff1-a394-438c-9105-028ef42053b6 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:26.299052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-1297aff1-a394-438c-9105-028ef42053b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:26.452201 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297aff1-a394-438c-9105-028ef42053b6 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:26.457988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91853d-7e30-428e-8713-178e0e2d0b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:26.459091 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91853d-7e30-428e-8713-178e0e2d0b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:26.459562 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91853d-7e30-428e-8713-178e0e2d0b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:26.459916 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91853d-7e30-428e-8713-178e0e2d0b6f admin admin] PATH_INFO: `/v3/projects/94ec02e15bb04ebabe231564b69dcdca` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:26.461516 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91853d-7e30-428e-8713-178e0e2d0b6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=94ec02e15bb04ebabe231564b69dcdca)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:26.463685 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91853d-7e30-428e-8713-178e0e2d0b6f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:26.651801 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ac91853d-7e30-428e-8713-178e0e2d0b6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94ec02e15bb04ebabe231564b69dcdca', 'request_id': 'req-ac91853d-7e30-428e-8713-178e0e2d0b6f'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:26.770622 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ac91853d-7e30-428e-8713-178e0e2d0b6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94ec02e15bb04ebabe231564b69dcdca', 'request_id': 'req-ac91853d-7e30-428e-8713-178e0e2d0b6f'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:26.778850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:26.782340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ac91853d-7e30-428e-8713-178e0e2d0b6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94ec02e15bb04ebabe231564b69dcdca', 'request_id': 'req-ac91853d-7e30-428e-8713-178e0e2d0b6f'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:26.815422 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ac91853d-7e30-428e-8713-178e0e2d0b6f admin admin] The token cache is being invalidate because project 94ec02e15bb04ebabe231564b69dcdca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:30:26.817643 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ac91853d-7e30-428e-8713-178e0e2d0b6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:26.820407 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ac91853d-7e30-428e-8713-178e0e2d0b6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:26.822336 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1148/2276] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:30:26 2022] DELETE /identity/v3/projects/94ec02e15bb04ebabe231564b69dcdca => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:30:26.826894 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba196d96-1965-4f38-8c40-07f8a7dccbf0 service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:26.852510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba196d96-1965-4f38-8c40-07f8a7dccbf0 service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:26.983988 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ecf24-3543-4cfe-bd48-7eb8ad67c767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:26.985488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ecf24-3543-4cfe-bd48-7eb8ad67c767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:26.985789 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ecf24-3543-4cfe-bd48-7eb8ad67c767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:26.986072 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ecf24-3543-4cfe-bd48-7eb8ad67c767 admin admin] PATH_INFO: `/v3/users/d5dd0f21dc66459ab9de179ae3c7cbb6` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:26.987359 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ecf24-3543-4cfe-bd48-7eb8ad67c767 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5dd0f21dc66459ab9de179ae3c7cbb6)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:26.989346 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ecf24-3543-4cfe-bd48-7eb8ad67c767 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:27.191323 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:27.214550 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-717ecf24-3543-4cfe-bd48-7eb8ad67c767 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5dd0f21dc66459ab9de179ae3c7cbb6'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:27.234908 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-717ecf24-3543-4cfe-bd48-7eb8ad67c767 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5dd0f21dc66459ab9de179ae3c7cbb6'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:27.261671 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-717ecf24-3543-4cfe-bd48-7eb8ad67c767 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5dd0f21dc66459ab9de179ae3c7cbb6'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:27.262460 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-717ecf24-3543-4cfe-bd48-7eb8ad67c767 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5dd0f21dc66459ab9de179ae3c7cbb6'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:27.391459 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-717ecf24-3543-4cfe-bd48-7eb8ad67c767 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5dd0f21dc66459ab9de179ae3c7cbb6'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:27.404388 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1129/2277] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:30:26 2022] DELETE /identity/v3/users/d5dd0f21dc66459ab9de179ae3c7cbb6 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:30:28.166569 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91853d-7e30-428e-8713-178e0e2d0b6f admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:28.213241 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ac91853d-7e30-428e-8713-178e0e2d0b6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:28.335498 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351db559-477d-4bba-b2e6-d8f64ab548e0 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:28.335498 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351db559-477d-4bba-b2e6-d8f64ab548e0 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:28.335498 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351db559-477d-4bba-b2e6-d8f64ab548e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:28.336407 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91853d-7e30-428e-8713-178e0e2d0b6f admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:28.399402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-351db559-477d-4bba-b2e6-d8f64ab548e0 None None] MFA Rules not processed for user `0fe315cf964248049eacf8c88040448a`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:28.401018 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-351db559-477d-4bba-b2e6-d8f64ab548e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:28.479099 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3160dc7-62b2-4181-a1e9-35c151d916bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:28.481377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3160dc7-62b2-4181-a1e9-35c151d916bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:28.482361 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3160dc7-62b2-4181-a1e9-35c151d916bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:28.483255 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3160dc7-62b2-4181-a1e9-35c151d916bf admin admin] PATH_INFO: `/v3/projects/214f788969b34a0b8a95c2348c5dc82f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:28.487761 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3160dc7-62b2-4181-a1e9-35c151d916bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=214f788969b34a0b8a95c2348c5dc82f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:28.487761 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3160dc7-62b2-4181-a1e9-35c151d916bf admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:28.495448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1130/2278] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:28.677304 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d3160dc7-62b2-4181-a1e9-35c151d916bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '214f788969b34a0b8a95c2348c5dc82f', 'request_id': 'req-d3160dc7-62b2-4181-a1e9-35c151d916bf'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:28.799085 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d3160dc7-62b2-4181-a1e9-35c151d916bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '214f788969b34a0b8a95c2348c5dc82f', 'request_id': 'req-d3160dc7-62b2-4181-a1e9-35c151d916bf'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:28.810165 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d3160dc7-62b2-4181-a1e9-35c151d916bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '214f788969b34a0b8a95c2348c5dc82f', 'request_id': 'req-d3160dc7-62b2-4181-a1e9-35c151d916bf'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:28.871575 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d3160dc7-62b2-4181-a1e9-35c151d916bf admin admin] The token cache is being invalidate because project 214f788969b34a0b8a95c2348c5dc82f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:30:28.875016 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d3160dc7-62b2-4181-a1e9-35c151d916bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:28.877563 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d3160dc7-62b2-4181-a1e9-35c151d916bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:28.882356 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1149/2279] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:30:28 2022] DELETE /identity/v3/projects/214f788969b34a0b8a95c2348c5dc82f => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:30:28.888092 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea603c-1ce8-4ced-b777-bb24daf3df81 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:28.888718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea603c-1ce8-4ced-b777-bb24daf3df81 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:28.889199 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea603c-1ce8-4ced-b777-bb24daf3df81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:28.918751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-e8ea603c-1ce8-4ced-b777-bb24daf3df81 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:28.921021 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e8ea603c-1ce8-4ced-b777-bb24daf3df81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:29.002678 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1131/2280] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:30:29.010556 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f5c25-4a62-40d4-b196-defd2a4743e9 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:29.011104 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f5c25-4a62-40d4-b196-defd2a4743e9 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:29.011561 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f5c25-4a62-40d4-b196-defd2a4743e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:29.042771 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-a58f5c25-4a62-40d4-b196-defd2a4743e9 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:29.044371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a58f5c25-4a62-40d4-b196-defd2a4743e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:29.057890 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1150/2281] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:29.061989 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea603c-1ce8-4ced-b777-bb24daf3df81 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:29.077370 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea603c-1ce8-4ced-b777-bb24daf3df81 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:29.089887 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc861dd8-a1f2-4eb4-a203-fc73f67c014f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:29.090892 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc861dd8-a1f2-4eb4-a203-fc73f67c014f admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:29.095511 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc861dd8-a1f2-4eb4-a203-fc73f67c014f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:29.095511 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc861dd8-a1f2-4eb4-a203-fc73f67c014f admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:29.095511 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc861dd8-a1f2-4eb4-a203-fc73f67c014f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:29.095511 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc861dd8-a1f2-4eb4-a203-fc73f67c014f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:29.095511 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc861dd8-a1f2-4eb4-a203-fc73f67c014f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:29.118596 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1132/2282] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:30:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:30:29.120729 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f5c25-4a62-40d4-b196-defd2a4743e9 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:29.135424 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f5c25-4a62-40d4-b196-defd2a4743e9 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:29.154993 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179575ee-72e3-4b56-9d97-c05c77f4e69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:29.155713 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179575ee-72e3-4b56-9d97-c05c77f4e69e admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:29.156012 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179575ee-72e3-4b56-9d97-c05c77f4e69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:29.156288 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179575ee-72e3-4b56-9d97-c05c77f4e69e admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:29.157023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179575ee-72e3-4b56-9d97-c05c77f4e69e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:29.159118 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179575ee-72e3-4b56-9d97-c05c77f4e69e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:29.306790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1151/2283] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:30:29 2022] POST /identity/v3/projects => generated 377 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:30:29.310952 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc861dd8-a1f2-4eb4-a203-fc73f67c014f admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:29.327441 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc861dd8-a1f2-4eb4-a203-fc73f67c014f admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:29.411049 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:29.448498 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aba7c1-b3e0-4256-8438-3e18912928c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:29.449960 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aba7c1-b3e0-4256-8438-3e18912928c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:29.450283 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aba7c1-b3e0-4256-8438-3e18912928c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:29.450566 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aba7c1-b3e0-4256-8438-3e18912928c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:29.452071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aba7c1-b3e0-4256-8438-3e18912928c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:29.454479 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aba7c1-b3e0-4256-8438-3e18912928c4 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:29.601859 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1133/2284] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:30:29 2022] POST /identity/v3/users => generated 289 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:30:29.605671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179575ee-72e3-4b56-9d97-c05c77f4e69e admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:29.623880 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179575ee-72e3-4b56-9d97-c05c77f4e69e admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:29.639235 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5d026-6ae2-40b6-9455-975d7b04096a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:29.640401 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5d026-6ae2-40b6-9455-975d7b04096a admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:29.641202 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5d026-6ae2-40b6-9455-975d7b04096a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:29.641504 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5d026-6ae2-40b6-9455-975d7b04096a admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:29.645457 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5d026-6ae2-40b6-9455-975d7b04096a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:29.648183 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5d026-6ae2-40b6-9455-975d7b04096a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:29.676313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1152/2285] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:30:29.680658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aba7c1-b3e0-4256-8438-3e18912928c4 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:29.703541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aba7c1-b3e0-4256-8438-3e18912928c4 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:29.712319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58303e35-57a1-4730-a61b-4b26c7bc9bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:29.713179 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58303e35-57a1-4730-a61b-4b26c7bc9bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:29.713468 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58303e35-57a1-4730-a61b-4b26c7bc9bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:29.713799 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58303e35-57a1-4730-a61b-4b26c7bc9bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:29.714924 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58303e35-57a1-4730-a61b-4b26c7bc9bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:29.722463 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58303e35-57a1-4730-a61b-4b26c7bc9bc3 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:29.751666 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1134/2286] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:30:29.752943 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5d026-6ae2-40b6-9455-975d7b04096a admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:29.771245 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5d026-6ae2-40b6-9455-975d7b04096a admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:29.782737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108cb7a-486a-46cd-a553-d7e299577ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:29.784058 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108cb7a-486a-46cd-a553-d7e299577ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:29.784522 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108cb7a-486a-46cd-a553-d7e299577ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:29.785004 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108cb7a-486a-46cd-a553-d7e299577ffd admin admin] PATH_INFO: `/v3/projects/da6a40983db74f62a17b796bc66da8d2/users/90904c21b14b44f58f0f66ea58b26253/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:29.808921 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7108cb7a-486a-46cd-a553-d7e299577ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=da6a40983db74f62a17b796bc66da8d2, user_id=90904c21b14b44f58f0f66ea58b26253, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:29.829584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7108cb7a-486a-46cd-a553-d7e299577ffd admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:29.974880 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1153/2287] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:30:29 2022] PUT /identity/v3/projects/da6a40983db74f62a17b796bc66da8d2/users/90904c21b14b44f58f0f66ea58b26253/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:30:29.984986 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457cb62-d952-406f-9c1b-6a0535c042b9 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:29.985261 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457cb62-d952-406f-9c1b-6a0535c042b9 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:29.985875 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457cb62-d952-406f-9c1b-6a0535c042b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:30.029015 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-9457cb62-d952-406f-9c1b-6a0535c042b9 None None] MFA Rules not processed for user `90904c21b14b44f58f0f66ea58b26253`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:30.031015 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9457cb62-d952-406f-9c1b-6a0535c042b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:30.204868 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108cb7a-486a-46cd-a553-d7e299577ffd admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:30.205080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1135/2288] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:30:30.259745 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:30.378669 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108cb7a-486a-46cd-a553-d7e299577ffd admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:30.386553 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2379958-5c39-45b1-9a51-69f28ee4a3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:30.387603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2379958-5c39-45b1-9a51-69f28ee4a3c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:30.388197 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2379958-5c39-45b1-9a51-69f28ee4a3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:30.388958 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2379958-5c39-45b1-9a51-69f28ee4a3c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:30.389932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2379958-5c39-45b1-9a51-69f28ee4a3c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:30.392707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2379958-5c39-45b1-9a51-69f28ee4a3c7 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:30.514554 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1154/2289] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:30:30 2022] POST /identity/v3/projects => generated 377 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:30:30.518675 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457cb62-d952-406f-9c1b-6a0535c042b9 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:30.545260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457cb62-d952-406f-9c1b-6a0535c042b9 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:30.662007 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c183a2-e326-4820-9640-c1ec616e1b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:30.662007 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c183a2-e326-4820-9640-c1ec616e1b75 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:30.662007 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c183a2-e326-4820-9640-c1ec616e1b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:30.662007 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c183a2-e326-4820-9640-c1ec616e1b75 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:30.662573 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c183a2-e326-4820-9640-c1ec616e1b75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:30.664460 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c183a2-e326-4820-9640-c1ec616e1b75 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:30.829542 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1136/2290] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:30:30 2022] POST /identity/v3/users => generated 295 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:30:30.836880 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2379958-5c39-45b1-9a51-69f28ee4a3c7 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:30.857106 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2379958-5c39-45b1-9a51-69f28ee4a3c7 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:30.862847 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c8542-f9c9-4fbd-b2c5-a634c39b872b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:30.863646 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c8542-f9c9-4fbd-b2c5-a634c39b872b admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:30.864033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c8542-f9c9-4fbd-b2c5-a634c39b872b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:30.864411 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c8542-f9c9-4fbd-b2c5-a634c39b872b admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:30.865898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c8542-f9c9-4fbd-b2c5-a634c39b872b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:30.867839 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c8542-f9c9-4fbd-b2c5-a634c39b872b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:30.881609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1155/2291] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:30:30.886005 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c183a2-e326-4820-9640-c1ec616e1b75 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:30.901089 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c183a2-e326-4820-9640-c1ec616e1b75 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:30.910656 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5597f6-9934-4ab5-aa20-c069ab949e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:30.911555 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5597f6-9934-4ab5-aa20-c069ab949e8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:30.912193 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5597f6-9934-4ab5-aa20-c069ab949e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:30.912672 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5597f6-9934-4ab5-aa20-c069ab949e8d admin admin] PATH_INFO: `/v3/projects/31a2bcdbc3214512b14d255c987a9796/users/2ae69ca8173e4563b25a17240b09351e/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:30.947640 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5597f6-9934-4ab5-aa20-c069ab949e8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=31a2bcdbc3214512b14d255c987a9796, user_id=2ae69ca8173e4563b25a17240b09351e, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:30.951919 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5597f6-9934-4ab5-aa20-c069ab949e8d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:31.061725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1137/2292] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:30:30 2022] PUT /identity/v3/projects/31a2bcdbc3214512b14d255c987a9796/users/2ae69ca8173e4563b25a17240b09351e/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:30:31.065956 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c8542-f9c9-4fbd-b2c5-a634c39b872b admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:31.078564 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c8542-f9c9-4fbd-b2c5-a634c39b872b admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:31.190717 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d1611-de97-48a6-852c-866ec1d9cb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:31.191962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d1611-de97-48a6-852c-866ec1d9cb9d admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:31.191962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d1611-de97-48a6-852c-866ec1d9cb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:31.192144 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d1611-de97-48a6-852c-866ec1d9cb9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:31.193319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d1611-de97-48a6-852c-866ec1d9cb9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:31.195199 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d1611-de97-48a6-852c-866ec1d9cb9d admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:31.217750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1156/2293] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:30:31.220226 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5597f6-9934-4ab5-aa20-c069ab949e8d admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:31.235857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5597f6-9934-4ab5-aa20-c069ab949e8d admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:31.256589 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f13a33-48da-484f-8b19-9655889ef470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:31.257610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f13a33-48da-484f-8b19-9655889ef470 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:31.260707 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f13a33-48da-484f-8b19-9655889ef470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:31.260707 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f13a33-48da-484f-8b19-9655889ef470 admin admin] PATH_INFO: `/v3/projects/31a2bcdbc3214512b14d255c987a9796/users/2ae69ca8173e4563b25a17240b09351e/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:31.260935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f13a33-48da-484f-8b19-9655889ef470 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31a2bcdbc3214512b14d255c987a9796, user_id=2ae69ca8173e4563b25a17240b09351e, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:31.264368 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f13a33-48da-484f-8b19-9655889ef470 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:31.284393 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1138/2294] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:30:31 2022] PUT /identity/v3/projects/31a2bcdbc3214512b14d255c987a9796/users/2ae69ca8173e4563b25a17240b09351e/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:30:31.295464 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d72651-6bd4-4e1b-8ed5-49f2e42d33c7 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:31.295824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d72651-6bd4-4e1b-8ed5-49f2e42d33c7 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:31.296117 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d72651-6bd4-4e1b-8ed5-49f2e42d33c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:31.337807 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d9d72651-6bd4-4e1b-8ed5-49f2e42d33c7 None None] MFA Rules not processed for user `2ae69ca8173e4563b25a17240b09351e`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:31.339249 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d9d72651-6bd4-4e1b-8ed5-49f2e42d33c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:31.497900 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1157/2295] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:31.514331 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f13a33-48da-484f-8b19-9655889ef470 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:31.516791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-28f13a33-48da-484f-8b19-9655889ef470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:31.524661 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:31.598106 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f13a33-48da-484f-8b19-9655889ef470 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:31.611691 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191570b-5391-479c-83b4-d8474de74d90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:31.612617 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191570b-5391-479c-83b4-d8474de74d90 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:31.613247 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191570b-5391-479c-83b4-d8474de74d90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:31.613584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191570b-5391-479c-83b4-d8474de74d90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:31.764104 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191570b-5391-479c-83b4-d8474de74d90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:31.766614 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191570b-5391-479c-83b4-d8474de74d90 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:31.798635 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1139/2296] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:30:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:30:34.827536 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d72651-6bd4-4e1b-8ed5-49f2e42d33c7 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:34.850364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d72651-6bd4-4e1b-8ed5-49f2e42d33c7 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:34.855837 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe44be8-d003-4622-a1ce-31f0c432a732 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:34.860904 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe44be8-d003-4622-a1ce-31f0c432a732 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:34.860904 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe44be8-d003-4622-a1ce-31f0c432a732 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:34.860904 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe44be8-d003-4622-a1ce-31f0c432a732 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:34.872791 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe44be8-d003-4622-a1ce-31f0c432a732 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:34.874869 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe44be8-d003-4622-a1ce-31f0c432a732 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:34.896871 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:34.903816 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1158/2297] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:30:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:30:36.692190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2702a6-a45c-41f4-8577-aed99208601a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:36.693114 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2702a6-a45c-41f4-8577-aed99208601a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:36.693397 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2702a6-a45c-41f4-8577-aed99208601a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:36.735365 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-eb2702a6-a45c-41f4-8577-aed99208601a None None] MFA Rules not processed for user `063ce3b820a74d648d709ab6ac4d7be2`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:36.736683 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-eb2702a6-a45c-41f4-8577-aed99208601a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:36.827665 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1140/2298] 10.222.0.13 () {58 vars in 967 bytes} [Tue Jul 5 21:30:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:36.843509 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe44be8-d003-4622-a1ce-31f0c432a732 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:36.845085 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-9fe44be8-d003-4622-a1ce-31f0c432a732 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:37.009667 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe44be8-d003-4622-a1ce-31f0c432a732 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:37.011737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335dc66-1c03-4090-99bd-2593592b93fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '441be62a077444b9b9f78714e24a760a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:37.012400 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335dc66-1c03-4090-99bd-2593592b93fc service swift] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:37.012687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335dc66-1c03-4090-99bd-2593592b93fc service swift] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:37.012964 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335dc66-1c03-4090-99bd-2593592b93fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:37.024091 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a335dc66-1c03-4090-99bd-2593592b93fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:37.025844 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a335dc66-1c03-4090-99bd-2593592b93fc service swift] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:37.039979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1159/2299] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Jul 5 21:30:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 21:30:39.440543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2702a6-a45c-41f4-8577-aed99208601a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:39.492185 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:39.511288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2702a6-a45c-41f4-8577-aed99208601a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:39.516108 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545e3be-42f4-467d-a9fc-c81c031bbf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:39.516987 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545e3be-42f4-467d-a9fc-c81c031bbf4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:39.517269 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545e3be-42f4-467d-a9fc-c81c031bbf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:39.517550 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545e3be-42f4-467d-a9fc-c81c031bbf4b admin admin] PATH_INFO: `/v3/users/90904c21b14b44f58f0f66ea58b26253` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:39.518777 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545e3be-42f4-467d-a9fc-c81c031bbf4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=90904c21b14b44f58f0f66ea58b26253)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:39.521363 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545e3be-42f4-467d-a9fc-c81c031bbf4b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:39.767651 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-d545e3be-42f4-467d-a9fc-c81c031bbf4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90904c21b14b44f58f0f66ea58b26253'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:39.775674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-d545e3be-42f4-467d-a9fc-c81c031bbf4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90904c21b14b44f58f0f66ea58b26253'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:39.788522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-d545e3be-42f4-467d-a9fc-c81c031bbf4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90904c21b14b44f58f0f66ea58b26253'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:39.789248 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-d545e3be-42f4-467d-a9fc-c81c031bbf4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90904c21b14b44f58f0f66ea58b26253'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:39.853116 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-d545e3be-42f4-467d-a9fc-c81c031bbf4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90904c21b14b44f58f0f66ea58b26253'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:39.860724 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1141/2300] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:30:39 2022] DELETE /identity/v3/users/90904c21b14b44f58f0f66ea58b26253 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:30:39.866061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef4c58-255a-4d3c-83ec-571caf7ad397 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:39.866576 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef4c58-255a-4d3c-83ec-571caf7ad397 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:39.866690 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef4c58-255a-4d3c-83ec-571caf7ad397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:39.886373 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d0ef4c58-255a-4d3c-83ec-571caf7ad397 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:39.887857 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d0ef4c58-255a-4d3c-83ec-571caf7ad397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:39.960893 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1160/2301] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:39.970712 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545e3be-42f4-467d-a9fc-c81c031bbf4b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:39.972352 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d545e3be-42f4-467d-a9fc-c81c031bbf4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:40.044291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545e3be-42f4-467d-a9fc-c81c031bbf4b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:40.048288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e3b8a-e20a-41dc-a26c-3ca1943873d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:40.049137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e3b8a-e20a-41dc-a26c-3ca1943873d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:40.051728 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e3b8a-e20a-41dc-a26c-3ca1943873d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:40.051728 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e3b8a-e20a-41dc-a26c-3ca1943873d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:40.059252 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e3b8a-e20a-41dc-a26c-3ca1943873d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:40.060732 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e3b8a-e20a-41dc-a26c-3ca1943873d3 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:40.070652 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1142/2302] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:30:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:30:40.557488 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef4c58-255a-4d3c-83ec-571caf7ad397 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:40.560666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d0ef4c58-255a-4d3c-83ec-571caf7ad397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:40.574063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef4c58-255a-4d3c-83ec-571caf7ad397 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:40.579973 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054c942-d2bd-4d8e-b636-62d82a2a4eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:40.580858 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054c942-d2bd-4d8e-b636-62d82a2a4eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:40.581141 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054c942-d2bd-4d8e-b636-62d82a2a4eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:40.581417 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054c942-d2bd-4d8e-b636-62d82a2a4eef admin admin] PATH_INFO: `/v3/projects/da6a40983db74f62a17b796bc66da8d2` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:40.583258 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054c942-d2bd-4d8e-b636-62d82a2a4eef admin admin] RBAC: Authorizing `identity:delete_project(project_id=da6a40983db74f62a17b796bc66da8d2)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:40.590495 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054c942-d2bd-4d8e-b636-62d82a2a4eef admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:40.736039 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e054c942-d2bd-4d8e-b636-62d82a2a4eef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da6a40983db74f62a17b796bc66da8d2', 'request_id': 'req-e054c942-d2bd-4d8e-b636-62d82a2a4eef'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:40.866007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e054c942-d2bd-4d8e-b636-62d82a2a4eef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da6a40983db74f62a17b796bc66da8d2', 'request_id': 'req-e054c942-d2bd-4d8e-b636-62d82a2a4eef'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:40.868922 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e054c942-d2bd-4d8e-b636-62d82a2a4eef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da6a40983db74f62a17b796bc66da8d2', 'request_id': 'req-e054c942-d2bd-4d8e-b636-62d82a2a4eef'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:40.876225 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e3b8a-e20a-41dc-a26c-3ca1943873d3 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:40.879040 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-109e3b8a-e20a-41dc-a26c-3ca1943873d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:40.888966 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e054c942-d2bd-4d8e-b636-62d82a2a4eef admin admin] The token cache is being invalidate because project da6a40983db74f62a17b796bc66da8d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:30:40.889109 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e054c942-d2bd-4d8e-b636-62d82a2a4eef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:40.889816 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e054c942-d2bd-4d8e-b636-62d82a2a4eef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:40.893399 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1161/2303] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:30:40 2022] DELETE /identity/v3/projects/da6a40983db74f62a17b796bc66da8d2 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:30:40.898929 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054c942-d2bd-4d8e-b636-62d82a2a4eef admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:40.899618 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e3b8a-e20a-41dc-a26c-3ca1943873d3 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:40.900968 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e054c942-d2bd-4d8e-b636-62d82a2a4eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:40.924509 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:40.984612 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c8c4c-960a-4d1f-a5f1-9fa1cac93273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:40.985489 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c8c4c-960a-4d1f-a5f1-9fa1cac93273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:40.985768 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c8c4c-960a-4d1f-a5f1-9fa1cac93273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:40.986040 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c8c4c-960a-4d1f-a5f1-9fa1cac93273 admin admin] PATH_INFO: `/v3/users/eff8feae83ae43ba82cc5a58044cb7c3` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:40.987319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c8c4c-960a-4d1f-a5f1-9fa1cac93273 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eff8feae83ae43ba82cc5a58044cb7c3)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:40.989859 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c8c4c-960a-4d1f-a5f1-9fa1cac93273 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:40.991478 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054c942-d2bd-4d8e-b636-62d82a2a4eef admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:40.997259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0c018-3cee-44cd-aa34-bc595975f902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:40.998196 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0c018-3cee-44cd-aa34-bc595975f902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:40.998486 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0c018-3cee-44cd-aa34-bc595975f902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:40.999026 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0c018-3cee-44cd-aa34-bc595975f902 admin admin] PATH_INFO: `/v3/users/2ae69ca8173e4563b25a17240b09351e` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:41.000266 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc0c018-3cee-44cd-aa34-bc595975f902 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ae69ca8173e4563b25a17240b09351e)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:41.002064 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:41.002916 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc0c018-3cee-44cd-aa34-bc595975f902 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:41.240638 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-f46c8c4c-960a-4d1f-a5f1-9fa1cac93273 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eff8feae83ae43ba82cc5a58044cb7c3'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:41.248261 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-f46c8c4c-960a-4d1f-a5f1-9fa1cac93273 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eff8feae83ae43ba82cc5a58044cb7c3'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:41.262332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-f46c8c4c-960a-4d1f-a5f1-9fa1cac93273 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eff8feae83ae43ba82cc5a58044cb7c3'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:41.263094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-f46c8c4c-960a-4d1f-a5f1-9fa1cac93273 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eff8feae83ae43ba82cc5a58044cb7c3'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:41.310361 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-dbc0c018-3cee-44cd-aa34-bc595975f902 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ae69ca8173e4563b25a17240b09351e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:41.370154 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-f46c8c4c-960a-4d1f-a5f1-9fa1cac93273 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eff8feae83ae43ba82cc5a58044cb7c3'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:41.377137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1143/2304] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:30:40 2022] DELETE /identity/v3/users/eff8feae83ae43ba82cc5a58044cb7c3 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:30:41.455965 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-dbc0c018-3cee-44cd-aa34-bc595975f902 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ae69ca8173e4563b25a17240b09351e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:41.470955 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-dbc0c018-3cee-44cd-aa34-bc595975f902 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ae69ca8173e4563b25a17240b09351e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:41.480567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-dbc0c018-3cee-44cd-aa34-bc595975f902 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ae69ca8173e4563b25a17240b09351e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:41.481311 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-dbc0c018-3cee-44cd-aa34-bc595975f902 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ae69ca8173e4563b25a17240b09351e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:41.492742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1162/2305] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:30:40 2022] DELETE /identity/v3/users/2ae69ca8173e4563b25a17240b09351e => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:30:41.642288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c8c4c-960a-4d1f-a5f1-9fa1cac93273 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:41.643764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f46c8c4c-960a-4d1f-a5f1-9fa1cac93273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:41.863460 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c8c4c-960a-4d1f-a5f1-9fa1cac93273 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:41.970571 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da4d5f-d300-4a8c-a96c-80ddd264fc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:41.972633 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da4d5f-d300-4a8c-a96c-80ddd264fc9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:41.973410 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da4d5f-d300-4a8c-a96c-80ddd264fc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:41.974565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da4d5f-d300-4a8c-a96c-80ddd264fc9f admin admin] PATH_INFO: `/v3/projects/1218192cb1704799b5aab8812e84b334` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:41.977287 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da4d5f-d300-4a8c-a96c-80ddd264fc9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1218192cb1704799b5aab8812e84b334)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:41.980518 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da4d5f-d300-4a8c-a96c-80ddd264fc9f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:42.124290 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0c018-3cee-44cd-aa34-bc595975f902 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:42.126738 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-dbc0c018-3cee-44cd-aa34-bc595975f902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:42.156781 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0c018-3cee-44cd-aa34-bc595975f902 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:42.180612 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-88da4d5f-d300-4a8c-a96c-80ddd264fc9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1218192cb1704799b5aab8812e84b334', 'request_id': 'req-88da4d5f-d300-4a8c-a96c-80ddd264fc9f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:42.199281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-88da4d5f-d300-4a8c-a96c-80ddd264fc9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1218192cb1704799b5aab8812e84b334', 'request_id': 'req-88da4d5f-d300-4a8c-a96c-80ddd264fc9f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:42.230512 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda271d8-f36c-4f19-96a8-f4d6915cd11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:42.231420 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda271d8-f36c-4f19-96a8-f4d6915cd11d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:42.231704 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda271d8-f36c-4f19-96a8-f4d6915cd11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:42.232357 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda271d8-f36c-4f19-96a8-f4d6915cd11d admin admin] PATH_INFO: `/v3/projects/31a2bcdbc3214512b14d255c987a9796` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:42.234099 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda271d8-f36c-4f19-96a8-f4d6915cd11d admin admin] RBAC: Authorizing `identity:delete_project(project_id=31a2bcdbc3214512b14d255c987a9796)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:42.236243 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda271d8-f36c-4f19-96a8-f4d6915cd11d admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:42.295595 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-88da4d5f-d300-4a8c-a96c-80ddd264fc9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1218192cb1704799b5aab8812e84b334', 'request_id': 'req-88da4d5f-d300-4a8c-a96c-80ddd264fc9f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:42.310559 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-88da4d5f-d300-4a8c-a96c-80ddd264fc9f admin admin] The token cache is being invalidate because project 1218192cb1704799b5aab8812e84b334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:30:42.310866 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-88da4d5f-d300-4a8c-a96c-80ddd264fc9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:42.311490 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-88da4d5f-d300-4a8c-a96c-80ddd264fc9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:42.313279 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1144/2306] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:30:41 2022] DELETE /identity/v3/projects/1218192cb1704799b5aab8812e84b334 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:30:42.318708 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadec54d-859e-4f29-a0a6-494ab6d14c03 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:42.319088 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadec54d-859e-4f29-a0a6-494ab6d14c03 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:42.319433 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadec54d-859e-4f29-a0a6-494ab6d14c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:42.341801 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-dadec54d-859e-4f29-a0a6-494ab6d14c03 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:42.343110 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-dadec54d-859e-4f29-a0a6-494ab6d14c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:42.354707 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1145/2307] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:30:42.361931 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9abf1f-5c35-4646-9d9b-71bcb6470c51 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:42.362320 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9abf1f-5c35-4646-9d9b-71bcb6470c51 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:42.362660 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9abf1f-5c35-4646-9d9b-71bcb6470c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:42.383870 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-ad9abf1f-5c35-4646-9d9b-71bcb6470c51 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:42.387433 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ad9abf1f-5c35-4646-9d9b-71bcb6470c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:42.395706 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1146/2308] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:42.403095 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9abf1f-5c35-4646-9d9b-71bcb6470c51 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:42.412936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9abf1f-5c35-4646-9d9b-71bcb6470c51 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:42.417908 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-bda271d8-f36c-4f19-96a8-f4d6915cd11d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31a2bcdbc3214512b14d255c987a9796', 'request_id': 'req-bda271d8-f36c-4f19-96a8-f4d6915cd11d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:42.479123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b746d-33ed-4fe4-97ec-2787ed960264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:42.479904 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b746d-33ed-4fe4-97ec-2787ed960264 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:42.480294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b746d-33ed-4fe4-97ec-2787ed960264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:42.480574 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b746d-33ed-4fe4-97ec-2787ed960264 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:42.481520 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b746d-33ed-4fe4-97ec-2787ed960264 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:42.482010 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b746d-33ed-4fe4-97ec-2787ed960264 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:42.483699 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b746d-33ed-4fe4-97ec-2787ed960264 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:42.486152 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-bda271d8-f36c-4f19-96a8-f4d6915cd11d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31a2bcdbc3214512b14d255c987a9796', 'request_id': 'req-bda271d8-f36c-4f19-96a8-f4d6915cd11d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:42.493182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-bda271d8-f36c-4f19-96a8-f4d6915cd11d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31a2bcdbc3214512b14d255c987a9796', 'request_id': 'req-bda271d8-f36c-4f19-96a8-f4d6915cd11d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:42.500392 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1147/2309] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:30:42.501367 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b746d-33ed-4fe4-97ec-2787ed960264 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:42.506972 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-bda271d8-f36c-4f19-96a8-f4d6915cd11d admin admin] The token cache is being invalidate because project 31a2bcdbc3214512b14d255c987a9796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:30:42.507303 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-bda271d8-f36c-4f19-96a8-f4d6915cd11d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:42.508475 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-bda271d8-f36c-4f19-96a8-f4d6915cd11d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:42.513364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1163/2310] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:30:42 2022] DELETE /identity/v3/projects/31a2bcdbc3214512b14d255c987a9796 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:30:42.513495 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b746d-33ed-4fe4-97ec-2787ed960264 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:42.515051 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ee4b7-a34f-4bc8-a8cb-57f1f84cd607 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:42.515655 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ee4b7-a34f-4bc8-a8cb-57f1f84cd607 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:42.517274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:42.526898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a743f-a7db-40b7-9291-89dea98eb290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:42.527099 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ee4b7-a34f-4bc8-a8cb-57f1f84cd607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:42.527205 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a743f-a7db-40b7-9291-89dea98eb290 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:42.527205 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a743f-a7db-40b7-9291-89dea98eb290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:42.527205 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a743f-a7db-40b7-9291-89dea98eb290 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:42.527205 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a743f-a7db-40b7-9291-89dea98eb290 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:42.527205 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a743f-a7db-40b7-9291-89dea98eb290 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:42.543601 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-7d3ee4b7-a34f-4bc8-a8cb-57f1f84cd607 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:42.544887 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7d3ee4b7-a34f-4bc8-a8cb-57f1f84cd607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:42.547813 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:42.554434 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1164/2311] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:42.562227 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69427fff-6827-4ceb-a38c-548018a82d88 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:42.562531 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69427fff-6827-4ceb-a38c-548018a82d88 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:42.562803 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69427fff-6827-4ceb-a38c-548018a82d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:42.584564 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-69427fff-6827-4ceb-a38c-548018a82d88 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:42.586453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-69427fff-6827-4ceb-a38c-548018a82d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:42.596700 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1165/2312] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:42.601649 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69427fff-6827-4ceb-a38c-548018a82d88 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:42.606987 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1148/2313] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:30:42 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:30:42.611195 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69427fff-6827-4ceb-a38c-548018a82d88 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:42.617037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a743f-a7db-40b7-9291-89dea98eb290 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:42.618901 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-285a743f-a7db-40b7-9291-89dea98eb290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:42.671504 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d677b4-7967-4d9c-9e1d-dbfa5da2051a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:42.672293 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d677b4-7967-4d9c-9e1d-dbfa5da2051a admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:42.672583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d677b4-7967-4d9c-9e1d-dbfa5da2051a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:42.672863 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d677b4-7967-4d9c-9e1d-dbfa5da2051a admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:42.673589 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d677b4-7967-4d9c-9e1d-dbfa5da2051a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:42.673896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d677b4-7967-4d9c-9e1d-dbfa5da2051a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:42.675557 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d677b4-7967-4d9c-9e1d-dbfa5da2051a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:42.688587 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1166/2314] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:30:42.689760 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a743f-a7db-40b7-9291-89dea98eb290 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:42.692864 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d677b4-7967-4d9c-9e1d-dbfa5da2051a admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:42.697011 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cecc9-3e2e-445b-b9c0-8c2b45f61f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:42.697798 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cecc9-3e2e-445b-b9c0-8c2b45f61f2a admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:42.698177 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cecc9-3e2e-445b-b9c0-8c2b45f61f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:42.698528 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cecc9-3e2e-445b-b9c0-8c2b45f61f2a admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:42.699299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579cecc9-3e2e-445b-b9c0-8c2b45f61f2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:42.701539 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579cecc9-3e2e-445b-b9c0-8c2b45f61f2a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:42.707354 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d677b4-7967-4d9c-9e1d-dbfa5da2051a admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:42.713554 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0334f-7193-4f45-913f-c265feefa196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:42.714462 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0334f-7193-4f45-913f-c265feefa196 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:42.715075 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0334f-7193-4f45-913f-c265feefa196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:42.715359 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0334f-7193-4f45-913f-c265feefa196 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:42.716059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0334f-7193-4f45-913f-c265feefa196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:42.718330 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0334f-7193-4f45-913f-c265feefa196 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:42.821995 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1149/2315] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:30:42 2022] POST /identity/v3/users => generated 292 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:30:42.823144 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cecc9-3e2e-445b-b9c0-8c2b45f61f2a admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:42.833292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cecc9-3e2e-445b-b9c0-8c2b45f61f2a admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:42.838467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8efe8-ff10-472c-99ac-579d0b26f76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:42.839186 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8efe8-ff10-472c-99ac-579d0b26f76c admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:42.839764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8efe8-ff10-472c-99ac-579d0b26f76c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:42.840004 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8efe8-ff10-472c-99ac-579d0b26f76c admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:42.840755 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8efe8-ff10-472c-99ac-579d0b26f76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:42.842393 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8efe8-ff10-472c-99ac-579d0b26f76c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:42.848196 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1167/2316] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:30:42 2022] POST /identity/v3/projects => generated 381 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:30:42.853082 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0334f-7193-4f45-913f-c265feefa196 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:42.856340 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1150/2317] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:30:42.858461 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8efe8-ff10-472c-99ac-579d0b26f76c admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:42.870830 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8efe8-ff10-472c-99ac-579d0b26f76c admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:42.938065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0334f-7193-4f45-913f-c265feefa196 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:42.943448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7d576-298e-4262-9941-9d57596ba88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:42.944335 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7d576-298e-4262-9941-9d57596ba88a admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:42.944621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7d576-298e-4262-9941-9d57596ba88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:42.944905 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7d576-298e-4262-9941-9d57596ba88a admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:42.945599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7d576-298e-4262-9941-9d57596ba88a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:42.947559 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7d576-298e-4262-9941-9d57596ba88a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:42.964235 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d83ddb-96f7-436e-ab86-98e016f43076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:42.967049 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d83ddb-96f7-436e-ab86-98e016f43076 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:42.967522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d83ddb-96f7-436e-ab86-98e016f43076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:42.969166 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d83ddb-96f7-436e-ab86-98e016f43076 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:42.970610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d83ddb-96f7-436e-ab86-98e016f43076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:42.973024 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d83ddb-96f7-436e-ab86-98e016f43076 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:42.996448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1151/2318] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:30:43.000505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d83ddb-96f7-436e-ab86-98e016f43076 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:43.014666 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d83ddb-96f7-436e-ab86-98e016f43076 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:43.020625 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c6a07-550e-4d40-9c5f-13c8528436f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:43.022059 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c6a07-550e-4d40-9c5f-13c8528436f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:43.029174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c6a07-550e-4d40-9c5f-13c8528436f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:43.029174 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c6a07-550e-4d40-9c5f-13c8528436f0 admin admin] PATH_INFO: `/v3/projects/4231fee8fd32480a8f9346380cfe4843/users/1d9b6c63c3b249d5be97eb6f2bd928a2/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:43.047825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c6a07-550e-4d40-9c5f-13c8528436f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4231fee8fd32480a8f9346380cfe4843, user_id=1d9b6c63c3b249d5be97eb6f2bd928a2, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:43.059132 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c6a07-550e-4d40-9c5f-13c8528436f0 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:43.086345 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1168/2319] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:30:42 2022] POST /identity/v3/users => generated 291 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:30:43.093311 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7d576-298e-4262-9941-9d57596ba88a admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:43.116014 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7d576-298e-4262-9941-9d57596ba88a admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:43.124730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3abd2-5226-4669-bb36-917a8e0d6172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:43.125363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3abd2-5226-4669-bb36-917a8e0d6172 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:43.125647 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3abd2-5226-4669-bb36-917a8e0d6172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:43.125964 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3abd2-5226-4669-bb36-917a8e0d6172 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:43.126691 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3abd2-5226-4669-bb36-917a8e0d6172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:43.128351 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3abd2-5226-4669-bb36-917a8e0d6172 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:43.139765 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1169/2320] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:30:43.143651 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3abd2-5226-4669-bb36-917a8e0d6172 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:43.154666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3abd2-5226-4669-bb36-917a8e0d6172 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:43.159455 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c169300-857a-4d3a-8188-49688adefd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:43.160100 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c169300-857a-4d3a-8188-49688adefd40 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:43.160385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c169300-857a-4d3a-8188-49688adefd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:43.161283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c169300-857a-4d3a-8188-49688adefd40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:43.162426 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c169300-857a-4d3a-8188-49688adefd40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:43.164035 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c169300-857a-4d3a-8188-49688adefd40 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:43.181811 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1170/2321] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:30:43.185554 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c169300-857a-4d3a-8188-49688adefd40 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:43.192355 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1152/2322] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:30:42 2022] PUT /identity/v3/projects/4231fee8fd32480a8f9346380cfe4843/users/1d9b6c63c3b249d5be97eb6f2bd928a2/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:30:43.211196 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c169300-857a-4d3a-8188-49688adefd40 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:43.213450 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcc46e-5b23-4bd8-b354-92b1bb53be1d None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:43.213895 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcc46e-5b23-4bd8-b354-92b1bb53be1d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:43.214511 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcc46e-5b23-4bd8-b354-92b1bb53be1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:43.234167 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-2ffcc46e-5b23-4bd8-b354-92b1bb53be1d None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:43.240221 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2ffcc46e-5b23-4bd8-b354-92b1bb53be1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:43.313371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2797995-79d2-45c3-8f22-215d37783253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:43.314303 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2797995-79d2-45c3-8f22-215d37783253 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:43.314990 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2797995-79d2-45c3-8f22-215d37783253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:43.314990 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2797995-79d2-45c3-8f22-215d37783253 admin admin] PATH_INFO: `/v3/projects/f3c8ac4c556b4593b24821827132feea/users/e7e9788d9cfb4c4db0cc500905b2d601/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:43.330032 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2797995-79d2-45c3-8f22-215d37783253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3c8ac4c556b4593b24821827132feea, user_id=e7e9788d9cfb4c4db0cc500905b2d601, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:43.333287 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2797995-79d2-45c3-8f22-215d37783253 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:43.348853 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1153/2323] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:43.356692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcc46e-5b23-4bd8-b354-92b1bb53be1d None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:43.358160 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2ffcc46e-5b23-4bd8-b354-92b1bb53be1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:43.425282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcc46e-5b23-4bd8-b354-92b1bb53be1d None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:43.429694 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef901f-7a98-48d8-8752-3201600845cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:43.430385 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef901f-7a98-48d8-8752-3201600845cb service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:43.430671 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef901f-7a98-48d8-8752-3201600845cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:43.430947 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef901f-7a98-48d8-8752-3201600845cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:43.440251 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef901f-7a98-48d8-8752-3201600845cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:43.441679 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef901f-7a98-48d8-8752-3201600845cb service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:43.451904 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1154/2324] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:30:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:30:43.459384 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1171/2325] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:30:43 2022] PUT /identity/v3/projects/f3c8ac4c556b4593b24821827132feea/users/e7e9788d9cfb4c4db0cc500905b2d601/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:30:43.470664 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c26c8-d9b5-471b-83ce-ff33eacc48e8 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:43.471234 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c26c8-d9b5-471b-83ce-ff33eacc48e8 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:43.471234 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c26c8-d9b5-471b-83ce-ff33eacc48e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:43.498381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-b30c26c8-d9b5-471b-83ce-ff33eacc48e8 None None] MFA Rules not processed for user `e7e9788d9cfb4c4db0cc500905b2d601`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:43.499930 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b30c26c8-d9b5-471b-83ce-ff33eacc48e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:43.507842 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:43.567524 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1155/2326] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:43.570658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:43.572114 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2797995-79d2-45c3-8f22-215d37783253 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:43.641700 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2797995-79d2-45c3-8f22-215d37783253 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:43.647572 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d16815-dc1c-40a3-8e3c-3814084c9fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:43.648448 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d16815-dc1c-40a3-8e3c-3814084c9fbc admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:43.648729 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d16815-dc1c-40a3-8e3c-3814084c9fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:43.649022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d16815-dc1c-40a3-8e3c-3814084c9fbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:43.649869 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d16815-dc1c-40a3-8e3c-3814084c9fbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:43.651941 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d16815-dc1c-40a3-8e3c-3814084c9fbc admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:43.752500 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1172/2327] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:30:43 2022] POST /identity/v3/projects => generated 383 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:30:43.753663 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c26c8-d9b5-471b-83ce-ff33eacc48e8 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:43.765303 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c26c8-d9b5-471b-83ce-ff33eacc48e8 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:43.827159 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e55cd-424d-4e6d-b249-fc1534556002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:43.827983 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e55cd-424d-4e6d-b249-fc1534556002 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:43.828274 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e55cd-424d-4e6d-b249-fc1534556002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:43.828550 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e55cd-424d-4e6d-b249-fc1534556002 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:43.829258 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e55cd-424d-4e6d-b249-fc1534556002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:43.831255 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e55cd-424d-4e6d-b249-fc1534556002 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:43.959617 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1156/2328] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:30:43 2022] POST /identity/v3/users => generated 298 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:30:43.964064 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d16815-dc1c-40a3-8e3c-3814084c9fbc admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:43.975161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d16815-dc1c-40a3-8e3c-3814084c9fbc admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:43.979832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c222d-57d9-4943-9175-72c9921aff2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:43.980496 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c222d-57d9-4943-9175-72c9921aff2f admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:43.980783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c222d-57d9-4943-9175-72c9921aff2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:43.982582 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c222d-57d9-4943-9175-72c9921aff2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:43.983368 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c222d-57d9-4943-9175-72c9921aff2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:43.985049 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c222d-57d9-4943-9175-72c9921aff2f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:43.996999 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1173/2329] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:30:44.001214 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e55cd-424d-4e6d-b249-fc1534556002 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:44.015749 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e55cd-424d-4e6d-b249-fc1534556002 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:44.018427 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b830d9-05d6-415e-aae8-0fd89d3db61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:44.019314 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b830d9-05d6-415e-aae8-0fd89d3db61b admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:44.019604 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b830d9-05d6-415e-aae8-0fd89d3db61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:44.019861 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b830d9-05d6-415e-aae8-0fd89d3db61b admin admin] PATH_INFO: `/v3/projects/1b39a13df42241198a717b5721bf70dc/users/7f084d73a31f4574aa0c2c3a855feb2d/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:44.035845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b830d9-05d6-415e-aae8-0fd89d3db61b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b39a13df42241198a717b5721bf70dc, user_id=7f084d73a31f4574aa0c2c3a855feb2d, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:44.038870 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b830d9-05d6-415e-aae8-0fd89d3db61b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:44.155658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1157/2330] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:30:44 2022] PUT /identity/v3/projects/1b39a13df42241198a717b5721bf70dc/users/7f084d73a31f4574aa0c2c3a855feb2d/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:30:44.159743 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c222d-57d9-4943-9175-72c9921aff2f admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:44.170317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c222d-57d9-4943-9175-72c9921aff2f admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:44.202299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:44.215749 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:44.228994 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f1697-e63f-49a7-93ae-df15a97bc6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:44.229837 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f1697-e63f-49a7-93ae-df15a97bc6bb admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:44.230297 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f1697-e63f-49a7-93ae-df15a97bc6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:44.230648 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f1697-e63f-49a7-93ae-df15a97bc6bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:44.231456 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f1697-e63f-49a7-93ae-df15a97bc6bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:44.233354 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f1697-e63f-49a7-93ae-df15a97bc6bb admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:44.244203 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1174/2331] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:30:44.248766 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b830d9-05d6-415e-aae8-0fd89d3db61b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:44.260199 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b830d9-05d6-415e-aae8-0fd89d3db61b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:44.265251 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49685e77-be1b-4be9-bf09-fa5b6ac43bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:44.266159 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49685e77-be1b-4be9-bf09-fa5b6ac43bce admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:44.266444 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49685e77-be1b-4be9-bf09-fa5b6ac43bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:44.266716 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49685e77-be1b-4be9-bf09-fa5b6ac43bce admin admin] PATH_INFO: `/v3/projects/1b39a13df42241198a717b5721bf70dc/users/7f084d73a31f4574aa0c2c3a855feb2d/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:44.269734 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49685e77-be1b-4be9-bf09-fa5b6ac43bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b39a13df42241198a717b5721bf70dc, user_id=7f084d73a31f4574aa0c2c3a855feb2d, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:44.273183 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49685e77-be1b-4be9-bf09-fa5b6ac43bce admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:44.285808 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1158/2332] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:30:44 2022] PUT /identity/v3/projects/1b39a13df42241198a717b5721bf70dc/users/7f084d73a31f4574aa0c2c3a855feb2d/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:30:44.321651 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ea925-c3e7-4294-bd70-d9e300a77766 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:44.322016 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ea925-c3e7-4294-bd70-d9e300a77766 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:44.322468 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ea925-c3e7-4294-bd70-d9e300a77766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:44.361856 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-a47ea925-c3e7-4294-bd70-d9e300a77766 None None] MFA Rules not processed for user `7f084d73a31f4574aa0c2c3a855feb2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:44.363108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a47ea925-c3e7-4294-bd70-d9e300a77766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:44.449518 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1175/2333] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:44.460552 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49685e77-be1b-4be9-bf09-fa5b6ac43bce admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:44.462423 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-49685e77-be1b-4be9-bf09-fa5b6ac43bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:44.561946 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49685e77-be1b-4be9-bf09-fa5b6ac43bce admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:44.565887 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f85515-86fb-4bc0-b525-87b2600127d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:44.566621 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f85515-86fb-4bc0-b525-87b2600127d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:44.566950 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f85515-86fb-4bc0-b525-87b2600127d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:44.567228 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f85515-86fb-4bc0-b525-87b2600127d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:44.577271 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f85515-86fb-4bc0-b525-87b2600127d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:44.578920 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f85515-86fb-4bc0-b525-87b2600127d3 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:44.589896 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1159/2334] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:30:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:30:44.675932 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:44.721871 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ea925-c3e7-4294-bd70-d9e300a77766 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:44.737936 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ea925-c3e7-4294-bd70-d9e300a77766 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:44.744139 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d0fcd-da83-4876-97a5-a2c3d2483e43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:44.745534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d0fcd-da83-4876-97a5-a2c3d2483e43 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:44.746518 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d0fcd-da83-4876-97a5-a2c3d2483e43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:44.747020 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d0fcd-da83-4876-97a5-a2c3d2483e43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:44.821669 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d0fcd-da83-4876-97a5-a2c3d2483e43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:44.824911 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d0fcd-da83-4876-97a5-a2c3d2483e43 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:44.839155 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1176/2335] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:30:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:30:45.103213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789342ec-f70b-40e1-afa6-058a3d4430a9 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:45.103728 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789342ec-f70b-40e1-afa6-058a3d4430a9 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:45.103811 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789342ec-f70b-40e1-afa6-058a3d4430a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:45.155240 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-789342ec-f70b-40e1-afa6-058a3d4430a9 None None] MFA Rules not processed for user `1d9b6c63c3b249d5be97eb6f2bd928a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:45.156581 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-789342ec-f70b-40e1-afa6-058a3d4430a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:45.255151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1160/2336] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:45.263096 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d0fcd-da83-4876-97a5-a2c3d2483e43 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:45.264650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-496d0fcd-da83-4876-97a5-a2c3d2483e43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:45.277493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d0fcd-da83-4876-97a5-a2c3d2483e43 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:45.281654 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d0a2a-378c-4197-8ae8-7b783841dacb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:45.282383 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d0a2a-378c-4197-8ae8-7b783841dacb service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:45.282671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d0a2a-378c-4197-8ae8-7b783841dacb service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:45.282950 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d0a2a-378c-4197-8ae8-7b783841dacb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:45.294504 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d0a2a-378c-4197-8ae8-7b783841dacb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:45.295979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d0a2a-378c-4197-8ae8-7b783841dacb service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:45.308508 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1177/2337] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:30:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:30:47.098735 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff1e52-995f-442f-ac15-d0c68ab935c8 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:47.099328 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff1e52-995f-442f-ac15-d0c68ab935c8 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:47.099328 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff1e52-995f-442f-ac15-d0c68ab935c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:47.122538 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-71ff1e52-995f-442f-ac15-d0c68ab935c8 None None] MFA Rules not processed for user `1d9b6c63c3b249d5be97eb6f2bd928a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:47.124034 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-71ff1e52-995f-442f-ac15-d0c68ab935c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:47.133957 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1161/2338] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:49.147725 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d0a2a-378c-4197-8ae8-7b783841dacb service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:49.200223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:49.211663 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d0a2a-378c-4197-8ae8-7b783841dacb service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:49.216169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322be30-a65e-4219-b958-4546f3fe87df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:49.217026 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322be30-a65e-4219-b958-4546f3fe87df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:49.217310 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322be30-a65e-4219-b958-4546f3fe87df admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:49.217588 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322be30-a65e-4219-b958-4546f3fe87df admin admin] PATH_INFO: `/v3/users/e7e9788d9cfb4c4db0cc500905b2d601` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:49.218895 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f322be30-a65e-4219-b958-4546f3fe87df admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7e9788d9cfb4c4db0cc500905b2d601)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:49.220903 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f322be30-a65e-4219-b958-4546f3fe87df admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:49.439445 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f322be30-a65e-4219-b958-4546f3fe87df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7e9788d9cfb4c4db0cc500905b2d601'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:49.529157 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f322be30-a65e-4219-b958-4546f3fe87df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7e9788d9cfb4c4db0cc500905b2d601'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:49.541895 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f322be30-a65e-4219-b958-4546f3fe87df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7e9788d9cfb4c4db0cc500905b2d601'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:49.548667 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f322be30-a65e-4219-b958-4546f3fe87df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7e9788d9cfb4c4db0cc500905b2d601'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:49.549308 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f322be30-a65e-4219-b958-4546f3fe87df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7e9788d9cfb4c4db0cc500905b2d601'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:49.556006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1178/2339] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:30:49 2022] DELETE /identity/v3/users/e7e9788d9cfb4c4db0cc500905b2d601 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:30:49.560443 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd73db6-a580-480a-a50e-1a3b781f10f9 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:49.560898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd73db6-a580-480a-a50e-1a3b781f10f9 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:49.561131 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd73db6-a580-480a-a50e-1a3b781f10f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:49.579077 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-3bd73db6-a580-480a-a50e-1a3b781f10f9 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:49.580728 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3bd73db6-a580-480a-a50e-1a3b781f10f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:49.639989 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1162/2340] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:49.649742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322be30-a65e-4219-b958-4546f3fe87df admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:49.651220 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f322be30-a65e-4219-b958-4546f3fe87df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:49.708146 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322be30-a65e-4219-b958-4546f3fe87df admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:49.711736 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b0b4f-6ffb-4dc4-af27-3ae643c4abed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:49.712381 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b0b4f-6ffb-4dc4-af27-3ae643c4abed service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:49.712666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b0b4f-6ffb-4dc4-af27-3ae643c4abed service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:49.712950 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b0b4f-6ffb-4dc4-af27-3ae643c4abed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:49.722218 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b0b4f-6ffb-4dc4-af27-3ae643c4abed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:49.724078 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b0b4f-6ffb-4dc4-af27-3ae643c4abed service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:49.733695 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1179/2341] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:30:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:30:50.348016 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd73db6-a580-480a-a50e-1a3b781f10f9 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:50.350083 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3bd73db6-a580-480a-a50e-1a3b781f10f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:50.362935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd73db6-a580-480a-a50e-1a3b781f10f9 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:50.368538 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7b2fe-8ea4-4202-844f-f4fd4315c54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:50.369422 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7b2fe-8ea4-4202-844f-f4fd4315c54d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:50.369699 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7b2fe-8ea4-4202-844f-f4fd4315c54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:50.369969 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7b2fe-8ea4-4202-844f-f4fd4315c54d admin admin] PATH_INFO: `/v3/projects/f3c8ac4c556b4593b24821827132feea` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:50.372306 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7b2fe-8ea4-4202-844f-f4fd4315c54d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3c8ac4c556b4593b24821827132feea)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:50.375008 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7b2fe-8ea4-4202-844f-f4fd4315c54d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:50.518749 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c6a7b2fe-8ea4-4202-844f-f4fd4315c54d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3c8ac4c556b4593b24821827132feea', 'request_id': 'req-c6a7b2fe-8ea4-4202-844f-f4fd4315c54d'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:50.524956 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c6a7b2fe-8ea4-4202-844f-f4fd4315c54d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3c8ac4c556b4593b24821827132feea', 'request_id': 'req-c6a7b2fe-8ea4-4202-844f-f4fd4315c54d'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:50.527452 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:50.606087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c6a7b2fe-8ea4-4202-844f-f4fd4315c54d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3c8ac4c556b4593b24821827132feea', 'request_id': 'req-c6a7b2fe-8ea4-4202-844f-f4fd4315c54d'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:50.617544 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c6a7b2fe-8ea4-4202-844f-f4fd4315c54d admin admin] The token cache is being invalidate because project f3c8ac4c556b4593b24821827132feea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:30:50.617827 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c6a7b2fe-8ea4-4202-844f-f4fd4315c54d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:50.622204 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-c6a7b2fe-8ea4-4202-844f-f4fd4315c54d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:50.622204 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1163/2342] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:30:50 2022] DELETE /identity/v3/projects/f3c8ac4c556b4593b24821827132feea => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:30:50.624232 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b0b4f-6ffb-4dc4-af27-3ae643c4abed service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:50.634424 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b0b4f-6ffb-4dc4-af27-3ae643c4abed service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:50.697838 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f016a-2412-4dca-afec-a254e48571ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:50.698740 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f016a-2412-4dca-afec-a254e48571ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:50.699025 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f016a-2412-4dca-afec-a254e48571ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:50.699301 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f016a-2412-4dca-afec-a254e48571ed admin admin] PATH_INFO: `/v3/users/7f084d73a31f4574aa0c2c3a855feb2d` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:50.700544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f016a-2412-4dca-afec-a254e48571ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f084d73a31f4574aa0c2c3a855feb2d)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:50.702512 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f016a-2412-4dca-afec-a254e48571ed admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:50.718900 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:51.021017 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d86f016a-2412-4dca-afec-a254e48571ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f084d73a31f4574aa0c2c3a855feb2d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:51.088953 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d86f016a-2412-4dca-afec-a254e48571ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f084d73a31f4574aa0c2c3a855feb2d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:51.103496 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d86f016a-2412-4dca-afec-a254e48571ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f084d73a31f4574aa0c2c3a855feb2d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:51.110511 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d86f016a-2412-4dca-afec-a254e48571ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f084d73a31f4574aa0c2c3a855feb2d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:51.111229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d86f016a-2412-4dca-afec-a254e48571ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f084d73a31f4574aa0c2c3a855feb2d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:51.117720 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1180/2343] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:30:50 2022] DELETE /identity/v3/users/7f084d73a31f4574aa0c2c3a855feb2d => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:30:51.705076 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7b2fe-8ea4-4202-844f-f4fd4315c54d admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:51.707938 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c6a7b2fe-8ea4-4202-844f-f4fd4315c54d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:51.726260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7b2fe-8ea4-4202-844f-f4fd4315c54d admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:51.796359 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebeda6-0470-4820-b2b1-611b077ce609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:51.797233 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebeda6-0470-4820-b2b1-611b077ce609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:51.797518 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebeda6-0470-4820-b2b1-611b077ce609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:51.797795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebeda6-0470-4820-b2b1-611b077ce609 admin admin] PATH_INFO: `/v3/projects/1b39a13df42241198a717b5721bf70dc` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:51.799127 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebeda6-0470-4820-b2b1-611b077ce609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b39a13df42241198a717b5721bf70dc)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:51.801035 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebeda6-0470-4820-b2b1-611b077ce609 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:51.982438 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-96ebeda6-0470-4820-b2b1-611b077ce609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b39a13df42241198a717b5721bf70dc', 'request_id': 'req-96ebeda6-0470-4820-b2b1-611b077ce609'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:51.987989 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-96ebeda6-0470-4820-b2b1-611b077ce609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b39a13df42241198a717b5721bf70dc', 'request_id': 'req-96ebeda6-0470-4820-b2b1-611b077ce609'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:52.077091 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-96ebeda6-0470-4820-b2b1-611b077ce609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b39a13df42241198a717b5721bf70dc', 'request_id': 'req-96ebeda6-0470-4820-b2b1-611b077ce609'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:52.089793 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-96ebeda6-0470-4820-b2b1-611b077ce609 admin admin] The token cache is being invalidate because project 1b39a13df42241198a717b5721bf70dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:30:52.090256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-96ebeda6-0470-4820-b2b1-611b077ce609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:52.090964 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-96ebeda6-0470-4820-b2b1-611b077ce609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:52.092871 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1164/2344] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:30:51 2022] DELETE /identity/v3/projects/1b39a13df42241198a717b5721bf70dc => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:30:52.097491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f475b5-b5a3-4bfe-9e9b-6079154abf4f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:52.097932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f475b5-b5a3-4bfe-9e9b-6079154abf4f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:52.098061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f475b5-b5a3-4bfe-9e9b-6079154abf4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:52.118370 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-d4f475b5-b5a3-4bfe-9e9b-6079154abf4f None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:52.119606 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d4f475b5-b5a3-4bfe-9e9b-6079154abf4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:52.226216 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1181/2345] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:52.229293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485aa378-67ef-4a28-8496-d18d6f276893 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:52.229585 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485aa378-67ef-4a28-8496-d18d6f276893 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:52.229887 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485aa378-67ef-4a28-8496-d18d6f276893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:52.248858 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-485aa378-67ef-4a28-8496-d18d6f276893 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:52.256522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-485aa378-67ef-4a28-8496-d18d6f276893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:52.259775 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1165/2346] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:52.263856 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f475b5-b5a3-4bfe-9e9b-6079154abf4f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:52.275780 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f475b5-b5a3-4bfe-9e9b-6079154abf4f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:52.282438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d53cd-4b58-44c6-bc36-2310e5ba8994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:52.283119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d53cd-4b58-44c6-bc36-2310e5ba8994 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:52.283401 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d53cd-4b58-44c6-bc36-2310e5ba8994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:52.283676 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d53cd-4b58-44c6-bc36-2310e5ba8994 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:52.284869 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d53cd-4b58-44c6-bc36-2310e5ba8994 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:52.285229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d53cd-4b58-44c6-bc36-2310e5ba8994 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:52.287677 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d53cd-4b58-44c6-bc36-2310e5ba8994 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:52.312078 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1182/2347] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:30:52.322729 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485aa378-67ef-4a28-8496-d18d6f276893 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:52.332863 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485aa378-67ef-4a28-8496-d18d6f276893 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:52.339291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b65bc-0aa5-442c-84cd-590b7b89747d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:52.339987 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b65bc-0aa5-442c-84cd-590b7b89747d admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:52.340297 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b65bc-0aa5-442c-84cd-590b7b89747d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:52.340580 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b65bc-0aa5-442c-84cd-590b7b89747d admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:52.341340 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b65bc-0aa5-442c-84cd-590b7b89747d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:52.343327 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b65bc-0aa5-442c-84cd-590b7b89747d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:52.486500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1166/2348] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:30:52 2022] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:30:52.487643 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d53cd-4b58-44c6-bc36-2310e5ba8994 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:52.499756 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d53cd-4b58-44c6-bc36-2310e5ba8994 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:52.571452 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e6c64-6ae2-401d-bdf6-6e69d649a998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:52.572138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e6c64-6ae2-401d-bdf6-6e69d649a998 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:52.572427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e6c64-6ae2-401d-bdf6-6e69d649a998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:52.572709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e6c64-6ae2-401d-bdf6-6e69d649a998 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:52.573453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e6c64-6ae2-401d-bdf6-6e69d649a998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:52.575458 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e6c64-6ae2-401d-bdf6-6e69d649a998 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:52.687515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1183/2349] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:30:52 2022] POST /identity/v3/users => generated 294 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:30:52.688821 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b65bc-0aa5-442c-84cd-590b7b89747d admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:52.700073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b65bc-0aa5-442c-84cd-590b7b89747d admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:52.704833 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea911d95-04a7-4292-8f76-8863b4575aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:52.705602 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea911d95-04a7-4292-8f76-8863b4575aaa admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:52.706231 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea911d95-04a7-4292-8f76-8863b4575aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:52.706231 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea911d95-04a7-4292-8f76-8863b4575aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:52.707082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea911d95-04a7-4292-8f76-8863b4575aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:52.708767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea911d95-04a7-4292-8f76-8863b4575aaa admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:52.723657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1167/2350] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:30:52.726814 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e6c64-6ae2-401d-bdf6-6e69d649a998 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:52.736677 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e6c64-6ae2-401d-bdf6-6e69d649a998 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:52.741460 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4f1ed-aa30-4caa-8b22-949519d35a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:52.743466 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4f1ed-aa30-4caa-8b22-949519d35a24 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:52.743466 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4f1ed-aa30-4caa-8b22-949519d35a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:52.743466 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4f1ed-aa30-4caa-8b22-949519d35a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:52.743744 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4f1ed-aa30-4caa-8b22-949519d35a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:52.745109 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4f1ed-aa30-4caa-8b22-949519d35a24 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:52.751294 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:52.757412 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1184/2351] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:30:52.761326 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea911d95-04a7-4292-8f76-8863b4575aaa admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:52.777845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea911d95-04a7-4292-8f76-8863b4575aaa admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:52.782575 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e5adb-9049-4e26-a832-6b1980697cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:52.783456 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e5adb-9049-4e26-a832-6b1980697cb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:52.783736 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e5adb-9049-4e26-a832-6b1980697cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:52.784010 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e5adb-9049-4e26-a832-6b1980697cb8 admin admin] PATH_INFO: `/v3/projects/8975f2fd842b414e8bc14cc4a4ac607f/users/82986bab8c444ba9b7b86179671b015d/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:52.799293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e5adb-9049-4e26-a832-6b1980697cb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8975f2fd842b414e8bc14cc4a4ac607f, user_id=82986bab8c444ba9b7b86179671b015d, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:52.801946 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e5adb-9049-4e26-a832-6b1980697cb8 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:52.948692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1168/2352] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:30:52 2022] PUT /identity/v3/projects/8975f2fd842b414e8bc14cc4a4ac607f/users/82986bab8c444ba9b7b86179671b015d/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:30:52.960767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d96ea-1af4-4885-9776-faf93959e9d6 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:52.961063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d96ea-1af4-4885-9776-faf93959e9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:52.961336 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d96ea-1af4-4885-9776-faf93959e9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:52.989592 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-622d96ea-1af4-4885-9776-faf93959e9d6 None None] MFA Rules not processed for user `82986bab8c444ba9b7b86179671b015d`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:52.990960 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-622d96ea-1af4-4885-9776-faf93959e9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:53.057976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1185/2353] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:53.062465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e5adb-9049-4e26-a832-6b1980697cb8 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:53.081170 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:53.129434 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e5adb-9049-4e26-a832-6b1980697cb8 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:53.134963 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f2c1b-046d-45b1-b8cd-f6ac03bac3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:53.135652 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f2c1b-046d-45b1-b8cd-f6ac03bac3b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:53.135936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f2c1b-046d-45b1-b8cd-f6ac03bac3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:53.136214 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f2c1b-046d-45b1-b8cd-f6ac03bac3b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:53.136937 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f2c1b-046d-45b1-b8cd-f6ac03bac3b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:53.138876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f2c1b-046d-45b1-b8cd-f6ac03bac3b1 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:53.227851 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1169/2354] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:30:53 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:30:53.229108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d96ea-1af4-4885-9776-faf93959e9d6 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:53.240648 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d96ea-1af4-4885-9776-faf93959e9d6 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:53.297626 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfa4aa-2865-4a44-9a13-cdeaae59db11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:53.298334 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfa4aa-2865-4a44-9a13-cdeaae59db11 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:53.298622 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfa4aa-2865-4a44-9a13-cdeaae59db11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:53.298905 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfa4aa-2865-4a44-9a13-cdeaae59db11 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:53.299618 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadfa4aa-2865-4a44-9a13-cdeaae59db11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:53.301545 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadfa4aa-2865-4a44-9a13-cdeaae59db11 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:53.433669 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1186/2355] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:30:53 2022] POST /identity/v3/users => generated 300 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:30:53.437549 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f2c1b-046d-45b1-b8cd-f6ac03bac3b1 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:53.449567 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f2c1b-046d-45b1-b8cd-f6ac03bac3b1 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:53.455896 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21923bf6-d9bd-4673-ba34-3326d492583a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:53.456762 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21923bf6-d9bd-4673-ba34-3326d492583a admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:53.482889 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21923bf6-d9bd-4673-ba34-3326d492583a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:53.482889 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21923bf6-d9bd-4673-ba34-3326d492583a admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:53.482889 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21923bf6-d9bd-4673-ba34-3326d492583a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:53.482889 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21923bf6-d9bd-4673-ba34-3326d492583a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:53.482889 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1170/2356] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:30:53.489642 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfa4aa-2865-4a44-9a13-cdeaae59db11 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:53.503389 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfa4aa-2865-4a44-9a13-cdeaae59db11 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:53.510394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b536d0b-3807-4ee6-b701-b3af5bcebf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:53.511282 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b536d0b-3807-4ee6-b701-b3af5bcebf3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:53.511563 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b536d0b-3807-4ee6-b701-b3af5bcebf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:53.517661 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b536d0b-3807-4ee6-b701-b3af5bcebf3d admin admin] PATH_INFO: `/v3/projects/3bbcaf162f0c4ac4b8d63ef7ac76a52e/users/c085b0d881304b6786b6ad6ab7e21ba8/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:53.530725 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b536d0b-3807-4ee6-b701-b3af5bcebf3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bbcaf162f0c4ac4b8d63ef7ac76a52e, user_id=c085b0d881304b6786b6ad6ab7e21ba8, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:53.533732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b536d0b-3807-4ee6-b701-b3af5bcebf3d admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:53.629132 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9be42-f7d5-4a90-ac06-ff2039fc8e5b None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:53.629421 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9be42-f7d5-4a90-ac06-ff2039fc8e5b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:53.629702 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9be42-f7d5-4a90-ac06-ff2039fc8e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:53.655824 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-90b9be42-f7d5-4a90-ac06-ff2039fc8e5b None None] MFA Rules not processed for user `063ce3b820a74d648d709ab6ac4d7be2`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:53.657096 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-90b9be42-f7d5-4a90-ac06-ff2039fc8e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:53.689233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1187/2357] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:30:53 2022] PUT /identity/v3/projects/3bbcaf162f0c4ac4b8d63ef7ac76a52e/users/c085b0d881304b6786b6ad6ab7e21ba8/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:30:53.693183 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b536d0b-3807-4ee6-b701-b3af5bcebf3d admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:53.715020 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1171/2358] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Jul 5 21:30:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:30:53.729214 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9be42-f7d5-4a90-ac06-ff2039fc8e5b None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:53.730694 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-90b9be42-f7d5-4a90-ac06-ff2039fc8e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:53.755198 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:53.760589 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b536d0b-3807-4ee6-b701-b3af5bcebf3d admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:53.765486 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07509f30-44b9-4362-a3bf-0ee1eaa56499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:53.766274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07509f30-44b9-4362-a3bf-0ee1eaa56499 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:53.766657 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07509f30-44b9-4362-a3bf-0ee1eaa56499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:53.767065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07509f30-44b9-4362-a3bf-0ee1eaa56499 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:53.767760 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07509f30-44b9-4362-a3bf-0ee1eaa56499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:53.769365 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07509f30-44b9-4362-a3bf-0ee1eaa56499 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:53.782161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1188/2359] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:30:53.784242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07509f30-44b9-4362-a3bf-0ee1eaa56499 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:53.796902 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07509f30-44b9-4362-a3bf-0ee1eaa56499 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:53.800664 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48a8cb-d4e6-493f-bfc5-caa22ad54156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:53.801577 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48a8cb-d4e6-493f-bfc5-caa22ad54156 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:53.801865 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48a8cb-d4e6-493f-bfc5-caa22ad54156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:53.803339 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48a8cb-d4e6-493f-bfc5-caa22ad54156 admin admin] PATH_INFO: `/v3/projects/3bbcaf162f0c4ac4b8d63ef7ac76a52e/users/c085b0d881304b6786b6ad6ab7e21ba8/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:53.805481 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48a8cb-d4e6-493f-bfc5-caa22ad54156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bbcaf162f0c4ac4b8d63ef7ac76a52e, user_id=c085b0d881304b6786b6ad6ab7e21ba8, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:53.809642 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48a8cb-d4e6-493f-bfc5-caa22ad54156 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:53.816446 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9be42-f7d5-4a90-ac06-ff2039fc8e5b None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:53.822495 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1189/2360] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:30:53 2022] PUT /identity/v3/projects/3bbcaf162f0c4ac4b8d63ef7ac76a52e/users/c085b0d881304b6786b6ad6ab7e21ba8/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:30:53.832552 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bc756-1ac6-4652-bac3-13f89f1396dd None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:53.833187 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bc756-1ac6-4652-bac3-13f89f1396dd None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:53.833658 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bc756-1ac6-4652-bac3-13f89f1396dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:53.868946 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b15bc756-1ac6-4652-bac3-13f89f1396dd None None] MFA Rules not processed for user `c085b0d881304b6786b6ad6ab7e21ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:53.870190 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b15bc756-1ac6-4652-bac3-13f89f1396dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:53.872437 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:53.903239 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fe018-11cd-4493-a33c-33f89b5561b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '441be62a077444b9b9f78714e24a760a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:53.903899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fe018-11cd-4493-a33c-33f89b5561b2 service swift] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:53.904311 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fe018-11cd-4493-a33c-33f89b5561b2 service swift] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:53.904585 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fe018-11cd-4493-a33c-33f89b5561b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:53.947720 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1190/2361] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:30:53.958365 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bc756-1ac6-4652-bac3-13f89f1396dd None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:53.960592 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b15bc756-1ac6-4652-bac3-13f89f1396dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:53.968184 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622fe018-11cd-4493-a33c-33f89b5561b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:53.971814 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622fe018-11cd-4493-a33c-33f89b5561b2 service swift] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:53.982107 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1172/2362] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Jul 5 21:30:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 21:30:54.028157 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bc756-1ac6-4652-bac3-13f89f1396dd None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:54.032065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3c22e-21cc-4b6f-9c6c-9f0fdf26df01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:54.032714 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3c22e-21cc-4b6f-9c6c-9f0fdf26df01 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:54.033004 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3c22e-21cc-4b6f-9c6c-9f0fdf26df01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:54.033283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3c22e-21cc-4b6f-9c6c-9f0fdf26df01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:54.042674 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3c22e-21cc-4b6f-9c6c-9f0fdf26df01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:54.044123 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3c22e-21cc-4b6f-9c6c-9f0fdf26df01 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:54.054781 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1191/2363] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:30:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:30:54.196853 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fe018-11cd-4493-a33c-33f89b5561b2 service swift] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:54.269022 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fe018-11cd-4493-a33c-33f89b5561b2 service swift] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:54.274035 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c7acf-1ad7-4a97-a171-b19ec93fece1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:54.275137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c7acf-1ad7-4a97-a171-b19ec93fece1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:54.275519 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c7acf-1ad7-4a97-a171-b19ec93fece1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:54.275869 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c7acf-1ad7-4a97-a171-b19ec93fece1 admin admin] PATH_INFO: `/v3/users/82986bab8c444ba9b7b86179671b015d` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:54.277165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c7acf-1ad7-4a97-a171-b19ec93fece1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82986bab8c444ba9b7b86179671b015d)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:54.279312 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c7acf-1ad7-4a97-a171-b19ec93fece1 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:54.503797 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e30c7acf-1ad7-4a97-a171-b19ec93fece1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82986bab8c444ba9b7b86179671b015d'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:54.511789 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e30c7acf-1ad7-4a97-a171-b19ec93fece1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82986bab8c444ba9b7b86179671b015d'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:54.524939 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e30c7acf-1ad7-4a97-a171-b19ec93fece1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82986bab8c444ba9b7b86179671b015d'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:54.525663 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e30c7acf-1ad7-4a97-a171-b19ec93fece1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82986bab8c444ba9b7b86179671b015d'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:54.625438 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e30c7acf-1ad7-4a97-a171-b19ec93fece1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82986bab8c444ba9b7b86179671b015d'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:54.630565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:54.636739 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1173/2364] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:30:54 2022] DELETE /identity/v3/users/82986bab8c444ba9b7b86179671b015d => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:30:54.641272 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be73c9-d1f8-40a3-95ac-d6089678d258 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:54.641786 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be73c9-d1f8-40a3-95ac-d6089678d258 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:54.641786 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be73c9-d1f8-40a3-95ac-d6089678d258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:54.660785 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-17be73c9-d1f8-40a3-95ac-d6089678d258 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:54.662060 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-17be73c9-d1f8-40a3-95ac-d6089678d258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:54.749016 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1192/2365] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:54.759378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c7acf-1ad7-4a97-a171-b19ec93fece1 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:54.760905 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e30c7acf-1ad7-4a97-a171-b19ec93fece1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:54.834086 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c7acf-1ad7-4a97-a171-b19ec93fece1 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:54.838756 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7196dd5-3092-4b39-8389-96cc3fc0c91d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:54.839500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7196dd5-3092-4b39-8389-96cc3fc0c91d service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:54.839853 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7196dd5-3092-4b39-8389-96cc3fc0c91d service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:54.840240 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7196dd5-3092-4b39-8389-96cc3fc0c91d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:54.852178 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7196dd5-3092-4b39-8389-96cc3fc0c91d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:54.852178 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7196dd5-3092-4b39-8389-96cc3fc0c91d service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:54.861777 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1174/2366] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:30:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:30:55.090398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec9f87-413a-4203-acda-653cc4c57c97 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:55.090694 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec9f87-413a-4203-acda-653cc4c57c97 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:55.090974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec9f87-413a-4203-acda-653cc4c57c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:55.104574 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:55.111016 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-00ec9f87-413a-4203-acda-653cc4c57c97 None None] MFA Rules not processed for user `063ce3b820a74d648d709ab6ac4d7be2`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:55.112098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-00ec9f87-413a-4203-acda-653cc4c57c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:55.178802 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1193/2367] 10.222.0.13 () {58 vars in 967 bytes} [Tue Jul 5 21:30:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:55.194665 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7196dd5-3092-4b39-8389-96cc3fc0c91d service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:55.196192 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a7196dd5-3092-4b39-8389-96cc3fc0c91d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:55.270078 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7196dd5-3092-4b39-8389-96cc3fc0c91d service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:55.275810 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fb91a-ce13-4b07-bd08-6e768b33c4bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '441be62a077444b9b9f78714e24a760a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:55.276448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fb91a-ce13-4b07-bd08-6e768b33c4bc service swift] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:55.276728 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fb91a-ce13-4b07-bd08-6e768b33c4bc service swift] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:55.277003 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fb91a-ce13-4b07-bd08-6e768b33c4bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:55.285022 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fb91a-ce13-4b07-bd08-6e768b33c4bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:55.287296 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fb91a-ce13-4b07-bd08-6e768b33c4bc service swift] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:55.294978 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1175/2368] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Jul 5 21:30:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 21:30:55.358548 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec9f87-413a-4203-acda-653cc4c57c97 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:55.359990 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-00ec9f87-413a-4203-acda-653cc4c57c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:55.377941 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec9f87-413a-4203-acda-653cc4c57c97 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:55.383641 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d1aad-bcb1-48a1-8e1a-8fbcdba03794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:55.384590 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d1aad-bcb1-48a1-8e1a-8fbcdba03794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:55.384897 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d1aad-bcb1-48a1-8e1a-8fbcdba03794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:55.385145 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d1aad-bcb1-48a1-8e1a-8fbcdba03794 admin admin] PATH_INFO: `/v3/projects/8975f2fd842b414e8bc14cc4a4ac607f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:55.386454 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d1aad-bcb1-48a1-8e1a-8fbcdba03794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8975f2fd842b414e8bc14cc4a4ac607f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:55.388408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d1aad-bcb1-48a1-8e1a-8fbcdba03794 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:55.552763 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0a2d1aad-bcb1-48a1-8e1a-8fbcdba03794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8975f2fd842b414e8bc14cc4a4ac607f', 'request_id': 'req-0a2d1aad-bcb1-48a1-8e1a-8fbcdba03794'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:55.651869 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0a2d1aad-bcb1-48a1-8e1a-8fbcdba03794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8975f2fd842b414e8bc14cc4a4ac607f', 'request_id': 'req-0a2d1aad-bcb1-48a1-8e1a-8fbcdba03794'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:55.658016 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0a2d1aad-bcb1-48a1-8e1a-8fbcdba03794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8975f2fd842b414e8bc14cc4a4ac607f', 'request_id': 'req-0a2d1aad-bcb1-48a1-8e1a-8fbcdba03794'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:55.670105 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0a2d1aad-bcb1-48a1-8e1a-8fbcdba03794 admin admin] The token cache is being invalidate because project 8975f2fd842b414e8bc14cc4a4ac607f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:30:55.670447 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0a2d1aad-bcb1-48a1-8e1a-8fbcdba03794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:55.671108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0a2d1aad-bcb1-48a1-8e1a-8fbcdba03794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:55.672671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1194/2369] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:30:55 2022] DELETE /identity/v3/projects/8975f2fd842b414e8bc14cc4a4ac607f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:30:55.677182 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fb91a-ce13-4b07-bd08-6e768b33c4bc service swift] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:55.688028 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fb91a-ce13-4b07-bd08-6e768b33c4bc service swift] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:55.745896 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66bf16-6db1-42e3-aec9-d3e11aa3f67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:55.746803 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66bf16-6db1-42e3-aec9-d3e11aa3f67b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:55.747127 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66bf16-6db1-42e3-aec9-d3e11aa3f67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:55.747406 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66bf16-6db1-42e3-aec9-d3e11aa3f67b admin admin] PATH_INFO: `/v3/users/c085b0d881304b6786b6ad6ab7e21ba8` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:55.748835 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e66bf16-6db1-42e3-aec9-d3e11aa3f67b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c085b0d881304b6786b6ad6ab7e21ba8)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:55.750966 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e66bf16-6db1-42e3-aec9-d3e11aa3f67b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:55.999082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:56.020796 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4f025-5676-4fbb-ba12-283dc87d82e8 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:56.021175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4f025-5676-4fbb-ba12-283dc87d82e8 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:56.022017 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4f025-5676-4fbb-ba12-283dc87d82e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:56.025631 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8e66bf16-6db1-42e3-aec9-d3e11aa3f67b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c085b0d881304b6786b6ad6ab7e21ba8'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:56.032256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8e66bf16-6db1-42e3-aec9-d3e11aa3f67b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c085b0d881304b6786b6ad6ab7e21ba8'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:56.045160 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e2a4f025-5676-4fbb-ba12-283dc87d82e8 None None] MFA Rules not processed for user `063ce3b820a74d648d709ab6ac4d7be2`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:56.045319 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8e66bf16-6db1-42e3-aec9-d3e11aa3f67b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c085b0d881304b6786b6ad6ab7e21ba8'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:56.046010 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8e66bf16-6db1-42e3-aec9-d3e11aa3f67b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c085b0d881304b6786b6ad6ab7e21ba8'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:56.046475 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e2a4f025-5676-4fbb-ba12-283dc87d82e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:56.102433 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1195/2370] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Jul 5 21:30:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:30:56.114854 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4f025-5676-4fbb-ba12-283dc87d82e8 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:56.116351 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e2a4f025-5676-4fbb-ba12-283dc87d82e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:56.125757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8e66bf16-6db1-42e3-aec9-d3e11aa3f67b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c085b0d881304b6786b6ad6ab7e21ba8'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:56.133550 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1176/2371] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:30:55 2022] DELETE /identity/v3/users/c085b0d881304b6786b6ad6ab7e21ba8 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:30:56.163419 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:56.191818 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4f025-5676-4fbb-ba12-283dc87d82e8 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:56.254062 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3afba-b6bc-4532-90a0-fb91e4933bf7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '441be62a077444b9b9f78714e24a760a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:56.254741 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3afba-b6bc-4532-90a0-fb91e4933bf7 service swift] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:56.255027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3afba-b6bc-4532-90a0-fb91e4933bf7 service swift] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:56.255303 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3afba-b6bc-4532-90a0-fb91e4933bf7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:56.257911 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e9d3afba-b6bc-4532-90a0-fb91e4933bf7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:56.314883 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d3afba-b6bc-4532-90a0-fb91e4933bf7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:56.316683 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d3afba-b6bc-4532-90a0-fb91e4933bf7 service swift] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:56.325695 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1196/2372] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Jul 5 21:30:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 21:30:56.633700 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66bf16-6db1-42e3-aec9-d3e11aa3f67b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:56.635221 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8e66bf16-6db1-42e3-aec9-d3e11aa3f67b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:56.704292 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66bf16-6db1-42e3-aec9-d3e11aa3f67b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:56.709590 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac54db-e0f4-4e29-8415-897c1b1fd281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:56.710474 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac54db-e0f4-4e29-8415-897c1b1fd281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:56.710757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac54db-e0f4-4e29-8415-897c1b1fd281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:56.711034 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac54db-e0f4-4e29-8415-897c1b1fd281 admin admin] PATH_INFO: `/v3/projects/3bbcaf162f0c4ac4b8d63ef7ac76a52e` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:56.712234 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac54db-e0f4-4e29-8415-897c1b1fd281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bbcaf162f0c4ac4b8d63ef7ac76a52e)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:56.714173 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac54db-e0f4-4e29-8415-897c1b1fd281 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:56.858590 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-edac54db-e0f4-4e29-8415-897c1b1fd281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bbcaf162f0c4ac4b8d63ef7ac76a52e', 'request_id': 'req-edac54db-e0f4-4e29-8415-897c1b1fd281'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:56.864165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-edac54db-e0f4-4e29-8415-897c1b1fd281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bbcaf162f0c4ac4b8d63ef7ac76a52e', 'request_id': 'req-edac54db-e0f4-4e29-8415-897c1b1fd281'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:56.960702 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-edac54db-e0f4-4e29-8415-897c1b1fd281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bbcaf162f0c4ac4b8d63ef7ac76a52e', 'request_id': 'req-edac54db-e0f4-4e29-8415-897c1b1fd281'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:56.973016 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-edac54db-e0f4-4e29-8415-897c1b1fd281 admin admin] The token cache is being invalidate because project 3bbcaf162f0c4ac4b8d63ef7ac76a52e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:30:56.973337 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-edac54db-e0f4-4e29-8415-897c1b1fd281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:56.973997 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-edac54db-e0f4-4e29-8415-897c1b1fd281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:30:56.976305 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1177/2373] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:30:56 2022] DELETE /identity/v3/projects/3bbcaf162f0c4ac4b8d63ef7ac76a52e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:30:56.981166 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77f40c-bd48-4374-b0f1-4a8c52ed4f76 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:56.981637 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77f40c-bd48-4374-b0f1-4a8c52ed4f76 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:56.981734 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77f40c-bd48-4374-b0f1-4a8c52ed4f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:57.001337 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-ee77f40c-bd48-4374-b0f1-4a8c52ed4f76 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:57.002265 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ee77f40c-bd48-4374-b0f1-4a8c52ed4f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:57.050026 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d0baa-d4ae-4727-accb-264aacd7c4be None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:57.050463 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d0baa-d4ae-4727-accb-264aacd7c4be None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:57.050680 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d0baa-d4ae-4727-accb-264aacd7c4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:57.070012 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-6e4d0baa-d4ae-4727-accb-264aacd7c4be None None] MFA Rules not processed for user `063ce3b820a74d648d709ab6ac4d7be2`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:57.071281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6e4d0baa-d4ae-4727-accb-264aacd7c4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:57.081250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1197/2374] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:57.098764 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e1660-b916-4c41-83a4-6d8f89ceaa38 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:57.098764 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e1660-b916-4c41-83a4-6d8f89ceaa38 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:57.098764 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e1660-b916-4c41-83a4-6d8f89ceaa38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:57.111803 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-a62e1660-b916-4c41-83a4-6d8f89ceaa38 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:57.113085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:57.113214 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a62e1660-b916-4c41-83a4-6d8f89ceaa38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:57.122937 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1198/2375] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:30:57.127487 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e1660-b916-4c41-83a4-6d8f89ceaa38 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:57.137945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e1660-b916-4c41-83a4-6d8f89ceaa38 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:57.138825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1178/2376] 10.222.0.13 () {58 vars in 967 bytes} [Tue Jul 5 21:30:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:30:57.143295 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a34f8f-7abd-4afa-a74f-b4f6ba7562fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:57.144147 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a34f8f-7abd-4afa-a74f-b4f6ba7562fb admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:57.144259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a34f8f-7abd-4afa-a74f-b4f6ba7562fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:57.144503 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a34f8f-7abd-4afa-a74f-b4f6ba7562fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:57.145239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a34f8f-7abd-4afa-a74f-b4f6ba7562fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:57.145544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a34f8f-7abd-4afa-a74f-b4f6ba7562fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:57.148013 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a34f8f-7abd-4afa-a74f-b4f6ba7562fb admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:57.157082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d0baa-d4ae-4727-accb-264aacd7c4be None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:57.163340 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6e4d0baa-d4ae-4727-accb-264aacd7c4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:57.163479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1199/2377] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:30:57.166337 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a34f8f-7abd-4afa-a74f-b4f6ba7562fb admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:57.173587 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:57.178654 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a34f8f-7abd-4afa-a74f-b4f6ba7562fb admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:57.184612 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31a9fd-5a18-46a9-8916-d52f5e493827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:57.185277 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31a9fd-5a18-46a9-8916-d52f5e493827 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:57.185718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31a9fd-5a18-46a9-8916-d52f5e493827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:57.186009 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31a9fd-5a18-46a9-8916-d52f5e493827 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:57.186747 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31a9fd-5a18-46a9-8916-d52f5e493827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:57.192002 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31a9fd-5a18-46a9-8916-d52f5e493827 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:57.238769 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d0baa-d4ae-4727-accb-264aacd7c4be None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:57.244187 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459dd07f-bc9a-4147-8120-cfddbd378c17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '441be62a077444b9b9f78714e24a760a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:57.244845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459dd07f-bc9a-4147-8120-cfddbd378c17 service swift] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:57.245137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459dd07f-bc9a-4147-8120-cfddbd378c17 service swift] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:57.245413 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459dd07f-bc9a-4147-8120-cfddbd378c17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:57.253914 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459dd07f-bc9a-4147-8120-cfddbd378c17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:57.255599 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459dd07f-bc9a-4147-8120-cfddbd378c17 service swift] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:57.264061 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1179/2378] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Jul 5 21:30:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 21:30:57.278187 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1200/2379] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:30:57 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:30:57.280742 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459dd07f-bc9a-4147-8120-cfddbd378c17 service swift] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:57.291704 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459dd07f-bc9a-4147-8120-cfddbd378c17 service swift] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:57.346279 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16363f-61f6-4192-9b54-f39d3650f697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:57.346943 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16363f-61f6-4192-9b54-f39d3650f697 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:57.347226 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16363f-61f6-4192-9b54-f39d3650f697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:57.347502 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16363f-61f6-4192-9b54-f39d3650f697 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:57.348179 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16363f-61f6-4192-9b54-f39d3650f697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:57.350817 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16363f-61f6-4192-9b54-f39d3650f697 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:57.446910 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1180/2380] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:30:57 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:30:57.451143 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31a9fd-5a18-46a9-8916-d52f5e493827 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:57.462267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31a9fd-5a18-46a9-8916-d52f5e493827 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:57.466997 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb469d-827e-4595-a5fd-0a24ab40664e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:57.467646 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb469d-827e-4595-a5fd-0a24ab40664e admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:57.467953 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb469d-827e-4595-a5fd-0a24ab40664e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:57.469660 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb469d-827e-4595-a5fd-0a24ab40664e admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:57.469660 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb469d-827e-4595-a5fd-0a24ab40664e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:57.470609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb469d-827e-4595-a5fd-0a24ab40664e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:57.480562 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1201/2381] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:30:57.484513 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16363f-61f6-4192-9b54-f39d3650f697 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:57.494464 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16363f-61f6-4192-9b54-f39d3650f697 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:57.499405 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412dea8-a09e-4cda-801b-2d901f1afa00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:57.500049 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412dea8-a09e-4cda-801b-2d901f1afa00 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:57.500330 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412dea8-a09e-4cda-801b-2d901f1afa00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:57.500605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412dea8-a09e-4cda-801b-2d901f1afa00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:57.501351 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412dea8-a09e-4cda-801b-2d901f1afa00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:57.502984 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412dea8-a09e-4cda-801b-2d901f1afa00 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:57.513674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1181/2382] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:30:57.517512 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb469d-827e-4595-a5fd-0a24ab40664e admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:57.528441 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb469d-827e-4595-a5fd-0a24ab40664e admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:57.534155 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c29d1-85ca-45d2-acf8-8d9785a37b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:57.535020 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c29d1-85ca-45d2-acf8-8d9785a37b29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:57.535304 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c29d1-85ca-45d2-acf8-8d9785a37b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:57.535582 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c29d1-85ca-45d2-acf8-8d9785a37b29 admin admin] PATH_INFO: `/v3/projects/2c0194954d274a19a7e51e767605b112/users/6aef2a364e7c464ba3f2d581b3fcf913/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:57.550513 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c29d1-85ca-45d2-acf8-8d9785a37b29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c0194954d274a19a7e51e767605b112, user_id=6aef2a364e7c464ba3f2d581b3fcf913, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:57.553191 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c29d1-85ca-45d2-acf8-8d9785a37b29 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:57.654465 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1202/2383] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:30:57 2022] PUT /identity/v3/projects/2c0194954d274a19a7e51e767605b112/users/6aef2a364e7c464ba3f2d581b3fcf913/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:30:57.659617 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c45469-4c1e-4f21-a543-0eeb381a66fc None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:57.659911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c45469-4c1e-4f21-a543-0eeb381a66fc None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:57.660190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c45469-4c1e-4f21-a543-0eeb381a66fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:57.679074 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-46c45469-4c1e-4f21-a543-0eeb381a66fc None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:57.680290 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-46c45469-4c1e-4f21-a543-0eeb381a66fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:57.727363 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:57.741600 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1182/2384] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:57.749865 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c29d1-85ca-45d2-acf8-8d9785a37b29 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:57.755220 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0e6c29d1-85ca-45d2-acf8-8d9785a37b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:57.817454 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c29d1-85ca-45d2-acf8-8d9785a37b29 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:57.825949 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3f550-a394-4bc1-a301-9d741f533b66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:57.826715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3f550-a394-4bc1-a301-9d741f533b66 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:57.827074 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3f550-a394-4bc1-a301-9d741f533b66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:57.827362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3f550-a394-4bc1-a301-9d741f533b66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:57.838295 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3f550-a394-4bc1-a301-9d741f533b66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:57.839710 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3f550-a394-4bc1-a301-9d741f533b66 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:57.850250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1203/2385] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:30:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:30:59.155589 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffc817-f4d4-4614-88c7-251079678905 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:59.156488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffc817-f4d4-4614-88c7-251079678905 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:59.156932 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffc817-f4d4-4614-88c7-251079678905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:59.184165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-0bffc817-f4d4-4614-88c7-251079678905 None None] MFA Rules not processed for user `6aef2a364e7c464ba3f2d581b3fcf913`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:59.185562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0bffc817-f4d4-4614-88c7-251079678905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:59.257927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1183/2386] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:30:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:30:59.262550 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3f550-a394-4bc1-a301-9d741f533b66 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:59.273294 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3f550-a394-4bc1-a301-9d741f533b66 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:59.279634 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38439e90-401d-41f1-8281-dca4d4cc9424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:59.279634 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38439e90-401d-41f1-8281-dca4d4cc9424 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:59.279634 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38439e90-401d-41f1-8281-dca4d4cc9424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:59.279634 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38439e90-401d-41f1-8281-dca4d4cc9424 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:59.280256 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38439e90-401d-41f1-8281-dca4d4cc9424 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:59.282249 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38439e90-401d-41f1-8281-dca4d4cc9424 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:59.384724 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1204/2387] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:30:59 2022] POST /identity/v3/projects => generated 371 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:30:59.388762 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffc817-f4d4-4614-88c7-251079678905 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:59.399646 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffc817-f4d4-4614-88c7-251079678905 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:59.456269 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3508f3-4ec7-45e0-b557-f62d469636e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:59.456942 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3508f3-4ec7-45e0-b557-f62d469636e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:59.457232 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3508f3-4ec7-45e0-b557-f62d469636e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:59.457516 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3508f3-4ec7-45e0-b557-f62d469636e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:59.458260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3508f3-4ec7-45e0-b557-f62d469636e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:59.460537 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3508f3-4ec7-45e0-b557-f62d469636e4 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:59.612063 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1184/2388] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:30:59 2022] POST /identity/v3/users => generated 292 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:30:59.616173 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38439e90-401d-41f1-8281-dca4d4cc9424 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:59.627250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38439e90-401d-41f1-8281-dca4d4cc9424 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:59.636151 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7748c04-484f-45ea-b7b0-f5758f165149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:59.636870 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7748c04-484f-45ea-b7b0-f5758f165149 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:59.637162 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7748c04-484f-45ea-b7b0-f5758f165149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:59.637443 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7748c04-484f-45ea-b7b0-f5758f165149 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:59.638247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7748c04-484f-45ea-b7b0-f5758f165149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:59.639945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7748c04-484f-45ea-b7b0-f5758f165149 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:59.651678 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1205/2389] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:30:59.655892 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3508f3-4ec7-45e0-b557-f62d469636e4 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:59.665760 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3508f3-4ec7-45e0-b557-f62d469636e4 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:59.670540 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da13904-4c36-4cc5-8b5c-f2b6a2ddb8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:59.671410 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da13904-4c36-4cc5-8b5c-f2b6a2ddb8c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:59.671697 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da13904-4c36-4cc5-8b5c-f2b6a2ddb8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:59.674295 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da13904-4c36-4cc5-8b5c-f2b6a2ddb8c3 admin admin] PATH_INFO: `/v3/projects/b44c9673a8124c6296d97761d5ff6f28/users/de0370bd890c4b8faefc889a230c481c/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:59.686636 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da13904-4c36-4cc5-8b5c-f2b6a2ddb8c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b44c9673a8124c6296d97761d5ff6f28, user_id=de0370bd890c4b8faefc889a230c481c, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:59.689307 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da13904-4c36-4cc5-8b5c-f2b6a2ddb8c3 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:59.804283 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1185/2390] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:30:59 2022] PUT /identity/v3/projects/b44c9673a8124c6296d97761d5ff6f28/users/de0370bd890c4b8faefc889a230c481c/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:30:59.808275 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7748c04-484f-45ea-b7b0-f5758f165149 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:59.818641 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7748c04-484f-45ea-b7b0-f5758f165149 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:59.875961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91692617-3fb8-40c3-a767-5cd3c0635304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:59.876551 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91692617-3fb8-40c3-a767-5cd3c0635304 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:59.876839 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91692617-3fb8-40c3-a767-5cd3c0635304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:59.877118 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91692617-3fb8-40c3-a767-5cd3c0635304 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:59.877840 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91692617-3fb8-40c3-a767-5cd3c0635304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:59.879479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91692617-3fb8-40c3-a767-5cd3c0635304 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:59.889587 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1206/2391] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:30:59.893816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da13904-4c36-4cc5-8b5c-f2b6a2ddb8c3 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:59.904132 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da13904-4c36-4cc5-8b5c-f2b6a2ddb8c3 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:59.908816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea4c6b-a228-403a-a74d-c2c7f842cb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:59.909733 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea4c6b-a228-403a-a74d-c2c7f842cb8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:59.910019 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea4c6b-a228-403a-a74d-c2c7f842cb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:59.915519 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea4c6b-a228-403a-a74d-c2c7f842cb8c admin admin] PATH_INFO: `/v3/projects/b44c9673a8124c6296d97761d5ff6f28/users/de0370bd890c4b8faefc889a230c481c/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:59.915519 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea4c6b-a228-403a-a74d-c2c7f842cb8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b44c9673a8124c6296d97761d5ff6f28, user_id=de0370bd890c4b8faefc889a230c481c, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:59.915519 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea4c6b-a228-403a-a74d-c2c7f842cb8c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:59.925679 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1186/2392] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:30:59 2022] PUT /identity/v3/projects/b44c9673a8124c6296d97761d5ff6f28/users/de0370bd890c4b8faefc889a230c481c/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:31:00.073255 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91692617-3fb8-40c3-a767-5cd3c0635304 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:00.075115 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-91692617-3fb8-40c3-a767-5cd3c0635304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:00.089108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91692617-3fb8-40c3-a767-5cd3c0635304 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:00.099984 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:31:00.149656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c4044-cc97-46a6-951e-d7f1c8298412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:00.150835 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c4044-cc97-46a6-951e-d7f1c8298412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:00.151150 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c4044-cc97-46a6-951e-d7f1c8298412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:00.151431 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c4044-cc97-46a6-951e-d7f1c8298412 admin admin] PATH_INFO: `/v3/users/0fe315cf964248049eacf8c88040448a` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:00.152671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c4044-cc97-46a6-951e-d7f1c8298412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fe315cf964248049eacf8c88040448a)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:00.154676 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c4044-cc97-46a6-951e-d7f1c8298412 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:00.452860 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b64c4044-cc97-46a6-951e-d7f1c8298412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fe315cf964248049eacf8c88040448a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:00.523765 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b64c4044-cc97-46a6-951e-d7f1c8298412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fe315cf964248049eacf8c88040448a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:00.544173 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b64c4044-cc97-46a6-951e-d7f1c8298412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fe315cf964248049eacf8c88040448a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:00.557802 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b64c4044-cc97-46a6-951e-d7f1c8298412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fe315cf964248049eacf8c88040448a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:00.558635 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b64c4044-cc97-46a6-951e-d7f1c8298412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fe315cf964248049eacf8c88040448a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:00.564710 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1207/2393] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:31:00 2022] DELETE /identity/v3/users/0fe315cf964248049eacf8c88040448a => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:31:00.569914 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253aacf0-4ca2-419b-b922-9ac39b219ce2 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:00.570629 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253aacf0-4ca2-419b-b922-9ac39b219ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:00.570629 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253aacf0-4ca2-419b-b922-9ac39b219ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:00.589665 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-253aacf0-4ca2-419b-b922-9ac39b219ce2 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:31:00.591198 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-253aacf0-4ca2-419b-b922-9ac39b219ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:00.630710 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:31:00.668271 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1187/2394] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:31:00.679087 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c4044-cc97-46a6-951e-d7f1c8298412 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:00.680840 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b64c4044-cc97-46a6-951e-d7f1c8298412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:00.755005 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c4044-cc97-46a6-951e-d7f1c8298412 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:00.759431 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e569b-78cd-424d-a754-3ec716bb81b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:00.760167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e569b-78cd-424d-a754-3ec716bb81b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:00.761239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e569b-78cd-424d-a754-3ec716bb81b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:00.761239 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e569b-78cd-424d-a754-3ec716bb81b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:00.772124 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e569b-78cd-424d-a754-3ec716bb81b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:00.773340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e569b-78cd-424d-a754-3ec716bb81b8 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:00.785223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1208/2395] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:31:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:31:01.092605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253aacf0-4ca2-419b-b922-9ac39b219ce2 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:01.094266 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-253aacf0-4ca2-419b-b922-9ac39b219ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:01.107000 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253aacf0-4ca2-419b-b922-9ac39b219ce2 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:01.111970 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fb154-4157-4f26-89f3-2d85cd686ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:01.113040 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fb154-4157-4f26-89f3-2d85cd686ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:01.113316 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fb154-4157-4f26-89f3-2d85cd686ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:01.113708 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fb154-4157-4f26-89f3-2d85cd686ff2 admin admin] PATH_INFO: `/v3/projects/229d22f0b88540a28b4760b603651007` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:01.115153 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920fb154-4157-4f26-89f3-2d85cd686ff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=229d22f0b88540a28b4760b603651007)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:01.117424 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920fb154-4157-4f26-89f3-2d85cd686ff2 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:01.246218 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-920fb154-4157-4f26-89f3-2d85cd686ff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '229d22f0b88540a28b4760b603651007', 'request_id': 'req-920fb154-4157-4f26-89f3-2d85cd686ff2'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:01.252188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-920fb154-4157-4f26-89f3-2d85cd686ff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '229d22f0b88540a28b4760b603651007', 'request_id': 'req-920fb154-4157-4f26-89f3-2d85cd686ff2'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:01.320042 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-920fb154-4157-4f26-89f3-2d85cd686ff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '229d22f0b88540a28b4760b603651007', 'request_id': 'req-920fb154-4157-4f26-89f3-2d85cd686ff2'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:01.331871 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-920fb154-4157-4f26-89f3-2d85cd686ff2 admin admin] The token cache is being invalidate because project 229d22f0b88540a28b4760b603651007 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:31:01.332145 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-920fb154-4157-4f26-89f3-2d85cd686ff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:01.332965 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-920fb154-4157-4f26-89f3-2d85cd686ff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:01.335226 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1188/2396] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:31:01 2022] DELETE /identity/v3/projects/229d22f0b88540a28b4760b603651007 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:31:01.357075 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1b1e7-491d-4385-aab9-323643c9053a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:01.357369 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1b1e7-491d-4385-aab9-323643c9053a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:01.357660 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1b1e7-491d-4385-aab9-323643c9053a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:01.391068 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-15a1b1e7-491d-4385-aab9-323643c9053a None None] MFA Rules not processed for user `de0370bd890c4b8faefc889a230c481c`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:31:01.392477 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-15a1b1e7-491d-4385-aab9-323643c9053a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:01.427437 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:31:01.484180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1209/2397] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:31:01 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:31:01.559585 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bdf29-224e-4b77-9ed4-bb45ae62e69a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:01.559875 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bdf29-224e-4b77-9ed4-bb45ae62e69a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:01.560162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bdf29-224e-4b77-9ed4-bb45ae62e69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:01.577995 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-263bdf29-224e-4b77-9ed4-bb45ae62e69a None None] MFA Rules not processed for user `6aef2a364e7c464ba3f2d581b3fcf913`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:31:01.579308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-263bdf29-224e-4b77-9ed4-bb45ae62e69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:01.635126 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1189/2398] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:31:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:31:01.647933 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1b1e7-491d-4385-aab9-323643c9053a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:01.649353 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-15a1b1e7-491d-4385-aab9-323643c9053a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:01.744484 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1b1e7-491d-4385-aab9-323643c9053a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:01.750394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7705e-6418-4a4b-84a0-ca0a38ed9e13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:01.751038 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7705e-6418-4a4b-84a0-ca0a38ed9e13 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:01.751321 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7705e-6418-4a4b-84a0-ca0a38ed9e13 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:01.751600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7705e-6418-4a4b-84a0-ca0a38ed9e13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:01.753371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b2f7705e-6418-4a4b-84a0-ca0a38ed9e13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:01.763662 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7705e-6418-4a4b-84a0-ca0a38ed9e13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:01.766884 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7705e-6418-4a4b-84a0-ca0a38ed9e13 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:01.774693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1210/2399] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:31:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:31:11.628070 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=63,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:31:11.960416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=61 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:31:17.616617 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bdf29-224e-4b77-9ed4-bb45ae62e69a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:17.620056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-263bdf29-224e-4b77-9ed4-bb45ae62e69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:17.732087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bdf29-224e-4b77-9ed4-bb45ae62e69a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:17.737464 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0064a4-9525-4f56-9190-80a1b9c7f2cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992db9dab5944769b192a868d6637a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:17.738835 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0064a4-9525-4f56-9190-80a1b9c7f2cd service placement] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:17.739215 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0064a4-9525-4f56-9190-80a1b9c7f2cd service placement] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:17.739559 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0064a4-9525-4f56-9190-80a1b9c7f2cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:17.741442 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-da0064a4-9525-4f56-9190-80a1b9c7f2cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:17.754633 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0064a4-9525-4f56-9190-80a1b9c7f2cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:17.756248 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0064a4-9525-4f56-9190-80a1b9c7f2cd service placement] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:17.767484 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1190/2400] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:31:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:31:20.524457 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7705e-6418-4a4b-84a0-ca0a38ed9e13 service nova] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:20.525923 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b2f7705e-6418-4a4b-84a0-ca0a38ed9e13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:20.587073 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7705e-6418-4a4b-84a0-ca0a38ed9e13 service nova] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:20.591609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cd45d-033e-4eb6-a05a-ef4dcbba4040 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:20.592643 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cd45d-033e-4eb6-a05a-ef4dcbba4040 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:20.592912 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cd45d-033e-4eb6-a05a-ef4dcbba4040 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:20.593143 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cd45d-033e-4eb6-a05a-ef4dcbba4040 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:20.604777 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28cd45d-033e-4eb6-a05a-ef4dcbba4040 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:20.606397 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28cd45d-033e-4eb6-a05a-ef4dcbba4040 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:20.617190 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1211/2401] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:31:20 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:31:27.762989 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=41 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:31:28.415468 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af28a8b-a659-439e-949d-acb0f1b3b6f4 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:28.415759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af28a8b-a659-439e-949d-acb0f1b3b6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:28.416040 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af28a8b-a659-439e-949d-acb0f1b3b6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:28.435074 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-5af28a8b-a659-439e-949d-acb0f1b3b6f4 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:31:28.436291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5af28a8b-a659-439e-949d-acb0f1b3b6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:28.510661 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1191/2402] 10.222.0.39 () {58 vars in 1016 bytes} [Tue Jul 5 21:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:31:28.585445 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cd45d-033e-4eb6-a05a-ef4dcbba4040 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:28.601459 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cd45d-033e-4eb6-a05a-ef4dcbba4040 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:28.608324 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090b410-3c00-4672-9539-cd8f8661485b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:28.608974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090b410-3c00-4672-9539-cd8f8661485b service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:28.609308 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090b410-3c00-4672-9539-cd8f8661485b service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:28.609582 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090b410-3c00-4672-9539-cd8f8661485b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:28.620869 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090b410-3c00-4672-9539-cd8f8661485b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:28.622852 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090b410-3c00-4672-9539-cd8f8661485b service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:28.636269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1212/2403] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:31:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:31:33.929117 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbad42-ba93-4ba1-a768-4e99032c183b None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:33.930307 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbad42-ba93-4ba1-a768-4e99032c183b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:33.930936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbad42-ba93-4ba1-a768-4e99032c183b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:33.950749 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-bddbad42-ba93-4ba1-a768-4e99032c183b None None] MFA Rules not processed for user `db2792db73c24a75a449894faf6fbf73`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:31:33.952506 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-bddbad42-ba93-4ba1-a768-4e99032c183b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:34.021750 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1192/2404] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:31:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:31:34.138082 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b8ea3-1c07-4e4d-9c69-4d31b105c95a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:34.138600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b8ea3-1c07-4e4d-9c69-4d31b105c95a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:34.138600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b8ea3-1c07-4e4d-9c69-4d31b105c95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:34.157426 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0d2b8ea3-1c07-4e4d-9c69-4d31b105c95a None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:31:34.158670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0d2b8ea3-1c07-4e4d-9c69-4d31b105c95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:34.168025 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1213/2405] 10.222.0.39 () {58 vars in 1016 bytes} [Tue Jul 5 21:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:31:34.234066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbad42-ba93-4ba1-a768-4e99032c183b None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:34.235507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-bddbad42-ba93-4ba1-a768-4e99032c183b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:34.252676 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbad42-ba93-4ba1-a768-4e99032c183b None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:34.258823 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bacff-7223-4710-8c2c-226a993552f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:34.259476 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bacff-7223-4710-8c2c-226a993552f3 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:34.259762 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bacff-7223-4710-8c2c-226a993552f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:34.260038 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bacff-7223-4710-8c2c-226a993552f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:34.269920 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051bacff-7223-4710-8c2c-226a993552f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:34.271827 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051bacff-7223-4710-8c2c-226a993552f3 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:34.281827 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1193/2406] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:31:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:31:39.835793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617afcc-9e55-4362-b0d9-521cd632c266 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:39.836399 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617afcc-9e55-4362-b0d9-521cd632c266 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:39.836399 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617afcc-9e55-4362-b0d9-521cd632c266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:39.854960 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-8617afcc-9e55-4362-b0d9-521cd632c266 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:31:39.858597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8617afcc-9e55-4362-b0d9-521cd632c266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:39.864664 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1214/2407] 10.222.0.39 () {58 vars in 1016 bytes} [Tue Jul 5 21:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:31:39.900383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bacff-7223-4710-8c2c-226a993552f3 service nova] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:39.912688 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bacff-7223-4710-8c2c-226a993552f3 service nova] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:39.919149 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da58f3-d313-4a8f-869d-91cb4f628eb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:39.925625 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da58f3-d313-4a8f-869d-91cb4f628eb0 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:39.925625 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da58f3-d313-4a8f-869d-91cb4f628eb0 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:39.925625 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da58f3-d313-4a8f-869d-91cb4f628eb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:39.930381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da58f3-d313-4a8f-869d-91cb4f628eb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:39.931994 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da58f3-d313-4a8f-869d-91cb4f628eb0 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:39.943222 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1194/2408] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:31:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:31:43.783416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03695857-4e5a-4454-9bc4-a4f2b28c92fb None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:43.783968 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03695857-4e5a-4454-9bc4-a4f2b28c92fb None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:43.783968 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03695857-4e5a-4454-9bc4-a4f2b28c92fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:43.791074 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=39 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:31:43.802827 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-03695857-4e5a-4454-9bc4-a4f2b28c92fb None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:31:43.809970 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-03695857-4e5a-4454-9bc4-a4f2b28c92fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:43.811910 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1215/2409] 10.222.0.39 () {58 vars in 1016 bytes} [Tue Jul 5 21:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:31:43.878408 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da58f3-d313-4a8f-869d-91cb4f628eb0 service nova] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:43.889695 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da58f3-d313-4a8f-869d-91cb4f628eb0 service nova] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:43.896212 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d5557-2098-4461-9b61-2f6f7ec6d14e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:43.896846 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d5557-2098-4461-9b61-2f6f7ec6d14e service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:43.897129 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d5557-2098-4461-9b61-2f6f7ec6d14e service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:43.897407 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d5557-2098-4461-9b61-2f6f7ec6d14e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:43.905703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d5557-2098-4461-9b61-2f6f7ec6d14e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:43.907482 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d5557-2098-4461-9b61-2f6f7ec6d14e service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:43.916910 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1195/2410] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:31:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:31:48.457604 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323121d-f61f-49fa-8bc0-2ca4551913a3 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:48.458477 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323121d-f61f-49fa-8bc0-2ca4551913a3 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:48.458763 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323121d-f61f-49fa-8bc0-2ca4551913a3 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:48.460988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1216/2411] 10.222.0.13 () {54 vars in 921 bytes} [Tue Jul 5 21:31:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:31:48.473692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42331e-c5c9-4e6b-b478-8113378019cf None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:48.474536 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42331e-c5c9-4e6b-b478-8113378019cf None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:48.474842 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42331e-c5c9-4e6b-b478-8113378019cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:48.512813 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-8d42331e-c5c9-4e6b-b478-8113378019cf None None] MFA Rules not processed for user `992db9dab5944769b192a868d6637a02`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:31:48.514039 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8d42331e-c5c9-4e6b-b478-8113378019cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:48.523287 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1196/2412] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Jul 5 21:31:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:31:48.533935 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323121d-f61f-49fa-8bc0-2ca4551913a3 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:48.535826 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b323121d-f61f-49fa-8bc0-2ca4551913a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:48.552816 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323121d-f61f-49fa-8bc0-2ca4551913a3 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:48.558181 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d800a-e746-4b98-b580-8a2a46124663 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992db9dab5944769b192a868d6637a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:48.558825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d800a-e746-4b98-b580-8a2a46124663 service placement] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:48.559238 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d800a-e746-4b98-b580-8a2a46124663 service placement] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:48.559629 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d800a-e746-4b98-b580-8a2a46124663 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:48.568398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d800a-e746-4b98-b580-8a2a46124663 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:48.570769 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d800a-e746-4b98-b580-8a2a46124663 service placement] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:48.580534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1217/2413] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:31:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:31:49.001698 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32280631-2b29-4171-999e-89a97396d9fd None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:49.006973 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32280631-2b29-4171-999e-89a97396d9fd None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:49.006973 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32280631-2b29-4171-999e-89a97396d9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:49.020455 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-32280631-2b29-4171-999e-89a97396d9fd None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:31:49.021707 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-32280631-2b29-4171-999e-89a97396d9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:49.030238 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1197/2414] 10.222.0.39 () {58 vars in 1016 bytes} [Tue Jul 5 21:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:31:49.056723 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d800a-e746-4b98-b580-8a2a46124663 service placement] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:49.068752 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d800a-e746-4b98-b580-8a2a46124663 service placement] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:49.074517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa99b4-4848-4d97-bbeb-38820c81e98d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:49.075163 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa99b4-4848-4d97-bbeb-38820c81e98d service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:49.075446 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa99b4-4848-4d97-bbeb-38820c81e98d service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:49.075730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa99b4-4848-4d97-bbeb-38820c81e98d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:49.084714 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa99b4-4848-4d97-bbeb-38820c81e98d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:49.086363 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa99b4-4848-4d97-bbeb-38820c81e98d service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:49.096089 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1218/2415] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:31:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:31:49.396855 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32280631-2b29-4171-999e-89a97396d9fd None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:49.398392 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-32280631-2b29-4171-999e-89a97396d9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:49.418563 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32280631-2b29-4171-999e-89a97396d9fd None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:49.419578 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26345f9e-e10c-4463-8244-6d09aefbf6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:49.419578 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26345f9e-e10c-4463-8244-6d09aefbf6b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:49.419957 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26345f9e-e10c-4463-8244-6d09aefbf6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:49.420050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26345f9e-e10c-4463-8244-6d09aefbf6b9 admin admin] PATH_INFO: `/v3/users/6aef2a364e7c464ba3f2d581b3fcf913` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:49.421349 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26345f9e-e10c-4463-8244-6d09aefbf6b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aef2a364e7c464ba3f2d581b3fcf913)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:49.423470 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26345f9e-e10c-4463-8244-6d09aefbf6b9 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:49.622775 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:31:49.629537 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-26345f9e-e10c-4463-8244-6d09aefbf6b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aef2a364e7c464ba3f2d581b3fcf913'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:49.637167 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-26345f9e-e10c-4463-8244-6d09aefbf6b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aef2a364e7c464ba3f2d581b3fcf913'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:49.650077 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-26345f9e-e10c-4463-8244-6d09aefbf6b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aef2a364e7c464ba3f2d581b3fcf913'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:49.650833 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-26345f9e-e10c-4463-8244-6d09aefbf6b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aef2a364e7c464ba3f2d581b3fcf913'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:49.739013 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-26345f9e-e10c-4463-8244-6d09aefbf6b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aef2a364e7c464ba3f2d581b3fcf913'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:49.745309 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1198/2416] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:31:49 2022] DELETE /identity/v3/users/6aef2a364e7c464ba3f2d581b3fcf913 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:31:49.996457 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa99b4-4848-4d97-bbeb-38820c81e98d service nova] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:50.007674 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa99b4-4848-4d97-bbeb-38820c81e98d service nova] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:50.065575 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c32810-2494-4b7f-ab8d-28874c3a2e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:50.066411 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c32810-2494-4b7f-ab8d-28874c3a2e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:50.066698 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c32810-2494-4b7f-ab8d-28874c3a2e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:50.066979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c32810-2494-4b7f-ab8d-28874c3a2e28 admin admin] PATH_INFO: `/v3/projects/2c0194954d274a19a7e51e767605b112` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:50.068275 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c32810-2494-4b7f-ab8d-28874c3a2e28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c0194954d274a19a7e51e767605b112)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:50.070213 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c32810-2494-4b7f-ab8d-28874c3a2e28 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:50.179497 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-77c32810-2494-4b7f-ab8d-28874c3a2e28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c0194954d274a19a7e51e767605b112', 'request_id': 'req-77c32810-2494-4b7f-ab8d-28874c3a2e28'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:50.274572 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-77c32810-2494-4b7f-ab8d-28874c3a2e28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c0194954d274a19a7e51e767605b112', 'request_id': 'req-77c32810-2494-4b7f-ab8d-28874c3a2e28'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:50.280400 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-77c32810-2494-4b7f-ab8d-28874c3a2e28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c0194954d274a19a7e51e767605b112', 'request_id': 'req-77c32810-2494-4b7f-ab8d-28874c3a2e28'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:50.291993 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-77c32810-2494-4b7f-ab8d-28874c3a2e28 admin admin] The token cache is being invalidate because project 2c0194954d274a19a7e51e767605b112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:31:50.292286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-77c32810-2494-4b7f-ab8d-28874c3a2e28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:50.292919 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-77c32810-2494-4b7f-ab8d-28874c3a2e28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:50.294554 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1219/2417] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:31:49 2022] DELETE /identity/v3/projects/2c0194954d274a19a7e51e767605b112 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:31:50.298664 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26345f9e-e10c-4463-8244-6d09aefbf6b9 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:50.300112 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-26345f9e-e10c-4463-8244-6d09aefbf6b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:50.313560 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26345f9e-e10c-4463-8244-6d09aefbf6b9 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:50.370565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ebe56-4e2c-428f-ac65-a9d19fa0ae9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:50.371611 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ebe56-4e2c-428f-ac65-a9d19fa0ae9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:50.371889 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ebe56-4e2c-428f-ac65-a9d19fa0ae9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:50.372163 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ebe56-4e2c-428f-ac65-a9d19fa0ae9e admin admin] PATH_INFO: `/v3/users/de0370bd890c4b8faefc889a230c481c` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:50.373334 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ebe56-4e2c-428f-ac65-a9d19fa0ae9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=de0370bd890c4b8faefc889a230c481c)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:50.375364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ebe56-4e2c-428f-ac65-a9d19fa0ae9e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:50.567177 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-895ebe56-4e2c-428f-ac65-a9d19fa0ae9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de0370bd890c4b8faefc889a230c481c'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:50.574625 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-895ebe56-4e2c-428f-ac65-a9d19fa0ae9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de0370bd890c4b8faefc889a230c481c'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:50.587821 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-895ebe56-4e2c-428f-ac65-a9d19fa0ae9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de0370bd890c4b8faefc889a230c481c'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:50.588527 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-895ebe56-4e2c-428f-ac65-a9d19fa0ae9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de0370bd890c4b8faefc889a230c481c'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:50.685570 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-895ebe56-4e2c-428f-ac65-a9d19fa0ae9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de0370bd890c4b8faefc889a230c481c'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:50.692729 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1199/2418] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:31:50 2022] DELETE /identity/v3/users/de0370bd890c4b8faefc889a230c481c => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:31:50.978035 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c32810-2494-4b7f-ab8d-28874c3a2e28 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:50.979537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-77c32810-2494-4b7f-ab8d-28874c3a2e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:50.997592 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c32810-2494-4b7f-ab8d-28874c3a2e28 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:51.056300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ab8ae-60eb-40c4-bb48-7191d1717559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:51.062282 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ab8ae-60eb-40c4-bb48-7191d1717559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:51.062282 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ab8ae-60eb-40c4-bb48-7191d1717559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:51.062282 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ab8ae-60eb-40c4-bb48-7191d1717559 admin admin] PATH_INFO: `/v3/projects/b44c9673a8124c6296d97761d5ff6f28` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:51.062282 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ab8ae-60eb-40c4-bb48-7191d1717559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b44c9673a8124c6296d97761d5ff6f28)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:51.062282 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ab8ae-60eb-40c4-bb48-7191d1717559 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:51.062282 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:31:51.210517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-379ab8ae-60eb-40c4-bb48-7191d1717559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b44c9673a8124c6296d97761d5ff6f28', 'request_id': 'req-379ab8ae-60eb-40c4-bb48-7191d1717559'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:51.333455 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-379ab8ae-60eb-40c4-bb48-7191d1717559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b44c9673a8124c6296d97761d5ff6f28', 'request_id': 'req-379ab8ae-60eb-40c4-bb48-7191d1717559'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:51.340044 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-379ab8ae-60eb-40c4-bb48-7191d1717559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b44c9673a8124c6296d97761d5ff6f28', 'request_id': 'req-379ab8ae-60eb-40c4-bb48-7191d1717559'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:51.351136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-379ab8ae-60eb-40c4-bb48-7191d1717559 admin admin] The token cache is being invalidate because project b44c9673a8124c6296d97761d5ff6f28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:31:51.351964 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-379ab8ae-60eb-40c4-bb48-7191d1717559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:51.352611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-379ab8ae-60eb-40c4-bb48-7191d1717559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:51.354164 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1220/2419] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:31:50 2022] DELETE /identity/v3/projects/b44c9673a8124c6296d97761d5ff6f28 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:31:51.358991 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6fcb1-2d67-4637-9423-ce4343f4d2b4 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:51.359280 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6fcb1-2d67-4637-9423-ce4343f4d2b4 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:51.359556 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6fcb1-2d67-4637-9423-ce4343f4d2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:51.378994 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d8a6fcb1-2d67-4637-9423-ce4343f4d2b4 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:31:51.384733 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d8a6fcb1-2d67-4637-9423-ce4343f4d2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:51.405507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:31:51.438884 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1200/2420] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:31:51.446450 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fe460-1a00-4ece-8b13-64c11e9a35e6 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:51.446745 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fe460-1a00-4ece-8b13-64c11e9a35e6 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:51.447030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fe460-1a00-4ece-8b13-64c11e9a35e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:51.465434 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-612fe460-1a00-4ece-8b13-64c11e9a35e6 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:31:51.466689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-612fe460-1a00-4ece-8b13-64c11e9a35e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:51.474940 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1221/2421] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:31:51.479638 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6fcb1-2d67-4637-9423-ce4343f4d2b4 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:51.489126 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6fcb1-2d67-4637-9423-ce4343f4d2b4 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:51.494655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf72fa-2a89-4293-a4f0-3ef14e891e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:51.495302 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf72fa-2a89-4293-a4f0-3ef14e891e20 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:51.495589 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf72fa-2a89-4293-a4f0-3ef14e891e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:51.496169 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf72fa-2a89-4293-a4f0-3ef14e891e20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:51.496903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf72fa-2a89-4293-a4f0-3ef14e891e20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:31:51.497212 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf72fa-2a89-4293-a4f0-3ef14e891e20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:51.499237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf72fa-2a89-4293-a4f0-3ef14e891e20 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:51.511428 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1201/2422] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:31:51.515539 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fe460-1a00-4ece-8b13-64c11e9a35e6 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:51.525008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fe460-1a00-4ece-8b13-64c11e9a35e6 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:51.529734 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6208a09-d779-4520-8709-94f625feec79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:51.530430 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6208a09-d779-4520-8709-94f625feec79 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:51.530722 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6208a09-d779-4520-8709-94f625feec79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:51.531003 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6208a09-d779-4520-8709-94f625feec79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:51.531730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6208a09-d779-4520-8709-94f625feec79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:51.533668 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6208a09-d779-4520-8709-94f625feec79 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:51.621203 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1222/2423] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:31:51 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:31:51.625294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf72fa-2a89-4293-a4f0-3ef14e891e20 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:51.636068 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf72fa-2a89-4293-a4f0-3ef14e891e20 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:51.692931 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291207e5-f548-427b-80f5-18dba0c0e4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:51.693601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291207e5-f548-427b-80f5-18dba0c0e4db admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:51.693872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291207e5-f548-427b-80f5-18dba0c0e4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:51.694176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291207e5-f548-427b-80f5-18dba0c0e4db admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:51.694981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291207e5-f548-427b-80f5-18dba0c0e4db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:51.697105 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291207e5-f548-427b-80f5-18dba0c0e4db admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:51.812970 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1202/2424] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:31:51 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:31:51.816796 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6208a09-d779-4520-8709-94f625feec79 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:51.828432 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6208a09-d779-4520-8709-94f625feec79 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:51.833054 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacdabc-5dbc-4020-a0ad-fbcdbcbcbd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:51.833692 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacdabc-5dbc-4020-a0ad-fbcdbcbcbd88 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:51.833972 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacdabc-5dbc-4020-a0ad-fbcdbcbcbd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:51.834277 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacdabc-5dbc-4020-a0ad-fbcdbcbcbd88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:51.834992 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacdabc-5dbc-4020-a0ad-fbcdbcbcbd88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:51.837129 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacdabc-5dbc-4020-a0ad-fbcdbcbcbd88 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:51.848819 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1223/2425] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:31:51.853069 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291207e5-f548-427b-80f5-18dba0c0e4db admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:51.862988 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291207e5-f548-427b-80f5-18dba0c0e4db admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:51.868602 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc001494-fe2d-4381-8f61-f234a70f12e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:51.869282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc001494-fe2d-4381-8f61-f234a70f12e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:51.869651 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc001494-fe2d-4381-8f61-f234a70f12e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:51.869934 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc001494-fe2d-4381-8f61-f234a70f12e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:51.870692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc001494-fe2d-4381-8f61-f234a70f12e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:51.872536 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc001494-fe2d-4381-8f61-f234a70f12e3 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:51.886684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1203/2426] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:31:51.887997 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacdabc-5dbc-4020-a0ad-fbcdbcbcbd88 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:51.899482 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacdabc-5dbc-4020-a0ad-fbcdbcbcbd88 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:51.904478 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2a260-74fd-4775-8aba-9b994736e9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:51.905587 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2a260-74fd-4775-8aba-9b994736e9bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:51.905940 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2a260-74fd-4775-8aba-9b994736e9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:51.906521 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2a260-74fd-4775-8aba-9b994736e9bd admin admin] PATH_INFO: `/v3/projects/5c72dc14775c49c3b11f518387b655ff/users/2cc3a9f8efe24b0a923228b55cd80cc2/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:51.925035 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2a260-74fd-4775-8aba-9b994736e9bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c72dc14775c49c3b11f518387b655ff, user_id=2cc3a9f8efe24b0a923228b55cd80cc2, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:51.928231 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2a260-74fd-4775-8aba-9b994736e9bd admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:52.034826 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1224/2427] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:31:51 2022] PUT /identity/v3/projects/5c72dc14775c49c3b11f518387b655ff/users/2cc3a9f8efe24b0a923228b55cd80cc2/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:31:52.045503 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f1577-2e47-4dbd-93af-c0df599d68f3 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:52.045791 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f1577-2e47-4dbd-93af-c0df599d68f3 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:52.046075 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f1577-2e47-4dbd-93af-c0df599d68f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:52.077121 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-dd4f1577-2e47-4dbd-93af-c0df599d68f3 None None] MFA Rules not processed for user `2cc3a9f8efe24b0a923228b55cd80cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:31:52.078515 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-dd4f1577-2e47-4dbd-93af-c0df599d68f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:52.149779 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1204/2428] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:31:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:31:52.161037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2a260-74fd-4775-8aba-9b994736e9bd admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:52.162793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-8ac2a260-74fd-4775-8aba-9b994736e9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:52.224103 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2a260-74fd-4775-8aba-9b994736e9bd admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:52.228167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f07faa-0e5d-40c8-9422-f5b956483f3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:52.228825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f07faa-0e5d-40c8-9422-f5b956483f3f service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:52.229110 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f07faa-0e5d-40c8-9422-f5b956483f3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:52.229385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f07faa-0e5d-40c8-9422-f5b956483f3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:52.238147 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f07faa-0e5d-40c8-9422-f5b956483f3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:52.239591 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f07faa-0e5d-40c8-9422-f5b956483f3f service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:52.248775 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1225/2429] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:31:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:31:52.270073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f1577-2e47-4dbd-93af-c0df599d68f3 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:52.302607 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:31:52.337271 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f1577-2e47-4dbd-93af-c0df599d68f3 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:52.341944 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b2eeb-f2e2-4690-a0a7-0a1cca7a80bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:52.342907 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b2eeb-f2e2-4690-a0a7-0a1cca7a80bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:52.343184 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b2eeb-f2e2-4690-a0a7-0a1cca7a80bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:52.343503 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b2eeb-f2e2-4690-a0a7-0a1cca7a80bd admin admin] PATH_INFO: `/v3/users/2cc3a9f8efe24b0a923228b55cd80cc2` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:52.344723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b2eeb-f2e2-4690-a0a7-0a1cca7a80bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cc3a9f8efe24b0a923228b55cd80cc2)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:52.346729 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b2eeb-f2e2-4690-a0a7-0a1cca7a80bd admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:52.574282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-bc9b2eeb-f2e2-4690-a0a7-0a1cca7a80bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cc3a9f8efe24b0a923228b55cd80cc2'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:52.581762 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-bc9b2eeb-f2e2-4690-a0a7-0a1cca7a80bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cc3a9f8efe24b0a923228b55cd80cc2'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:52.605565 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-bc9b2eeb-f2e2-4690-a0a7-0a1cca7a80bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cc3a9f8efe24b0a923228b55cd80cc2'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:52.606380 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-bc9b2eeb-f2e2-4690-a0a7-0a1cca7a80bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cc3a9f8efe24b0a923228b55cd80cc2'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:52.699030 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-bc9b2eeb-f2e2-4690-a0a7-0a1cca7a80bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cc3a9f8efe24b0a923228b55cd80cc2'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:52.706005 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1205/2430] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:31:52 2022] DELETE /identity/v3/users/2cc3a9f8efe24b0a923228b55cd80cc2 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:31:52.710544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a3d57-7cdd-4507-9726-5b5cb6e1dbe8 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:52.710866 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a3d57-7cdd-4507-9726-5b5cb6e1dbe8 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:52.711234 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a3d57-7cdd-4507-9726-5b5cb6e1dbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:52.733631 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-007a3d57-7cdd-4507-9726-5b5cb6e1dbe8 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:31:52.734869 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-007a3d57-7cdd-4507-9726-5b5cb6e1dbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:52.759527 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:31:52.792609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1226/2431] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:31:52.804035 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b2eeb-f2e2-4690-a0a7-0a1cca7a80bd admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:52.804035 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-bc9b2eeb-f2e2-4690-a0a7-0a1cca7a80bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:52.867152 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b2eeb-f2e2-4690-a0a7-0a1cca7a80bd admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:52.871088 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35b625-71c0-4434-9576-e4afa35206bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:52.871739 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35b625-71c0-4434-9576-e4afa35206bf service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:52.872022 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35b625-71c0-4434-9576-e4afa35206bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:52.872298 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35b625-71c0-4434-9576-e4afa35206bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:52.881703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35b625-71c0-4434-9576-e4afa35206bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:52.884010 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35b625-71c0-4434-9576-e4afa35206bf service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:52.893992 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1206/2432] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:31:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:31:53.352572 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a3d57-7cdd-4507-9726-5b5cb6e1dbe8 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:53.353650 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200a416-21b7-4326-af40-9577edd60671 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:53.353941 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200a416-21b7-4326-af40-9577edd60671 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:53.354082 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-007a3d57-7cdd-4507-9726-5b5cb6e1dbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:53.354240 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200a416-21b7-4326-af40-9577edd60671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:53.374961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a3d57-7cdd-4507-9726-5b5cb6e1dbe8 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:53.376655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-f200a416-21b7-4326-af40-9577edd60671 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:31:53.378256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f200a416-21b7-4326-af40-9577edd60671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:53.384081 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ce14d-4be9-4fb1-b88f-79ed6b130789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:53.385371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ce14d-4be9-4fb1-b88f-79ed6b130789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:53.386747 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ce14d-4be9-4fb1-b88f-79ed6b130789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:53.387214 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ce14d-4be9-4fb1-b88f-79ed6b130789 admin admin] PATH_INFO: `/v3/projects/5c72dc14775c49c3b11f518387b655ff` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:53.389118 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1207/2433] 10.222.0.39 () {58 vars in 1016 bytes} [Tue Jul 5 21:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:31:53.396824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ce14d-4be9-4fb1-b88f-79ed6b130789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c72dc14775c49c3b11f518387b655ff)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:53.398917 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ce14d-4be9-4fb1-b88f-79ed6b130789 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:53.422434 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200a416-21b7-4326-af40-9577edd60671 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:53.425300 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f200a416-21b7-4326-af40-9577edd60671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:53.479463 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:31:53.527024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-100ce14d-4be9-4fb1-b88f-79ed6b130789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c72dc14775c49c3b11f518387b655ff', 'request_id': 'req-100ce14d-4be9-4fb1-b88f-79ed6b130789'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:53.533230 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200a416-21b7-4326-af40-9577edd60671 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:53.614985 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a29aa5-75ff-4a0c-9fce-541625ab18e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:53.615668 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a29aa5-75ff-4a0c-9fce-541625ab18e3 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:53.615953 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a29aa5-75ff-4a0c-9fce-541625ab18e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:53.616233 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a29aa5-75ff-4a0c-9fce-541625ab18e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:53.623348 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-100ce14d-4be9-4fb1-b88f-79ed6b130789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c72dc14775c49c3b11f518387b655ff', 'request_id': 'req-100ce14d-4be9-4fb1-b88f-79ed6b130789'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:53.634338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-100ce14d-4be9-4fb1-b88f-79ed6b130789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c72dc14775c49c3b11f518387b655ff', 'request_id': 'req-100ce14d-4be9-4fb1-b88f-79ed6b130789'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:53.648618 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-100ce14d-4be9-4fb1-b88f-79ed6b130789 admin admin] The token cache is being invalidate because project 5c72dc14775c49c3b11f518387b655ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:31:53.649611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-100ce14d-4be9-4fb1-b88f-79ed6b130789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:53.650477 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-100ce14d-4be9-4fb1-b88f-79ed6b130789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:31:53.654163 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1227/2434] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:31:53 2022] DELETE /identity/v3/projects/5c72dc14775c49c3b11f518387b655ff => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:31:53.657567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11864954-df30-42c5-a5b6-069a2d9e2c51 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:53.658049 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11864954-df30-42c5-a5b6-069a2d9e2c51 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:53.658462 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11864954-df30-42c5-a5b6-069a2d9e2c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:53.680904 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-11864954-df30-42c5-a5b6-069a2d9e2c51 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:31:53.682464 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-11864954-df30-42c5-a5b6-069a2d9e2c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:53.696067 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a29aa5-75ff-4a0c-9fce-541625ab18e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:53.696067 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a29aa5-75ff-4a0c-9fce-541625ab18e3 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:53.696503 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1228/2435] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:31:53.703391 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1208/2436] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:31:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:31:53.707426 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693af16-afe6-4103-8ba8-27d3f5f4e2bc None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:53.707748 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693af16-afe6-4103-8ba8-27d3f5f4e2bc None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:53.708032 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693af16-afe6-4103-8ba8-27d3f5f4e2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:53.731108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-7693af16-afe6-4103-8ba8-27d3f5f4e2bc None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:31:53.732110 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7693af16-afe6-4103-8ba8-27d3f5f4e2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:53.752472 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1229/2437] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:31:53.753017 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a29aa5-75ff-4a0c-9fce-541625ab18e3 service nova] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:53.754567 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a8a29aa5-75ff-4a0c-9fce-541625ab18e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:53.768234 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a29aa5-75ff-4a0c-9fce-541625ab18e3 service nova] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:53.774493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634d553-93a5-49ea-86e3-47d4a24e4e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:53.775440 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634d553-93a5-49ea-86e3-47d4a24e4e8e admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:53.775800 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634d553-93a5-49ea-86e3-47d4a24e4e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:53.776077 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634d553-93a5-49ea-86e3-47d4a24e4e8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:53.776814 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5634d553-93a5-49ea-86e3-47d4a24e4e8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:31:53.777123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5634d553-93a5-49ea-86e3-47d4a24e4e8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:53.778779 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5634d553-93a5-49ea-86e3-47d4a24e4e8e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:53.794005 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1209/2438] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:31:53.799869 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693af16-afe6-4103-8ba8-27d3f5f4e2bc None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:53.811522 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693af16-afe6-4103-8ba8-27d3f5f4e2bc None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:53.816531 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687be9d-58ba-470a-8899-d2f378d195ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:53.817279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687be9d-58ba-470a-8899-d2f378d195ab admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:53.817593 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687be9d-58ba-470a-8899-d2f378d195ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:53.817874 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687be9d-58ba-470a-8899-d2f378d195ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:53.818640 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a687be9d-58ba-470a-8899-d2f378d195ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:53.821898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a687be9d-58ba-470a-8899-d2f378d195ab admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:53.938143 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1230/2439] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:31:53 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:31:53.942156 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634d553-93a5-49ea-86e3-47d4a24e4e8e admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:53.954131 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634d553-93a5-49ea-86e3-47d4a24e4e8e admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:54.013874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3720253-6e81-4f04-8199-3106276b6ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:54.014592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3720253-6e81-4f04-8199-3106276b6ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:54.015040 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3720253-6e81-4f04-8199-3106276b6ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:54.015512 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3720253-6e81-4f04-8199-3106276b6ba0 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:54.016068 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3720253-6e81-4f04-8199-3106276b6ba0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:54.018056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3720253-6e81-4f04-8199-3106276b6ba0 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:54.025259 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:31:54.100037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1210/2440] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:31:53 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:31:54.101790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687be9d-58ba-470a-8899-d2f378d195ab admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:54.112664 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687be9d-58ba-470a-8899-d2f378d195ab admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:54.118401 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e7945-4d4a-45ed-b556-fe12a66d48f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:54.119233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e7945-4d4a-45ed-b556-fe12a66d48f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:54.119605 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e7945-4d4a-45ed-b556-fe12a66d48f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:54.119889 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e7945-4d4a-45ed-b556-fe12a66d48f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:54.120623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e7945-4d4a-45ed-b556-fe12a66d48f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:54.122525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e7945-4d4a-45ed-b556-fe12a66d48f5 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:54.137194 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1231/2441] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:31:54.138754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3720253-6e81-4f04-8199-3106276b6ba0 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:54.148980 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3720253-6e81-4f04-8199-3106276b6ba0 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:54.153812 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bef2dc-1af7-46ac-8d11-d9bdd491ec9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:54.154502 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bef2dc-1af7-46ac-8d11-d9bdd491ec9d admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:54.154788 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bef2dc-1af7-46ac-8d11-d9bdd491ec9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:54.155068 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bef2dc-1af7-46ac-8d11-d9bdd491ec9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:54.155790 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bef2dc-1af7-46ac-8d11-d9bdd491ec9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:54.157399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bef2dc-1af7-46ac-8d11-d9bdd491ec9d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:54.169122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1211/2442] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:31:54.180121 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e7945-4d4a-45ed-b556-fe12a66d48f5 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:54.190796 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e7945-4d4a-45ed-b556-fe12a66d48f5 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:54.195578 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f34d3a-f711-4688-a0a8-24011bbb484b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:54.196536 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f34d3a-f711-4688-a0a8-24011bbb484b admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:54.196822 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f34d3a-f711-4688-a0a8-24011bbb484b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:54.197104 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f34d3a-f711-4688-a0a8-24011bbb484b admin admin] PATH_INFO: `/v3/projects/e1d7648c74b4459683d0da60b9ce1a43/users/b5520ffe9cbd422b9a4794dca2e5d444/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:54.212368 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f34d3a-f711-4688-a0a8-24011bbb484b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1d7648c74b4459683d0da60b9ce1a43, user_id=b5520ffe9cbd422b9a4794dca2e5d444, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:54.215065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f34d3a-f711-4688-a0a8-24011bbb484b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:54.294819 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1232/2443] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:31:54 2022] PUT /identity/v3/projects/e1d7648c74b4459683d0da60b9ce1a43/users/b5520ffe9cbd422b9a4794dca2e5d444/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:31:54.299919 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70a5d1-5642-4c7d-9c66-b52f59872033 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:54.300210 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70a5d1-5642-4c7d-9c66-b52f59872033 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:54.300536 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70a5d1-5642-4c7d-9c66-b52f59872033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:54.319066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-ad70a5d1-5642-4c7d-9c66-b52f59872033 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:31:54.320298 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ad70a5d1-5642-4c7d-9c66-b52f59872033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:54.389796 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1212/2444] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:31:54.399770 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f34d3a-f711-4688-a0a8-24011bbb484b admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:31:54.401551 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-26f34d3a-f711-4688-a0a8-24011bbb484b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:31:54.451872 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:31:54.463645 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f34d3a-f711-4688-a0a8-24011bbb484b admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:31:54.467419 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288685aa-c084-4e5e-81ae-065ac08517ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:31:54.468070 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288685aa-c084-4e5e-81ae-065ac08517ef service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:31:54.468371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288685aa-c084-4e5e-81ae-065ac08517ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:31:54.468729 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288685aa-c084-4e5e-81ae-065ac08517ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:31:54.479372 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288685aa-c084-4e5e-81ae-065ac08517ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:31:54.480828 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288685aa-c084-4e5e-81ae-065ac08517ef service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:31:54.501804 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1233/2445] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:31:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:32:00.329232 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369119d0-47fd-40d6-8313-cb55e78230a2 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:32:00.329755 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369119d0-47fd-40d6-8313-cb55e78230a2 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:32:00.329882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369119d0-47fd-40d6-8313-cb55e78230a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:32:00.367342 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-369119d0-47fd-40d6-8313-cb55e78230a2 None None] MFA Rules not processed for user `b5520ffe9cbd422b9a4794dca2e5d444`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:32:00.368576 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-369119d0-47fd-40d6-8313-cb55e78230a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:32:00.441294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1213/2446] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:32:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:32:00.446078 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288685aa-c084-4e5e-81ae-065ac08517ef service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:32:00.456169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288685aa-c084-4e5e-81ae-065ac08517ef service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:32:00.460929 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18488e83-3792-4d0d-b1a1-17443218603a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:32:00.461589 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18488e83-3792-4d0d-b1a1-17443218603a admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:32:00.461876 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18488e83-3792-4d0d-b1a1-17443218603a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:32:00.462199 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18488e83-3792-4d0d-b1a1-17443218603a admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:32:00.462895 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18488e83-3792-4d0d-b1a1-17443218603a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:32:00.464817 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18488e83-3792-4d0d-b1a1-17443218603a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:32:00.562082 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1234/2447] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:32:00 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:32:00.566027 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369119d0-47fd-40d6-8313-cb55e78230a2 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:32:00.577540 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369119d0-47fd-40d6-8313-cb55e78230a2 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:32:00.655509 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2655a-adbd-4911-ab13-992cfce7e126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:32:00.656348 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2655a-adbd-4911-ab13-992cfce7e126 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:32:00.656731 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2655a-adbd-4911-ab13-992cfce7e126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:32:00.657110 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2655a-adbd-4911-ab13-992cfce7e126 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:32:00.657943 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2655a-adbd-4911-ab13-992cfce7e126 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:32:00.660024 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2655a-adbd-4911-ab13-992cfce7e126 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:32:00.756494 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:32:00.762857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1214/2448] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:32:00 2022] POST /identity/v3/users => generated 298 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:32:00.766818 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18488e83-3792-4d0d-b1a1-17443218603a admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:32:00.778374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18488e83-3792-4d0d-b1a1-17443218603a admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:32:00.783304 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e6044-7fec-494b-9e01-5ed94b84ce43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:32:00.784004 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e6044-7fec-494b-9e01-5ed94b84ce43 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:32:00.784290 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e6044-7fec-494b-9e01-5ed94b84ce43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:32:00.784571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e6044-7fec-494b-9e01-5ed94b84ce43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:32:00.785314 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e6044-7fec-494b-9e01-5ed94b84ce43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:32:00.787159 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e6044-7fec-494b-9e01-5ed94b84ce43 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:32:00.798992 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1235/2449] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:32:00.803131 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2655a-adbd-4911-ab13-992cfce7e126 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:32:00.814012 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2655a-adbd-4911-ab13-992cfce7e126 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:32:00.819364 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd0727-9a0d-4a95-b1fe-67f9e92ffca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:32:00.820403 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd0727-9a0d-4a95-b1fe-67f9e92ffca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:32:00.820686 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd0727-9a0d-4a95-b1fe-67f9e92ffca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:32:00.820960 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd0727-9a0d-4a95-b1fe-67f9e92ffca0 admin admin] PATH_INFO: `/v3/projects/919917e3440d49e2975beb7ec7aaaa2b/users/eb281985113d45bbbbaf1a0fbc628689/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:32:00.837670 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd0727-9a0d-4a95-b1fe-67f9e92ffca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=919917e3440d49e2975beb7ec7aaaa2b, user_id=eb281985113d45bbbbaf1a0fbc628689, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:32:00.840389 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd0727-9a0d-4a95-b1fe-67f9e92ffca0 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:32:00.925159 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1215/2450] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:32:00 2022] PUT /identity/v3/projects/919917e3440d49e2975beb7ec7aaaa2b/users/eb281985113d45bbbbaf1a0fbc628689/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:32:00.929051 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e6044-7fec-494b-9e01-5ed94b84ce43 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:32:00.939253 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e6044-7fec-494b-9e01-5ed94b84ce43 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:32:00.996273 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7211b60-8c8c-40a4-8e73-458a32ec4f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:32:00.996938 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7211b60-8c8c-40a4-8e73-458a32ec4f87 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:32:00.997227 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7211b60-8c8c-40a4-8e73-458a32ec4f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:32:00.997511 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7211b60-8c8c-40a4-8e73-458a32ec4f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:32:00.998267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7211b60-8c8c-40a4-8e73-458a32ec4f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:32:00.999871 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7211b60-8c8c-40a4-8e73-458a32ec4f87 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:32:01.011392 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1236/2451] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:32:01.015432 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd0727-9a0d-4a95-b1fe-67f9e92ffca0 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:32:01.026434 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd0727-9a0d-4a95-b1fe-67f9e92ffca0 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:32:01.031052 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728b532-05c5-49ea-aab8-939e87a89671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:32:01.031922 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728b532-05c5-49ea-aab8-939e87a89671 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:32:01.032208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728b532-05c5-49ea-aab8-939e87a89671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:32:01.032488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728b532-05c5-49ea-aab8-939e87a89671 admin admin] PATH_INFO: `/v3/projects/919917e3440d49e2975beb7ec7aaaa2b/users/eb281985113d45bbbbaf1a0fbc628689/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:32:01.034490 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728b532-05c5-49ea-aab8-939e87a89671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=919917e3440d49e2975beb7ec7aaaa2b, user_id=eb281985113d45bbbbaf1a0fbc628689, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:32:01.037140 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728b532-05c5-49ea-aab8-939e87a89671 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:32:01.048048 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1216/2452] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:32:01 2022] PUT /identity/v3/projects/919917e3440d49e2975beb7ec7aaaa2b/users/eb281985113d45bbbbaf1a0fbc628689/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:32:06.367520 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c8835-fbca-4e2a-a1a9-481a77d353cc None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:32:06.368097 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c8835-fbca-4e2a-a1a9-481a77d353cc None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:32:06.368097 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c8835-fbca-4e2a-a1a9-481a77d353cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:32:06.387723 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-883c8835-fbca-4e2a-a1a9-481a77d353cc None None] MFA Rules not processed for user `1f329dcc462c425c8a9ab50e799e4edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:32:06.389306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-883c8835-fbca-4e2a-a1a9-481a77d353cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:32:06.453218 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1237/2453] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:32:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:32:08.449162 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40640fd6-8e6b-4e36-b7b3-8c09b687a2f9 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:32:08.449644 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40640fd6-8e6b-4e36-b7b3-8c09b687a2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:32:08.449753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40640fd6-8e6b-4e36-b7b3-8c09b687a2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:32:08.482726 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-40640fd6-8e6b-4e36-b7b3-8c09b687a2f9 None None] MFA Rules not processed for user `eb281985113d45bbbbaf1a0fbc628689`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:32:08.483946 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-40640fd6-8e6b-4e36-b7b3-8c09b687a2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:32:08.567972 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1217/2454] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:32:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:32:08.582336 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c8835-fbca-4e2a-a1a9-481a77d353cc None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:32:08.583151 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-883c8835-fbca-4e2a-a1a9-481a77d353cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:32:08.649888 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:32:08.678998 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c8835-fbca-4e2a-a1a9-481a77d353cc None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:32:08.684527 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813a935-ca87-4e71-9336-2331185fb9bd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '436d7cc587bc4b2a8a3242fc39876ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:32:08.685444 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813a935-ca87-4e71-9336-2331185fb9bd service glance] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:32:08.685730 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813a935-ca87-4e71-9336-2331185fb9bd service glance] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:32:08.686006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813a935-ca87-4e71-9336-2331185fb9bd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:32:08.754585 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813a935-ca87-4e71-9336-2331185fb9bd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:32:08.756036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813a935-ca87-4e71-9336-2331185fb9bd service glance] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:32:08.770458 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1238/2455] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:32:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:32:09.030745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27effd5-2694-429a-b9e1-1731e8adf93c None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:32:09.031058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27effd5-2694-429a-b9e1-1731e8adf93c None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:32:09.031327 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27effd5-2694-429a-b9e1-1731e8adf93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:32:09.082583 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d27effd5-2694-429a-b9e1-1731e8adf93c None None] MFA Rules not processed for user `063ce3b820a74d648d709ab6ac4d7be2`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:32:09.083821 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d27effd5-2694-429a-b9e1-1731e8adf93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:32:09.171150 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1218/2456] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Jul 5 21:32:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:32:09.363912 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813a935-ca87-4e71-9336-2331185fb9bd service glance] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:32:09.366856 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5813a935-ca87-4e71-9336-2331185fb9bd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:32:09.498718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813a935-ca87-4e71-9336-2331185fb9bd service glance] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:32:09.504206 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa5f7a-7613-4cfd-8af7-4187dbe9151e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '441be62a077444b9b9f78714e24a760a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:32:09.504866 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa5f7a-7613-4cfd-8af7-4187dbe9151e service swift] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:32:09.505146 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa5f7a-7613-4cfd-8af7-4187dbe9151e service swift] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:32:09.505421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa5f7a-7613-4cfd-8af7-4187dbe9151e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:32:09.514683 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa5f7a-7613-4cfd-8af7-4187dbe9151e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:32:09.516266 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa5f7a-7613-4cfd-8af7-4187dbe9151e service swift] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:32:09.525294 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1239/2457] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Jul 5 21:32:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 21:32:13.339157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d156916-4ea0-46e8-b8ed-c2bf6cfd5dfb None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:32:13.340435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d156916-4ea0-46e8-b8ed-c2bf6cfd5dfb None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:32:13.340819 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d156916-4ea0-46e8-b8ed-c2bf6cfd5dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:32:13.361494 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-8d156916-4ea0-46e8-b8ed-c2bf6cfd5dfb None None] MFA Rules not processed for user `1d9b6c63c3b249d5be97eb6f2bd928a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:32:13.362921 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8d156916-4ea0-46e8-b8ed-c2bf6cfd5dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:32:13.386477 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:32:13.450638 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1219/2458] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:32:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:32:19.521774 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=74 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:32:22.060613 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40791c-ac62-4476-9895-8404b50fea35 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:32:22.061118 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40791c-ac62-4476-9895-8404b50fea35 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:32:22.061213 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40791c-ac62-4476-9895-8404b50fea35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:32:22.079068 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-1d40791c-ac62-4476-9895-8404b50fea35 None None] MFA Rules not processed for user `b5520ffe9cbd422b9a4794dca2e5d444`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:32:22.080273 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-1d40791c-ac62-4476-9895-8404b50fea35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:32:22.087979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1240/2459] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:32:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:32:23.491975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=17 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:32:24.395172 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3861a0b-8b17-4837-8809-8e8e36d5467a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:32:24.395505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3861a0b-8b17-4837-8809-8e8e36d5467a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:32:24.396324 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3861a0b-8b17-4837-8809-8e8e36d5467a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:32:24.414278 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-a3861a0b-8b17-4837-8809-8e8e36d5467a None None] MFA Rules not processed for user `bf8ba3e86672440aa22ed3fae5d90721`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:32:24.415495 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a3861a0b-8b17-4837-8809-8e8e36d5467a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:32:24.471242 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1220/2460] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:32:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:32:25.710639 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040fa79-9e5a-41bf-9682-70080446884c None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:32:25.712867 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040fa79-9e5a-41bf-9682-70080446884c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:32:25.712867 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040fa79-9e5a-41bf-9682-70080446884c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:32:25.736303 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-5040fa79-9e5a-41bf-9682-70080446884c None None] MFA Rules not processed for user `063ce3b820a74d648d709ab6ac4d7be2`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:32:25.737549 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5040fa79-9e5a-41bf-9682-70080446884c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:32:25.748190 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1241/2461] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Jul 5 21:32:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:32:25.761537 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3861a0b-8b17-4837-8809-8e8e36d5467a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:32:25.777568 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3861a0b-8b17-4837-8809-8e8e36d5467a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:32:25.784727 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8dc09c-9f3c-4bb1-8976-706aaff886ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '441be62a077444b9b9f78714e24a760a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:32:25.785486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dc09c-9f3c-4bb1-8976-706aaff886ef service swift] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:32:25.785772 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dc09c-9f3c-4bb1-8976-706aaff886ef service swift] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:32:25.786724 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dc09c-9f3c-4bb1-8976-706aaff886ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:32:25.796001 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8dc09c-9f3c-4bb1-8976-706aaff886ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:32:25.797513 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8dc09c-9f3c-4bb1-8976-706aaff886ef service swift] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:32:25.806882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1221/2462] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Jul 5 21:32:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 21:32:35.723568 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=6 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:32:35.808613 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=31 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:32:43.281087 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65829c90-adb6-4d5b-a038-73a6d36ecb42 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:32:43.281619 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65829c90-adb6-4d5b-a038-73a6d36ecb42 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:32:43.281619 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65829c90-adb6-4d5b-a038-73a6d36ecb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:32:43.299480 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-65829c90-adb6-4d5b-a038-73a6d36ecb42 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:32:43.300706 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-65829c90-adb6-4d5b-a038-73a6d36ecb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:32:43.361905 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1242/2463] 10.222.0.39 () {58 vars in 1016 bytes} [Tue Jul 5 21:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:32:43.383672 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8dc09c-9f3c-4bb1-8976-706aaff886ef service swift] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:32:43.385074 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8a8dc09c-9f3c-4bb1-8976-706aaff886ef service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:32:43.458699 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8dc09c-9f3c-4bb1-8976-706aaff886ef service swift] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:32:43.464004 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396a535-f72f-41ef-a09e-d2e61a7e4bea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:32:43.464638 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396a535-f72f-41ef-a09e-d2e61a7e4bea service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:32:43.464916 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396a535-f72f-41ef-a09e-d2e61a7e4bea service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:32:43.465188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396a535-f72f-41ef-a09e-d2e61a7e4bea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:32:43.473240 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396a535-f72f-41ef-a09e-d2e61a7e4bea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:32:43.474962 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396a535-f72f-41ef-a09e-d2e61a7e4bea service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:32:43.484256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1222/2464] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:32:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:32:48.853613 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24321d8d-8fb5-479a-a56d-50f7e1e39ed7 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:32:48.854252 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24321d8d-8fb5-479a-a56d-50f7e1e39ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:32:48.854252 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24321d8d-8fb5-479a-a56d-50f7e1e39ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:32:48.872196 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-24321d8d-8fb5-479a-a56d-50f7e1e39ed7 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:32:48.873398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-24321d8d-8fb5-479a-a56d-50f7e1e39ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:32:48.881908 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1243/2465] 10.222.0.39 () {58 vars in 1016 bytes} [Tue Jul 5 21:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:32:48.913448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396a535-f72f-41ef-a09e-d2e61a7e4bea service nova] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:32:48.924556 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396a535-f72f-41ef-a09e-d2e61a7e4bea service nova] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:32:48.930065 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca65e7a-f48a-4067-acd6-7d1499a21040 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:32:48.930723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca65e7a-f48a-4067-acd6-7d1499a21040 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:32:48.931006 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca65e7a-f48a-4067-acd6-7d1499a21040 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:32:48.931282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca65e7a-f48a-4067-acd6-7d1499a21040 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:32:48.939517 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca65e7a-f48a-4067-acd6-7d1499a21040 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:32:48.941078 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca65e7a-f48a-4067-acd6-7d1499a21040 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:32:48.951032 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1223/2466] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:32:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:32:52.692839 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad240291-30aa-4d21-8d25-199a11307f57 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:32:52.693760 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad240291-30aa-4d21-8d25-199a11307f57 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:32:52.694055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad240291-30aa-4d21-8d25-199a11307f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:32:52.720979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-ad240291-30aa-4d21-8d25-199a11307f57 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:32:52.722402 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ad240291-30aa-4d21-8d25-199a11307f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:32:52.732221 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1244/2467] 10.222.0.39 () {58 vars in 1016 bytes} [Tue Jul 5 21:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:32:52.754667 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca65e7a-f48a-4067-acd6-7d1499a21040 service nova] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:32:52.756260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-fca65e7a-f48a-4067-acd6-7d1499a21040 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:32:52.771173 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca65e7a-f48a-4067-acd6-7d1499a21040 service nova] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:32:52.777000 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3aff19-a03e-4d83-9a51-133ccaf8c76a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:32:52.777800 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3aff19-a03e-4d83-9a51-133ccaf8c76a service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:32:52.778163 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3aff19-a03e-4d83-9a51-133ccaf8c76a service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:32:52.778448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3aff19-a03e-4d83-9a51-133ccaf8c76a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:32:52.788753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3aff19-a03e-4d83-9a51-133ccaf8c76a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:32:52.790096 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3aff19-a03e-4d83-9a51-133ccaf8c76a service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:32:52.801642 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1224/2468] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:32:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:32:55.269355 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bd444-5d41-40b9-8883-53548e4e46e4 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:32:55.269846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bd444-5d41-40b9-8883-53548e4e46e4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:32:55.269940 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bd444-5d41-40b9-8883-53548e4e46e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:32:55.287414 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-169bd444-5d41-40b9-8883-53548e4e46e4 None None] MFA Rules not processed for user `db2792db73c24a75a449894faf6fbf73`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:32:55.288630 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-169bd444-5d41-40b9-8883-53548e4e46e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:32:55.343782 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1245/2469] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:32:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:32:56.933505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727dac0-f054-47d7-b9ad-c59a46c31c3d None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:32:56.934051 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727dac0-f054-47d7-b9ad-c59a46c31c3d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:32:56.934177 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727dac0-f054-47d7-b9ad-c59a46c31c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:32:56.951999 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-9727dac0-f054-47d7-b9ad-c59a46c31c3d None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:32:56.953182 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9727dac0-f054-47d7-b9ad-c59a46c31c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:32:56.961000 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1225/2470] 10.222.0.39 () {58 vars in 1016 bytes} [Tue Jul 5 21:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:32:56.982457 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bd444-5d41-40b9-8883-53548e4e46e4 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:32:56.996093 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bd444-5d41-40b9-8883-53548e4e46e4 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:32:57.001675 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e227ea-3808-41f2-af89-98453807cf96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:32:57.002356 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e227ea-3808-41f2-af89-98453807cf96 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:32:57.002646 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e227ea-3808-41f2-af89-98453807cf96 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:32:57.002954 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e227ea-3808-41f2-af89-98453807cf96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:32:57.011801 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e227ea-3808-41f2-af89-98453807cf96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:32:57.013381 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e227ea-3808-41f2-af89-98453807cf96 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:32:57.022879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1246/2471] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:32:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:33:01.255981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727dac0-f054-47d7-b9ad-c59a46c31c3d None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:01.331434 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727dac0-f054-47d7-b9ad-c59a46c31c3d None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:01.335492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b63e7-c361-4860-b200-e48bf678dec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:01.336150 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b63e7-c361-4860-b200-e48bf678dec2 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:01.336437 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b63e7-c361-4860-b200-e48bf678dec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:01.336722 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b63e7-c361-4860-b200-e48bf678dec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:01.346759 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b63e7-c361-4860-b200-e48bf678dec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:01.348301 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b63e7-c361-4860-b200-e48bf678dec2 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:01.359259 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1226/2472] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:33:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:33:04.347268 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33430b-2678-49cc-a1e2-0b8259ffaf6a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:04.347834 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33430b-2678-49cc-a1e2-0b8259ffaf6a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:04.347834 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33430b-2678-49cc-a1e2-0b8259ffaf6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:04.368616 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-cc33430b-2678-49cc-a1e2-0b8259ffaf6a None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:33:04.370571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-cc33430b-2678-49cc-a1e2-0b8259ffaf6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:04.378469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1247/2473] 10.222.0.39 () {58 vars in 1016 bytes} [Tue Jul 5 21:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:33:04.409969 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b63e7-c361-4860-b200-e48bf678dec2 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:04.423642 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b63e7-c361-4860-b200-e48bf678dec2 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:04.430237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679a2a0-b3e8-4aaa-86a6-d8c4c286ba6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:04.430822 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679a2a0-b3e8-4aaa-86a6-d8c4c286ba6c service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:04.431104 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679a2a0-b3e8-4aaa-86a6-d8c4c286ba6c service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:04.431387 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679a2a0-b3e8-4aaa-86a6-d8c4c286ba6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:04.440309 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679a2a0-b3e8-4aaa-86a6-d8c4c286ba6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:04.441949 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679a2a0-b3e8-4aaa-86a6-d8c4c286ba6c service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:04.452865 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1227/2474] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:33:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:33:07.101590 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33430b-2678-49cc-a1e2-0b8259ffaf6a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:07.107743 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=68 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:33:07.113525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33430b-2678-49cc-a1e2-0b8259ffaf6a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:07.117727 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579161e7-e7c2-4356-94df-1fb706b07486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:07.119380 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579161e7-e7c2-4356-94df-1fb706b07486 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:07.119541 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579161e7-e7c2-4356-94df-1fb706b07486 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:07.119711 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579161e7-e7c2-4356-94df-1fb706b07486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:07.121683 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-579161e7-e7c2-4356-94df-1fb706b07486 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:07.137586 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579161e7-e7c2-4356-94df-1fb706b07486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:07.139244 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579161e7-e7c2-4356-94df-1fb706b07486 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:07.151016 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1248/2475] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:33:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:33:07.446946 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679a2a0-b3e8-4aaa-86a6-d8c4c286ba6c service nova] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:07.448499 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d679a2a0-b3e8-4aaa-86a6-d8c4c286ba6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:07.453923 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=82 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:33:07.510258 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679a2a0-b3e8-4aaa-86a6-d8c4c286ba6c service nova] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:07.513849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03243bb8-4cd0-4f9b-9c60-3cc5513cf663 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:07.514531 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03243bb8-4cd0-4f9b-9c60-3cc5513cf663 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:07.514816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03243bb8-4cd0-4f9b-9c60-3cc5513cf663 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:07.515093 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03243bb8-4cd0-4f9b-9c60-3cc5513cf663 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:07.516905 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-03243bb8-4cd0-4f9b-9c60-3cc5513cf663 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:07.531141 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03243bb8-4cd0-4f9b-9c60-3cc5513cf663 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:07.532904 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03243bb8-4cd0-4f9b-9c60-3cc5513cf663 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:07.545368 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1228/2476] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:33:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:33:17.208123 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=5 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:33:17.560474 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=25 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:33:18.972960 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579161e7-e7c2-4356-94df-1fb706b07486 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:18.984590 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579161e7-e7c2-4356-94df-1fb706b07486 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:18.990863 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a236e-7374-4631-8782-189bf1798034 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:18.991507 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a236e-7374-4631-8782-189bf1798034 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:18.991789 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a236e-7374-4631-8782-189bf1798034 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:18.992085 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a236e-7374-4631-8782-189bf1798034 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:18.994146 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-df5a236e-7374-4631-8782-189bf1798034 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:19.004553 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a236e-7374-4631-8782-189bf1798034 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:19.006432 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a236e-7374-4631-8782-189bf1798034 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:19.015585 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1249/2477] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:33:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:33:26.508637 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03243bb8-4cd0-4f9b-9c60-3cc5513cf663 service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:26.510199 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-03243bb8-4cd0-4f9b-9c60-3cc5513cf663 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:26.522662 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03243bb8-4cd0-4f9b-9c60-3cc5513cf663 service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:26.526450 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341aed01-913d-4a85-afa2-cf39cf72d86f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:26.527176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341aed01-913d-4a85-afa2-cf39cf72d86f service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:26.527355 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341aed01-913d-4a85-afa2-cf39cf72d86f service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:26.527628 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341aed01-913d-4a85-afa2-cf39cf72d86f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:26.529403 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-341aed01-913d-4a85-afa2-cf39cf72d86f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:26.542413 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341aed01-913d-4a85-afa2-cf39cf72d86f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:26.543833 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341aed01-913d-4a85-afa2-cf39cf72d86f service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:26.554461 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1229/2478] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:33:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:33:29.011792 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=6 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:33:30.188125 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a236e-7374-4631-8782-189bf1798034 service nova] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:30.189581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-df5a236e-7374-4631-8782-189bf1798034 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:30.205709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a236e-7374-4631-8782-189bf1798034 service nova] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:30.211151 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f11f83-9e75-4015-830c-be9e765215ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:30.212033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f11f83-9e75-4015-830c-be9e765215ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:30.212315 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f11f83-9e75-4015-830c-be9e765215ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:30.212589 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f11f83-9e75-4015-830c-be9e765215ba admin admin] PATH_INFO: `/v3/users/1f329dcc462c425c8a9ab50e799e4edd` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:30.213758 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f11f83-9e75-4015-830c-be9e765215ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f329dcc462c425c8a9ab50e799e4edd)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:30.215690 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f11f83-9e75-4015-830c-be9e765215ba admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:30.406878 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-28f11f83-9e75-4015-830c-be9e765215ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f329dcc462c425c8a9ab50e799e4edd'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:33:30.461400 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-28f11f83-9e75-4015-830c-be9e765215ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f329dcc462c425c8a9ab50e799e4edd'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:33:30.474672 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-28f11f83-9e75-4015-830c-be9e765215ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f329dcc462c425c8a9ab50e799e4edd'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:33:30.481609 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-28f11f83-9e75-4015-830c-be9e765215ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f329dcc462c425c8a9ab50e799e4edd'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:33:30.482324 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-28f11f83-9e75-4015-830c-be9e765215ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f329dcc462c425c8a9ab50e799e4edd'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:33:30.488885 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1250/2479] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:33:30 2022] DELETE /identity/v3/users/1f329dcc462c425c8a9ab50e799e4edd => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:33:31.013804 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341aed01-913d-4a85-afa2-cf39cf72d86f service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:31.025872 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341aed01-913d-4a85-afa2-cf39cf72d86f service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:31.086300 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3283a-86b7-4bd4-8bee-d3aee9f50e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:31.087160 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3283a-86b7-4bd4-8bee-d3aee9f50e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:31.087446 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3283a-86b7-4bd4-8bee-d3aee9f50e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:31.087724 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3283a-86b7-4bd4-8bee-d3aee9f50e9e admin admin] PATH_INFO: `/v3/projects/b8185d7c4cc047feba5a64699c26550e` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:31.088928 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3283a-86b7-4bd4-8bee-d3aee9f50e9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8185d7c4cc047feba5a64699c26550e)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:31.090885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3283a-86b7-4bd4-8bee-d3aee9f50e9e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:31.220454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-74c3283a-86b7-4bd4-8bee-d3aee9f50e9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8185d7c4cc047feba5a64699c26550e', 'request_id': 'req-74c3283a-86b7-4bd4-8bee-d3aee9f50e9e'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:33:31.227040 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-74c3283a-86b7-4bd4-8bee-d3aee9f50e9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8185d7c4cc047feba5a64699c26550e', 'request_id': 'req-74c3283a-86b7-4bd4-8bee-d3aee9f50e9e'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:33:31.312807 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-74c3283a-86b7-4bd4-8bee-d3aee9f50e9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8185d7c4cc047feba5a64699c26550e', 'request_id': 'req-74c3283a-86b7-4bd4-8bee-d3aee9f50e9e'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:33:31.328952 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-74c3283a-86b7-4bd4-8bee-d3aee9f50e9e admin admin] The token cache is being invalidate because project b8185d7c4cc047feba5a64699c26550e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:33:31.328952 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-74c3283a-86b7-4bd4-8bee-d3aee9f50e9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:33:31.328952 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-74c3283a-86b7-4bd4-8bee-d3aee9f50e9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:33:31.330598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1230/2480] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:33:31 2022] DELETE /identity/v3/projects/b8185d7c4cc047feba5a64699c26550e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:33:31.337599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf2a3a-e871-40aa-abfd-fa0c5f0c815a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:31.338514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf2a3a-e871-40aa-abfd-fa0c5f0c815a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:31.338800 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf2a3a-e871-40aa-abfd-fa0c5f0c815a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:31.359083 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-53cf2a3a-e871-40aa-abfd-fa0c5f0c815a None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:33:31.359083 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-53cf2a3a-e871-40aa-abfd-fa0c5f0c815a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:31.428494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1251/2481] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:33:31.436196 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e05e66-df83-4dff-b0be-5f22ac48fb3b None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:31.436483 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e05e66-df83-4dff-b0be-5f22ac48fb3b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:31.436760 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e05e66-df83-4dff-b0be-5f22ac48fb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:31.455061 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-a6e05e66-df83-4dff-b0be-5f22ac48fb3b None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:33:31.456280 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a6e05e66-df83-4dff-b0be-5f22ac48fb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:31.464851 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1231/2482] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:33:31.469228 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf2a3a-e871-40aa-abfd-fa0c5f0c815a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:31.480277 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf2a3a-e871-40aa-abfd-fa0c5f0c815a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:31.485073 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b3fb1-61eb-4e5a-9b1c-46352e519fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:31.485742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b3fb1-61eb-4e5a-9b1c-46352e519fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:31.486217 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b3fb1-61eb-4e5a-9b1c-46352e519fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:31.486506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b3fb1-61eb-4e5a-9b1c-46352e519fe3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:31.487238 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b3fb1-61eb-4e5a-9b1c-46352e519fe3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:33:31.487552 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b3fb1-61eb-4e5a-9b1c-46352e519fe3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:31.489185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b3fb1-61eb-4e5a-9b1c-46352e519fe3 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:31.504874 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1252/2483] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:33:31.506384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e05e66-df83-4dff-b0be-5f22ac48fb3b None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:31.515641 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e05e66-df83-4dff-b0be-5f22ac48fb3b None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:31.520895 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a7173-b38c-49e1-9b56-249684624a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:31.524815 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a7173-b38c-49e1-9b56-249684624a5c admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:31.524815 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a7173-b38c-49e1-9b56-249684624a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:31.524815 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a7173-b38c-49e1-9b56-249684624a5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:31.524815 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a7173-b38c-49e1-9b56-249684624a5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:31.525306 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a7173-b38c-49e1-9b56-249684624a5c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:31.625874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1232/2484] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:33:31 2022] POST /identity/v3/projects => generated 389 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:33:31.630710 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b3fb1-61eb-4e5a-9b1c-46352e519fe3 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:31.641468 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b3fb1-61eb-4e5a-9b1c-46352e519fe3 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:31.699953 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4900e-50a5-4151-be39-1923b3844ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:31.700631 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4900e-50a5-4151-be39-1923b3844ebe admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:31.700918 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4900e-50a5-4151-be39-1923b3844ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:31.701204 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4900e-50a5-4151-be39-1923b3844ebe admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:31.701908 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4900e-50a5-4151-be39-1923b3844ebe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:31.703880 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4900e-50a5-4151-be39-1923b3844ebe admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:31.711163 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:33:31.804289 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1253/2485] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:33:31 2022] POST /identity/v3/users => generated 295 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:33:31.805684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a7173-b38c-49e1-9b56-249684624a5c admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:31.816337 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a7173-b38c-49e1-9b56-249684624a5c admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:31.821628 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251750f-94df-411b-a616-080b2d7509ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:31.822367 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251750f-94df-411b-a616-080b2d7509ce admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:31.822652 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251750f-94df-411b-a616-080b2d7509ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:31.822931 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251750f-94df-411b-a616-080b2d7509ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:31.823664 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251750f-94df-411b-a616-080b2d7509ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:31.825273 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251750f-94df-411b-a616-080b2d7509ce admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:31.837189 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1233/2486] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:33:31.841237 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4900e-50a5-4151-be39-1923b3844ebe admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:31.851581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4900e-50a5-4151-be39-1923b3844ebe admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:31.856311 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf82080-9578-4e58-b68e-49cea1d274bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:31.856975 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf82080-9578-4e58-b68e-49cea1d274bc admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:31.857259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf82080-9578-4e58-b68e-49cea1d274bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:31.857541 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf82080-9578-4e58-b68e-49cea1d274bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:31.858317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf82080-9578-4e58-b68e-49cea1d274bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:31.859910 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf82080-9578-4e58-b68e-49cea1d274bc admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:31.871094 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1254/2487] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:33:31.875377 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251750f-94df-411b-a616-080b2d7509ce admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:31.886087 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251750f-94df-411b-a616-080b2d7509ce admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:31.890795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91818383-8c15-4a10-a0f9-9f275049c620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:31.891657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91818383-8c15-4a10-a0f9-9f275049c620 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:31.891940 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91818383-8c15-4a10-a0f9-9f275049c620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:31.892238 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91818383-8c15-4a10-a0f9-9f275049c620 admin admin] PATH_INFO: `/v3/projects/70f599a604c74db9a850bd1051d4508f/users/19a7d575957f44b8abd5dbbb18e75eb3/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:31.908138 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91818383-8c15-4a10-a0f9-9f275049c620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f599a604c74db9a850bd1051d4508f, user_id=19a7d575957f44b8abd5dbbb18e75eb3, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:31.910994 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91818383-8c15-4a10-a0f9-9f275049c620 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:32.013354 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1234/2488] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:33:31 2022] PUT /identity/v3/projects/70f599a604c74db9a850bd1051d4508f/users/19a7d575957f44b8abd5dbbb18e75eb3/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:33:32.018451 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7e07b-26df-415e-b3e6-f47c38d5f243 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:32.018749 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7e07b-26df-415e-b3e6-f47c38d5f243 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:32.019035 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7e07b-26df-415e-b3e6-f47c38d5f243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:32.036356 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-42f7e07b-26df-415e-b3e6-f47c38d5f243 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:33:32.037608 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-42f7e07b-26df-415e-b3e6-f47c38d5f243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:32.099964 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1255/2489] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:33:32.109455 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91818383-8c15-4a10-a0f9-9f275049c620 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:32.111284 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-91818383-8c15-4a10-a0f9-9f275049c620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:32.127559 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:33:32.172264 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91818383-8c15-4a10-a0f9-9f275049c620 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:32.175924 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b64e4-f00e-4a9b-9b1d-09356027a426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:32.176657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b64e4-f00e-4a9b-9b1d-09356027a426 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:32.177147 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b64e4-f00e-4a9b-9b1d-09356027a426 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:32.177434 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b64e4-f00e-4a9b-9b1d-09356027a426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:32.186723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b64e4-f00e-4a9b-9b1d-09356027a426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:32.188715 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b64e4-f00e-4a9b-9b1d-09356027a426 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:32.197501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1235/2490] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:33:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:33:36.974568 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7e07b-26df-415e-b3e6-f47c38d5f243 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:36.976610 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-42f7e07b-26df-415e-b3e6-f47c38d5f243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:37.058651 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7e07b-26df-415e-b3e6-f47c38d5f243 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:37.064221 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1ecb3-025e-42b3-baa0-5a6fd033833d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:37.064873 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1ecb3-025e-42b3-baa0-5a6fd033833d service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:37.065160 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1ecb3-025e-42b3-baa0-5a6fd033833d service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:37.065583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1ecb3-025e-42b3-baa0-5a6fd033833d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:37.074805 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-23b1ecb3-025e-42b3-baa0-5a6fd033833d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:37.171396 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b1ecb3-025e-42b3-baa0-5a6fd033833d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:37.175640 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b1ecb3-025e-42b3-baa0-5a6fd033833d service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:37.198063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1256/2491] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:33:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:33:38.189911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d1678-e6d8-4722-a5a8-c65fee738d08 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:38.190578 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d1678-e6d8-4722-a5a8-c65fee738d08 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:38.190578 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d1678-e6d8-4722-a5a8-c65fee738d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:38.247063 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-db3d1678-e6d8-4722-a5a8-c65fee738d08 None None] MFA Rules not processed for user `19a7d575957f44b8abd5dbbb18e75eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:33:38.248312 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-db3d1678-e6d8-4722-a5a8-c65fee738d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:38.350001 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1236/2492] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:33:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:33:38.367664 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1ecb3-025e-42b3-baa0-5a6fd033833d service nova] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:38.381140 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1ecb3-025e-42b3-baa0-5a6fd033833d service nova] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:38.394545 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29623ab8-7d95-47ee-a1a4-e60a24b67739 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:38.394545 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29623ab8-7d95-47ee-a1a4-e60a24b67739 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:38.394545 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29623ab8-7d95-47ee-a1a4-e60a24b67739 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:38.394545 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29623ab8-7d95-47ee-a1a4-e60a24b67739 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:38.403566 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29623ab8-7d95-47ee-a1a4-e60a24b67739 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:38.405365 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29623ab8-7d95-47ee-a1a4-e60a24b67739 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:38.417720 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1257/2493] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:33:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:33:41.225611 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ec824-5a1a-4c73-a5cd-972ee36ba8c3 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:41.230358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ec824-5a1a-4c73-a5cd-972ee36ba8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:41.230358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ec824-5a1a-4c73-a5cd-972ee36ba8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:41.252428 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-816ec824-5a1a-4c73-a5cd-972ee36ba8c3 None None] MFA Rules not processed for user `19a7d575957f44b8abd5dbbb18e75eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:33:41.254023 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-816ec824-5a1a-4c73-a5cd-972ee36ba8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:41.262343 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1237/2494] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:33:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:33:41.665388 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29623ab8-7d95-47ee-a1a4-e60a24b67739 service nova] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:41.667084 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-29623ab8-7d95-47ee-a1a4-e60a24b67739 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:41.674240 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:33:41.680366 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29623ab8-7d95-47ee-a1a4-e60a24b67739 service nova] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:41.684171 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8f42e-b239-4771-af74-68d4b9b15471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:41.684897 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8f42e-b239-4771-af74-68d4b9b15471 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:41.685257 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8f42e-b239-4771-af74-68d4b9b15471 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:41.685790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8f42e-b239-4771-af74-68d4b9b15471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:41.687796 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5df8f42e-b239-4771-af74-68d4b9b15471 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:41.698844 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8f42e-b239-4771-af74-68d4b9b15471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:41.702809 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8f42e-b239-4771-af74-68d4b9b15471 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:41.710211 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1258/2495] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:33:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:33:42.177776 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ec824-5a1a-4c73-a5cd-972ee36ba8c3 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:42.180980 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-816ec824-5a1a-4c73-a5cd-972ee36ba8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:42.285397 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ec824-5a1a-4c73-a5cd-972ee36ba8c3 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:42.291277 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63c1d9-2fe0-4083-ae41-d785157876ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992db9dab5944769b192a868d6637a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:42.292063 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63c1d9-2fe0-4083-ae41-d785157876ff service placement] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:42.292425 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63c1d9-2fe0-4083-ae41-d785157876ff service placement] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:42.293082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63c1d9-2fe0-4083-ae41-d785157876ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:42.294724 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9f63c1d9-2fe0-4083-ae41-d785157876ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:42.310902 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63c1d9-2fe0-4083-ae41-d785157876ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:42.318173 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63c1d9-2fe0-4083-ae41-d785157876ff service placement] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:42.330924 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1238/2496] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:33:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:33:45.529279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8f42e-b239-4771-af74-68d4b9b15471 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:45.530799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5df8f42e-b239-4771-af74-68d4b9b15471 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:45.552732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8f42e-b239-4771-af74-68d4b9b15471 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:45.567583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ce166-b4e4-423b-80fe-37435dc9c1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:45.568597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ce166-b4e4-423b-80fe-37435dc9c1c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:45.568982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ce166-b4e4-423b-80fe-37435dc9c1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:45.569317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ce166-b4e4-423b-80fe-37435dc9c1c6 admin admin] PATH_INFO: `/v3/users/1d9b6c63c3b249d5be97eb6f2bd928a2` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:45.570899 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ce166-b4e4-423b-80fe-37435dc9c1c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d9b6c63c3b249d5be97eb6f2bd928a2)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:45.572934 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ce166-b4e4-423b-80fe-37435dc9c1c6 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:45.746745 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-886ce166-b4e4-423b-80fe-37435dc9c1c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d9b6c63c3b249d5be97eb6f2bd928a2'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:33:45.817529 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-886ce166-b4e4-423b-80fe-37435dc9c1c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d9b6c63c3b249d5be97eb6f2bd928a2'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:33:45.833431 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-886ce166-b4e4-423b-80fe-37435dc9c1c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d9b6c63c3b249d5be97eb6f2bd928a2'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:33:45.840720 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-886ce166-b4e4-423b-80fe-37435dc9c1c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d9b6c63c3b249d5be97eb6f2bd928a2'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:33:45.841454 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-886ce166-b4e4-423b-80fe-37435dc9c1c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d9b6c63c3b249d5be97eb6f2bd928a2'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:33:45.848351 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1259/2497] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:33:45 2022] DELETE /identity/v3/users/1d9b6c63c3b249d5be97eb6f2bd928a2 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:33:46.007271 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63c1d9-2fe0-4083-ae41-d785157876ff service placement] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:46.025822 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63c1d9-2fe0-4083-ae41-d785157876ff service placement] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:46.070800 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:33:46.098179 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5880ac-1b30-4d8e-ad73-e3f93856ff7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:46.098836 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5880ac-1b30-4d8e-ad73-e3f93856ff7a service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:46.099121 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5880ac-1b30-4d8e-ad73-e3f93856ff7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:46.099398 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5880ac-1b30-4d8e-ad73-e3f93856ff7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:46.101417 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9a5880ac-1b30-4d8e-ad73-e3f93856ff7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:46.111458 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5880ac-1b30-4d8e-ad73-e3f93856ff7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:46.113517 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5880ac-1b30-4d8e-ad73-e3f93856ff7a service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:46.123271 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1239/2498] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:33:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:33:46.123447 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ce166-b4e4-423b-80fe-37435dc9c1c6 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:46.124941 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-886ce166-b4e4-423b-80fe-37435dc9c1c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:46.207775 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ce166-b4e4-423b-80fe-37435dc9c1c6 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:46.212840 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c6cfa-c353-41ab-8de9-52d06faf3162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:46.213711 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c6cfa-c353-41ab-8de9-52d06faf3162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:46.213994 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c6cfa-c353-41ab-8de9-52d06faf3162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:46.214297 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c6cfa-c353-41ab-8de9-52d06faf3162 admin admin] PATH_INFO: `/v3/projects/4231fee8fd32480a8f9346380cfe4843` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:46.215499 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c6cfa-c353-41ab-8de9-52d06faf3162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4231fee8fd32480a8f9346380cfe4843)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:46.217423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c6cfa-c353-41ab-8de9-52d06faf3162 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:46.348768 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-bb3c6cfa-c353-41ab-8de9-52d06faf3162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4231fee8fd32480a8f9346380cfe4843', 'request_id': 'req-bb3c6cfa-c353-41ab-8de9-52d06faf3162'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:33:46.420767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-bb3c6cfa-c353-41ab-8de9-52d06faf3162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4231fee8fd32480a8f9346380cfe4843', 'request_id': 'req-bb3c6cfa-c353-41ab-8de9-52d06faf3162'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:33:46.426366 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:33:46.427585 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-bb3c6cfa-c353-41ab-8de9-52d06faf3162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4231fee8fd32480a8f9346380cfe4843', 'request_id': 'req-bb3c6cfa-c353-41ab-8de9-52d06faf3162'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:33:46.438650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-bb3c6cfa-c353-41ab-8de9-52d06faf3162 admin admin] The token cache is being invalidate because project 4231fee8fd32480a8f9346380cfe4843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:33:46.438967 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-bb3c6cfa-c353-41ab-8de9-52d06faf3162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:33:46.441454 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-bb3c6cfa-c353-41ab-8de9-52d06faf3162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:33:46.441929 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1260/2499] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:33:46 2022] DELETE /identity/v3/projects/4231fee8fd32480a8f9346380cfe4843 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:33:46.446810 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb239e46-d8b4-4da7-9983-9dd2ef086369 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:46.447099 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb239e46-d8b4-4da7-9983-9dd2ef086369 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:46.447383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb239e46-d8b4-4da7-9983-9dd2ef086369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:46.470194 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-fb239e46-d8b4-4da7-9983-9dd2ef086369 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:33:46.470194 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-fb239e46-d8b4-4da7-9983-9dd2ef086369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:46.525517 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1240/2500] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:33:46.533224 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e10b8-7bd9-4f77-8b13-2731794f5165 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:46.533707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e10b8-7bd9-4f77-8b13-2731794f5165 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:46.533824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e10b8-7bd9-4f77-8b13-2731794f5165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:46.553933 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-617e10b8-7bd9-4f77-8b13-2731794f5165 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:33:46.555163 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-617e10b8-7bd9-4f77-8b13-2731794f5165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:46.563336 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1261/2501] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:33:46.568370 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb239e46-d8b4-4da7-9983-9dd2ef086369 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:46.578356 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb239e46-d8b4-4da7-9983-9dd2ef086369 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:46.584642 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19db568-fc28-4645-bf25-969e57550d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:46.584642 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19db568-fc28-4645-bf25-969e57550d44 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:46.584642 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19db568-fc28-4645-bf25-969e57550d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:46.584642 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19db568-fc28-4645-bf25-969e57550d44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:46.585297 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19db568-fc28-4645-bf25-969e57550d44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:33:46.585377 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19db568-fc28-4645-bf25-969e57550d44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:46.586984 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19db568-fc28-4645-bf25-969e57550d44 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:46.606598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1241/2502] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:33:46.618740 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e10b8-7bd9-4f77-8b13-2731794f5165 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:46.620461 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e10b8-7bd9-4f77-8b13-2731794f5165 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:46.626352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60c4e5-fcdd-4b81-a886-dfd8a44bb29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:46.627479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60c4e5-fcdd-4b81-a886-dfd8a44bb29a admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:46.627782 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60c4e5-fcdd-4b81-a886-dfd8a44bb29a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:46.627990 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60c4e5-fcdd-4b81-a886-dfd8a44bb29a admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:46.629428 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60c4e5-fcdd-4b81-a886-dfd8a44bb29a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:46.631453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60c4e5-fcdd-4b81-a886-dfd8a44bb29a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:46.763856 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1262/2503] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:33:46 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:33:46.768419 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19db568-fc28-4645-bf25-969e57550d44 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:46.781122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19db568-fc28-4645-bf25-969e57550d44 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:46.867367 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72290ff-f1ed-46ab-affd-77bf770ee189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:46.867824 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72290ff-f1ed-46ab-affd-77bf770ee189 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:46.868168 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72290ff-f1ed-46ab-affd-77bf770ee189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:46.868505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72290ff-f1ed-46ab-affd-77bf770ee189 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:46.869264 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72290ff-f1ed-46ab-affd-77bf770ee189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:46.871221 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72290ff-f1ed-46ab-affd-77bf770ee189 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:46.984233 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1242/2504] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:33:46 2022] POST /identity/v3/users => generated 287 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:33:46.988732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60c4e5-fcdd-4b81-a886-dfd8a44bb29a admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:46.999693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60c4e5-fcdd-4b81-a886-dfd8a44bb29a admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:47.005215 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7cb2c-e8bb-4275-bf9f-27e972dfc3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:47.005864 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7cb2c-e8bb-4275-bf9f-27e972dfc3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:47.006445 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7cb2c-e8bb-4275-bf9f-27e972dfc3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:47.006900 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7cb2c-e8bb-4275-bf9f-27e972dfc3a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:47.007637 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7cb2c-e8bb-4275-bf9f-27e972dfc3a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:47.009286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7cb2c-e8bb-4275-bf9f-27e972dfc3a9 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:47.024755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1263/2505] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:33:47.029205 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72290ff-f1ed-46ab-affd-77bf770ee189 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:47.036317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7cb2c-e8bb-4275-bf9f-27e972dfc3a9 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:47.038974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d3d7cb2c-e8bb-4275-bf9f-27e972dfc3a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:47.055085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72290ff-f1ed-46ab-affd-77bf770ee189 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:47.060181 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07ebdd-cf4c-4373-ba7b-de71d0a5b820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:47.061115 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07ebdd-cf4c-4373-ba7b-de71d0a5b820 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:47.061504 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07ebdd-cf4c-4373-ba7b-de71d0a5b820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:47.061829 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07ebdd-cf4c-4373-ba7b-de71d0a5b820 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:47.062611 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07ebdd-cf4c-4373-ba7b-de71d0a5b820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:47.064902 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07ebdd-cf4c-4373-ba7b-de71d0a5b820 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:47.078165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1243/2506] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:33:47.080664 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07ebdd-cf4c-4373-ba7b-de71d0a5b820 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:47.091419 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07ebdd-cf4c-4373-ba7b-de71d0a5b820 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:47.096442 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdeb42b-19e9-4576-828b-31be2537942f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:47.097396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeb42b-19e9-4576-828b-31be2537942f admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:47.097696 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeb42b-19e9-4576-828b-31be2537942f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:47.098042 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeb42b-19e9-4576-828b-31be2537942f admin admin] PATH_INFO: `/v3/projects/c35dc9956a7344e29a171d1094bb00e0/users/bc1026f8fa6e4f118062f618cce875f2/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:47.120417 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdeb42b-19e9-4576-828b-31be2537942f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c35dc9956a7344e29a171d1094bb00e0, user_id=bc1026f8fa6e4f118062f618cce875f2, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:47.123506 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdeb42b-19e9-4576-828b-31be2537942f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:47.159486 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7cb2c-e8bb-4275-bf9f-27e972dfc3a9 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:47.190034 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2461e74-7eb6-4b54-b6db-1eaf85a040f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:47.192394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2461e74-7eb6-4b54-b6db-1eaf85a040f2 service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:47.193467 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2461e74-7eb6-4b54-b6db-1eaf85a040f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:47.193764 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2461e74-7eb6-4b54-b6db-1eaf85a040f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:47.196443 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1244/2507] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:33:47 2022] PUT /identity/v3/projects/c35dc9956a7344e29a171d1094bb00e0/users/bc1026f8fa6e4f118062f618cce875f2/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:33:47.202358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303444e-957d-4f07-98d6-5a2725ed0d1c None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:47.202663 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303444e-957d-4f07-98d6-5a2725ed0d1c None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:47.202947 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303444e-957d-4f07-98d6-5a2725ed0d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:47.207498 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b2461e74-7eb6-4b54-b6db-1eaf85a040f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:47.236858 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2461e74-7eb6-4b54-b6db-1eaf85a040f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:47.238617 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2461e74-7eb6-4b54-b6db-1eaf85a040f2 service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:47.241418 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-c303444e-957d-4f07-98d6-5a2725ed0d1c None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:33:47.242699 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c303444e-957d-4f07-98d6-5a2725ed0d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:47.270167 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:33:47.270885 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1264/2508] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:33:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:33:47.326852 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1245/2509] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:33:47.337253 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2461e74-7eb6-4b54-b6db-1eaf85a040f2 service nova] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:47.339101 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b2461e74-7eb6-4b54-b6db-1eaf85a040f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:47.412467 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2461e74-7eb6-4b54-b6db-1eaf85a040f2 service nova] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:47.461814 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55411e28-fdac-41c9-a9ea-473a72b168d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:47.462502 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55411e28-fdac-41c9-a9ea-473a72b168d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:47.462793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55411e28-fdac-41c9-a9ea-473a72b168d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:47.463075 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55411e28-fdac-41c9-a9ea-473a72b168d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:47.471376 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:33:47.474815 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55411e28-fdac-41c9-a9ea-473a72b168d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:47.476569 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55411e28-fdac-41c9-a9ea-473a72b168d8 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:47.486841 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1265/2510] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:33:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:33:53.037844 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a98a2e-6448-4058-a087-4ed5f3866745 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:53.037844 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a98a2e-6448-4058-a087-4ed5f3866745 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:53.037844 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a98a2e-6448-4058-a087-4ed5f3866745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:53.070582 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-85a98a2e-6448-4058-a087-4ed5f3866745 None None] MFA Rules not processed for user `bc1026f8fa6e4f118062f618cce875f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:33:53.073042 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-85a98a2e-6448-4058-a087-4ed5f3866745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:33:53.157171 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1246/2511] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:33:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:33:53.162919 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55411e28-fdac-41c9-a9ea-473a72b168d8 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:53.176235 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55411e28-fdac-41c9-a9ea-473a72b168d8 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:53.181647 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157f621-5694-4a81-9ab0-d96ee0202468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:53.182842 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157f621-5694-4a81-9ab0-d96ee0202468 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:53.183355 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157f621-5694-4a81-9ab0-d96ee0202468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:53.183836 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157f621-5694-4a81-9ab0-d96ee0202468 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:53.184745 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157f621-5694-4a81-9ab0-d96ee0202468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:53.187126 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157f621-5694-4a81-9ab0-d96ee0202468 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:53.280378 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1266/2512] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:33:53 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:33:53.285360 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a98a2e-6448-4058-a087-4ed5f3866745 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:53.306618 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a98a2e-6448-4058-a087-4ed5f3866745 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:53.412744 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114755bd-6e48-4d04-81c3-6aceb79bc3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:53.413429 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114755bd-6e48-4d04-81c3-6aceb79bc3a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:53.414390 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114755bd-6e48-4d04-81c3-6aceb79bc3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:53.414682 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114755bd-6e48-4d04-81c3-6aceb79bc3a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:53.415542 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114755bd-6e48-4d04-81c3-6aceb79bc3a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:53.417492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114755bd-6e48-4d04-81c3-6aceb79bc3a2 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:53.526192 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1247/2513] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:33:53 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:33:53.528288 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157f621-5694-4a81-9ab0-d96ee0202468 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:53.539583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157f621-5694-4a81-9ab0-d96ee0202468 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:53.545349 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f15689-cc42-40ae-9f65-b31ef835b24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:53.546719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f15689-cc42-40ae-9f65-b31ef835b24d admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:53.547250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f15689-cc42-40ae-9f65-b31ef835b24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:53.547482 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f15689-cc42-40ae-9f65-b31ef835b24d admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:53.548387 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f15689-cc42-40ae-9f65-b31ef835b24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:53.549972 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f15689-cc42-40ae-9f65-b31ef835b24d admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:53.563944 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1267/2514] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:33:53.568290 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114755bd-6e48-4d04-81c3-6aceb79bc3a2 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:53.579125 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114755bd-6e48-4d04-81c3-6aceb79bc3a2 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:53.602165 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ac26f-1a60-4e16-a76a-03d39c06c5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:53.603072 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ac26f-1a60-4e16-a76a-03d39c06c5e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:53.603354 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ac26f-1a60-4e16-a76a-03d39c06c5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:53.603690 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ac26f-1a60-4e16-a76a-03d39c06c5e3 admin admin] PATH_INFO: `/v3/projects/540833e57abc4502bd96cb16ca20eede/users/a103297647614fd390ed26acbbba5465/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:53.625369 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ac26f-1a60-4e16-a76a-03d39c06c5e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=540833e57abc4502bd96cb16ca20eede, user_id=a103297647614fd390ed26acbbba5465, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:53.628530 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ac26f-1a60-4e16-a76a-03d39c06c5e3 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:53.731458 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1248/2515] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:33:53 2022] PUT /identity/v3/projects/540833e57abc4502bd96cb16ca20eede/users/a103297647614fd390ed26acbbba5465/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:33:53.735524 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f15689-cc42-40ae-9f65-b31ef835b24d admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:53.747554 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f15689-cc42-40ae-9f65-b31ef835b24d admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:53.814467 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7f13c-d5eb-4925-9fbf-ee368df494f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:53.816169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7f13c-d5eb-4925-9fbf-ee368df494f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:53.816452 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7f13c-d5eb-4925-9fbf-ee368df494f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:53.816724 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7f13c-d5eb-4925-9fbf-ee368df494f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:53.817458 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7f13c-d5eb-4925-9fbf-ee368df494f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:53.819140 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7f13c-d5eb-4925-9fbf-ee368df494f9 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:53.830393 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1268/2516] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:33:53.835569 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ac26f-1a60-4e16-a76a-03d39c06c5e3 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:33:53.849585 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ac26f-1a60-4e16-a76a-03d39c06c5e3 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:33:53.853275 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7b97e-4e60-4b0d-a50d-d723e58b757e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:33:53.854227 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7b97e-4e60-4b0d-a50d-d723e58b757e admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:33:53.854584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7b97e-4e60-4b0d-a50d-d723e58b757e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:33:53.854826 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7b97e-4e60-4b0d-a50d-d723e58b757e admin admin] PATH_INFO: `/v3/projects/540833e57abc4502bd96cb16ca20eede/users/a103297647614fd390ed26acbbba5465/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:33:53.856976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7b97e-4e60-4b0d-a50d-d723e58b757e admin admin] RBAC: Authorizing `identity:create_grant(project_id=540833e57abc4502bd96cb16ca20eede, user_id=a103297647614fd390ed26acbbba5465, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:33:53.865450 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7b97e-4e60-4b0d-a50d-d723e58b757e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:33:53.890290 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:33:53.905816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1249/2517] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:33:53 2022] PUT /identity/v3/projects/540833e57abc4502bd96cb16ca20eede/users/a103297647614fd390ed26acbbba5465/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:34:00.168459 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7f13c-d5eb-4925-9fbf-ee368df494f9 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:00.329005 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7f13c-d5eb-4925-9fbf-ee368df494f9 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:00.445686 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:00.466553 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a623bb-daf0-43e1-b04d-e1f7693ef1ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:00.467413 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a623bb-daf0-43e1-b04d-e1f7693ef1ea service nova] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:00.467804 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a623bb-daf0-43e1-b04d-e1f7693ef1ea service nova] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:00.468796 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a623bb-daf0-43e1-b04d-e1f7693ef1ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:00.471580 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-96a623bb-daf0-43e1-b04d-e1f7693ef1ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:00.488164 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a623bb-daf0-43e1-b04d-e1f7693ef1ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:00.490936 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a623bb-daf0-43e1-b04d-e1f7693ef1ea service nova] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:00.505464 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1269/2518] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:34:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:34:01.449242 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7b97e-4e60-4b0d-a50d-d723e58b757e admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:01.450919 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ecd7b97e-4e60-4b0d-a50d-d723e58b757e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:01.480257 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7b97e-4e60-4b0d-a50d-d723e58b757e admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:01.492847 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c0ccb-621b-4f03-8e5e-ee6699130478 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:01.493509 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c0ccb-621b-4f03-8e5e-ee6699130478 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:01.494270 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c0ccb-621b-4f03-8e5e-ee6699130478 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:01.494270 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c0ccb-621b-4f03-8e5e-ee6699130478 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:01.498343 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8d0c0ccb-621b-4f03-8e5e-ee6699130478 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:01.648461 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c0ccb-621b-4f03-8e5e-ee6699130478 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:01.650168 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c0ccb-621b-4f03-8e5e-ee6699130478 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:01.679852 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1250/2519] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:34:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:34:01.983824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170a71e-a7ff-4ff0-8d79-e6fe812af286 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:01.984315 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170a71e-a7ff-4ff0-8d79-e6fe812af286 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:01.984400 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170a71e-a7ff-4ff0-8d79-e6fe812af286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:02.022935 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-a170a71e-a7ff-4ff0-8d79-e6fe812af286 None None] MFA Rules not processed for user `a103297647614fd390ed26acbbba5465`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:34:02.025084 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a170a71e-a7ff-4ff0-8d79-e6fe812af286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:02.118177 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1270/2520] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:34:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:34:02.132779 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c0ccb-621b-4f03-8e5e-ee6699130478 service nova] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:02.146479 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c0ccb-621b-4f03-8e5e-ee6699130478 service nova] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:02.153128 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2a09e-f755-4128-a541-80a79ddc1869 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:02.154168 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2a09e-f755-4128-a541-80a79ddc1869 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:02.154653 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2a09e-f755-4128-a541-80a79ddc1869 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:02.155108 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2a09e-f755-4128-a541-80a79ddc1869 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:02.233120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2a09e-f755-4128-a541-80a79ddc1869 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:02.236999 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2a09e-f755-4128-a541-80a79ddc1869 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:02.248031 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1251/2521] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:34:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:34:05.514907 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170a71e-a7ff-4ff0-8d79-e6fe812af286 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:05.519250 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a36123-dd48-482e-af18-9cc7b0edc6cc None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:05.520160 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a36123-dd48-482e-af18-9cc7b0edc6cc None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:05.520749 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a36123-dd48-482e-af18-9cc7b0edc6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:05.546357 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-65a36123-dd48-482e-af18-9cc7b0edc6cc None None] MFA Rules not processed for user `bc1026f8fa6e4f118062f618cce875f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:34:05.547819 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-65a36123-dd48-482e-af18-9cc7b0edc6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:05.561285 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1252/2522] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:34:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:34:05.652256 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170a71e-a7ff-4ff0-8d79-e6fe812af286 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:05.656257 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9664a-4906-4c1c-a66e-93646b5a945a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:05.658536 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9664a-4906-4c1c-a66e-93646b5a945a service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:05.659064 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9664a-4906-4c1c-a66e-93646b5a945a service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:05.660180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9664a-4906-4c1c-a66e-93646b5a945a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:05.663751 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6bf9664a-4906-4c1c-a66e-93646b5a945a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:05.757428 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9664a-4906-4c1c-a66e-93646b5a945a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:05.758975 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9664a-4906-4c1c-a66e-93646b5a945a service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:05.770597 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1271/2523] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:34:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:34:10.018209 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a36123-dd48-482e-af18-9cc7b0edc6cc None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:10.020050 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-65a36123-dd48-482e-af18-9cc7b0edc6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:10.035046 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a36123-dd48-482e-af18-9cc7b0edc6cc None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:10.040499 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bf824-dc5f-41a9-b06c-5f17e7198989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:10.041448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bf824-dc5f-41a9-b06c-5f17e7198989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:10.041806 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bf824-dc5f-41a9-b06c-5f17e7198989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:10.042243 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bf824-dc5f-41a9-b06c-5f17e7198989 admin admin] PATH_INFO: `/v3/users/bf8ba3e86672440aa22ed3fae5d90721` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:10.043487 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bf824-dc5f-41a9-b06c-5f17e7198989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf8ba3e86672440aa22ed3fae5d90721)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:10.045506 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bf824-dc5f-41a9-b06c-5f17e7198989 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:10.241816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-be2bf824-dc5f-41a9-b06c-5f17e7198989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf8ba3e86672440aa22ed3fae5d90721'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:10.252203 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-be2bf824-dc5f-41a9-b06c-5f17e7198989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf8ba3e86672440aa22ed3fae5d90721'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:10.263613 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-be2bf824-dc5f-41a9-b06c-5f17e7198989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf8ba3e86672440aa22ed3fae5d90721'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:10.264352 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-be2bf824-dc5f-41a9-b06c-5f17e7198989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf8ba3e86672440aa22ed3fae5d90721'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:10.324269 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-be2bf824-dc5f-41a9-b06c-5f17e7198989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf8ba3e86672440aa22ed3fae5d90721'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:10.328404 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:10.332480 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1253/2524] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:34:10 2022] DELETE /identity/v3/users/bf8ba3e86672440aa22ed3fae5d90721 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:34:10.565444 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9664a-4906-4c1c-a66e-93646b5a945a service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:10.576583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9664a-4906-4c1c-a66e-93646b5a945a service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:10.590850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:10.638946 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab6a8c-025e-4e1a-a8c8-f1d0556e2e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:10.639726 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab6a8c-025e-4e1a-a8c8-f1d0556e2e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:10.640007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab6a8c-025e-4e1a-a8c8-f1d0556e2e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:10.640282 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab6a8c-025e-4e1a-a8c8-f1d0556e2e0a admin admin] PATH_INFO: `/v3/projects/243cd73659c3454fb5724cfb6900807c` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:10.641461 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab6a8c-025e-4e1a-a8c8-f1d0556e2e0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=243cd73659c3454fb5724cfb6900807c)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:10.643958 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab6a8c-025e-4e1a-a8c8-f1d0556e2e0a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:10.781177 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-bdab6a8c-025e-4e1a-a8c8-f1d0556e2e0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '243cd73659c3454fb5724cfb6900807c', 'request_id': 'req-bdab6a8c-025e-4e1a-a8c8-f1d0556e2e0a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:10.906639 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-bdab6a8c-025e-4e1a-a8c8-f1d0556e2e0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '243cd73659c3454fb5724cfb6900807c', 'request_id': 'req-bdab6a8c-025e-4e1a-a8c8-f1d0556e2e0a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:10.913666 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-bdab6a8c-025e-4e1a-a8c8-f1d0556e2e0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '243cd73659c3454fb5724cfb6900807c', 'request_id': 'req-bdab6a8c-025e-4e1a-a8c8-f1d0556e2e0a'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:10.924969 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-bdab6a8c-025e-4e1a-a8c8-f1d0556e2e0a admin admin] The token cache is being invalidate because project 243cd73659c3454fb5724cfb6900807c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:34:10.925255 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-bdab6a8c-025e-4e1a-a8c8-f1d0556e2e0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:10.925895 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-bdab6a8c-025e-4e1a-a8c8-f1d0556e2e0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:10.927438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1272/2525] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:34:10 2022] DELETE /identity/v3/projects/243cd73659c3454fb5724cfb6900807c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:34:10.932522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291a437-1214-4ba8-b635-29a5e1fdf42e None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:10.932808 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291a437-1214-4ba8-b635-29a5e1fdf42e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:10.933182 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291a437-1214-4ba8-b635-29a5e1fdf42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:10.952888 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-1291a437-1214-4ba8-b635-29a5e1fdf42e None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:34:10.954094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1291a437-1214-4ba8-b635-29a5e1fdf42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:11.015946 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1254/2526] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:34:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:34:11.025231 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64ebba-bd22-4a32-9e2b-c1b552929c2c None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:11.025528 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64ebba-bd22-4a32-9e2b-c1b552929c2c None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:11.025809 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64ebba-bd22-4a32-9e2b-c1b552929c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:11.044322 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-9a64ebba-bd22-4a32-9e2b-c1b552929c2c None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:34:11.045543 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-9a64ebba-bd22-4a32-9e2b-c1b552929c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:11.053591 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1273/2527] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:34:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:34:11.058352 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291a437-1214-4ba8-b635-29a5e1fdf42e None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:11.069105 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291a437-1214-4ba8-b635-29a5e1fdf42e None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:11.074151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4e492-9098-4f90-9983-1b1e518a424a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:11.074895 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4e492-9098-4f90-9983-1b1e518a424a admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:11.075178 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4e492-9098-4f90-9983-1b1e518a424a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:11.075534 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4e492-9098-4f90-9983-1b1e518a424a admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:11.076447 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4e492-9098-4f90-9983-1b1e518a424a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:34:11.076756 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4e492-9098-4f90-9983-1b1e518a424a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:11.078847 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4e492-9098-4f90-9983-1b1e518a424a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:11.091734 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1255/2528] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:34:11.097260 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64ebba-bd22-4a32-9e2b-c1b552929c2c None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:11.107219 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64ebba-bd22-4a32-9e2b-c1b552929c2c None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:11.112557 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9bf90-37fa-4633-bed0-eedefe12a705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:11.113233 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9bf90-37fa-4633-bed0-eedefe12a705 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:11.113516 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9bf90-37fa-4633-bed0-eedefe12a705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:11.113794 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9bf90-37fa-4633-bed0-eedefe12a705 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:11.114533 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9bf90-37fa-4633-bed0-eedefe12a705 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:11.116702 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9bf90-37fa-4633-bed0-eedefe12a705 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:11.200059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1274/2529] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:34:11 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:34:11.204150 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4e492-9098-4f90-9983-1b1e518a424a admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:11.215898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4e492-9098-4f90-9983-1b1e518a424a admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:11.274325 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43610483-422a-468c-8e69-32d863e8f770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:11.274993 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43610483-422a-468c-8e69-32d863e8f770 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:11.275284 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43610483-422a-468c-8e69-32d863e8f770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:11.275572 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43610483-422a-468c-8e69-32d863e8f770 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:11.276263 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43610483-422a-468c-8e69-32d863e8f770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:11.278220 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43610483-422a-468c-8e69-32d863e8f770 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:11.386850 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1256/2530] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:34:11 2022] POST /identity/v3/users => generated 283 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:34:11.390361 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9bf90-37fa-4633-bed0-eedefe12a705 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:11.403501 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9bf90-37fa-4633-bed0-eedefe12a705 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:11.408445 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e56559-a201-4af5-aa89-4df74966fe0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:11.409258 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e56559-a201-4af5-aa89-4df74966fe0f admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:11.409737 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e56559-a201-4af5-aa89-4df74966fe0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:11.410203 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e56559-a201-4af5-aa89-4df74966fe0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:11.411124 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e56559-a201-4af5-aa89-4df74966fe0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:11.412768 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e56559-a201-4af5-aa89-4df74966fe0f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:11.423593 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1275/2531] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:34:11.428370 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43610483-422a-468c-8e69-32d863e8f770 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:11.438737 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43610483-422a-468c-8e69-32d863e8f770 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:11.444072 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1f248-9d7f-4389-87b4-fbb433f4e5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:11.444731 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1f248-9d7f-4389-87b4-fbb433f4e5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:11.445011 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1f248-9d7f-4389-87b4-fbb433f4e5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:11.445287 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1f248-9d7f-4389-87b4-fbb433f4e5d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:11.446004 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1f248-9d7f-4389-87b4-fbb433f4e5d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:11.447633 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1f248-9d7f-4389-87b4-fbb433f4e5d0 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:11.459101 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1257/2532] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:34:11.463379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e56559-a201-4af5-aa89-4df74966fe0f admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:11.474396 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e56559-a201-4af5-aa89-4df74966fe0f admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:11.479223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f70a58-d5bd-4c6f-8f97-a4eb59b23d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:11.480105 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f70a58-d5bd-4c6f-8f97-a4eb59b23d79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:11.480592 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f70a58-d5bd-4c6f-8f97-a4eb59b23d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:11.480732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f70a58-d5bd-4c6f-8f97-a4eb59b23d79 admin admin] PATH_INFO: `/v3/projects/2b8a3ba1e6d9443bbef4618324cd930f/users/cb4ec1b6ad1d47f5b360a15a79e46ab9/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:11.499310 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f70a58-d5bd-4c6f-8f97-a4eb59b23d79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b8a3ba1e6d9443bbef4618324cd930f, user_id=cb4ec1b6ad1d47f5b360a15a79e46ab9, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:11.501247 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f70a58-d5bd-4c6f-8f97-a4eb59b23d79 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:11.587956 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1276/2533] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:34:11 2022] PUT /identity/v3/projects/2b8a3ba1e6d9443bbef4618324cd930f/users/cb4ec1b6ad1d47f5b360a15a79e46ab9/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:34:11.599102 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badd119-916f-4064-a4cc-a6752808d44b None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:11.599394 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badd119-916f-4064-a4cc-a6752808d44b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:11.599674 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badd119-916f-4064-a4cc-a6752808d44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:11.628178 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-9badd119-916f-4064-a4cc-a6752808d44b None None] MFA Rules not processed for user `cb4ec1b6ad1d47f5b360a15a79e46ab9`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:34:11.629717 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9badd119-916f-4064-a4cc-a6752808d44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:11.686645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:11.699108 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1258/2534] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:34:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:34:11.703778 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f70a58-d5bd-4c6f-8f97-a4eb59b23d79 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:11.752389 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:11.769690 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f70a58-d5bd-4c6f-8f97-a4eb59b23d79 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:11.774792 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a740c-1839-426f-9f8f-bfe9005fb907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:11.775455 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a740c-1839-426f-9f8f-bfe9005fb907 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:11.775889 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a740c-1839-426f-9f8f-bfe9005fb907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:11.776171 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a740c-1839-426f-9f8f-bfe9005fb907 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:11.776862 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a740c-1839-426f-9f8f-bfe9005fb907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:11.778818 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a740c-1839-426f-9f8f-bfe9005fb907 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:11.912850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1277/2535] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:34:11 2022] POST /identity/v3/projects => generated 363 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:34:11.916980 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9badd119-916f-4064-a4cc-a6752808d44b None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:11.928190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9badd119-916f-4064-a4cc-a6752808d44b None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:11.990820 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1654eb-187f-40ab-8cc8-4cd7b2f7880b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:11.991493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1654eb-187f-40ab-8cc8-4cd7b2f7880b admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:11.994657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1654eb-187f-40ab-8cc8-4cd7b2f7880b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:11.994657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1654eb-187f-40ab-8cc8-4cd7b2f7880b admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:11.994657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1654eb-187f-40ab-8cc8-4cd7b2f7880b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:11.994657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1654eb-187f-40ab-8cc8-4cd7b2f7880b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:12.065453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1259/2536] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:34:11 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:34:12.069810 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a740c-1839-426f-9f8f-bfe9005fb907 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:12.080289 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a740c-1839-426f-9f8f-bfe9005fb907 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:12.086889 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14df77-fd61-48c3-8fde-7af4501ceb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:12.087628 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14df77-fd61-48c3-8fde-7af4501ceb20 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:12.087921 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14df77-fd61-48c3-8fde-7af4501ceb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:12.088227 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14df77-fd61-48c3-8fde-7af4501ceb20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:12.088967 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14df77-fd61-48c3-8fde-7af4501ceb20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:12.090659 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14df77-fd61-48c3-8fde-7af4501ceb20 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:12.102582 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1278/2537] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:34:12.111944 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1654eb-187f-40ab-8cc8-4cd7b2f7880b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:12.123942 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1654eb-187f-40ab-8cc8-4cd7b2f7880b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:12.129066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435adec4-cb4d-41f4-9722-07baa03d5917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:12.129950 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435adec4-cb4d-41f4-9722-07baa03d5917 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:12.130253 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435adec4-cb4d-41f4-9722-07baa03d5917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:12.130528 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435adec4-cb4d-41f4-9722-07baa03d5917 admin admin] PATH_INFO: `/v3/projects/2392c04a9f274c63a7ca4cbba6e1925c/users/4dee11a47a7743ed83c498c0f627ab99/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:12.146745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435adec4-cb4d-41f4-9722-07baa03d5917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2392c04a9f274c63a7ca4cbba6e1925c, user_id=4dee11a47a7743ed83c498c0f627ab99, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:12.149472 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435adec4-cb4d-41f4-9722-07baa03d5917 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:12.236568 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1260/2538] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:34:12 2022] PUT /identity/v3/projects/2392c04a9f274c63a7ca4cbba6e1925c/users/4dee11a47a7743ed83c498c0f627ab99/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:34:12.240871 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14df77-fd61-48c3-8fde-7af4501ceb20 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:12.251880 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14df77-fd61-48c3-8fde-7af4501ceb20 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:12.309797 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842af8f-76be-474b-a33e-d63a156d51cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:12.310493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842af8f-76be-474b-a33e-d63a156d51cd admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:12.310782 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842af8f-76be-474b-a33e-d63a156d51cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:12.311063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842af8f-76be-474b-a33e-d63a156d51cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:12.311794 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842af8f-76be-474b-a33e-d63a156d51cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:12.313426 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842af8f-76be-474b-a33e-d63a156d51cd admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:12.323776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1279/2539] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:34:12.327881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435adec4-cb4d-41f4-9722-07baa03d5917 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:12.338644 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435adec4-cb4d-41f4-9722-07baa03d5917 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:12.343352 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0ec50-e1b5-4552-a02f-8971f818a8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:12.344225 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0ec50-e1b5-4552-a02f-8971f818a8ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:12.344510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0ec50-e1b5-4552-a02f-8971f818a8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:12.344787 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0ec50-e1b5-4552-a02f-8971f818a8ec admin admin] PATH_INFO: `/v3/projects/2392c04a9f274c63a7ca4cbba6e1925c/users/4dee11a47a7743ed83c498c0f627ab99/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:12.347441 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0ec50-e1b5-4552-a02f-8971f818a8ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=2392c04a9f274c63a7ca4cbba6e1925c, user_id=4dee11a47a7743ed83c498c0f627ab99, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:12.350100 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0ec50-e1b5-4552-a02f-8971f818a8ec admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:12.360996 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1261/2540] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:34:12 2022] PUT /identity/v3/projects/2392c04a9f274c63a7ca4cbba6e1925c/users/4dee11a47a7743ed83c498c0f627ab99/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:34:12.372477 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb2f03-a1da-45e6-93ed-3bbfc16b699b None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:12.372782 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb2f03-a1da-45e6-93ed-3bbfc16b699b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:12.373064 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb2f03-a1da-45e6-93ed-3bbfc16b699b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:12.402281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-27cb2f03-a1da-45e6-93ed-3bbfc16b699b None None] MFA Rules not processed for user `4dee11a47a7743ed83c498c0f627ab99`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:34:12.403523 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-27cb2f03-a1da-45e6-93ed-3bbfc16b699b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:12.479477 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1280/2541] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:34:12 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:34:12.492993 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0ec50-e1b5-4552-a02f-8971f818a8ec admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:12.494767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-7bf0ec50-e1b5-4552-a02f-8971f818a8ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:12.563397 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0ec50-e1b5-4552-a02f-8971f818a8ec admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:12.567609 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc987b-2894-497e-b210-954b632c9022 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:12.572679 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc987b-2894-497e-b210-954b632c9022 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:12.573017 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc987b-2894-497e-b210-954b632c9022 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:12.573295 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc987b-2894-497e-b210-954b632c9022 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:12.585351 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc987b-2894-497e-b210-954b632c9022 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:12.586980 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc987b-2894-497e-b210-954b632c9022 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:12.605917 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1262/2542] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:34:12 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:34:13.776626 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb2f03-a1da-45e6-93ed-3bbfc16b699b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:13.848437 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:13.874977 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb2f03-a1da-45e6-93ed-3bbfc16b699b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:13.880571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714b43c-883d-4bbc-a29b-4fa503a92a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:13.881486 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714b43c-883d-4bbc-a29b-4fa503a92a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:13.882052 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714b43c-883d-4bbc-a29b-4fa503a92a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:13.882435 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714b43c-883d-4bbc-a29b-4fa503a92a3b admin admin] PATH_INFO: `/v3/users/cb4ec1b6ad1d47f5b360a15a79e46ab9` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:13.883698 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714b43c-883d-4bbc-a29b-4fa503a92a3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb4ec1b6ad1d47f5b360a15a79e46ab9)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:13.885697 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714b43c-883d-4bbc-a29b-4fa503a92a3b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:14.138654 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3714b43c-883d-4bbc-a29b-4fa503a92a3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb4ec1b6ad1d47f5b360a15a79e46ab9'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:14.232793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3714b43c-883d-4bbc-a29b-4fa503a92a3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb4ec1b6ad1d47f5b360a15a79e46ab9'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:14.250243 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3714b43c-883d-4bbc-a29b-4fa503a92a3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb4ec1b6ad1d47f5b360a15a79e46ab9'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:14.258294 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3714b43c-883d-4bbc-a29b-4fa503a92a3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb4ec1b6ad1d47f5b360a15a79e46ab9'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:14.259482 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3714b43c-883d-4bbc-a29b-4fa503a92a3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb4ec1b6ad1d47f5b360a15a79e46ab9'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:14.267131 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1281/2543] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:34:13 2022] DELETE /identity/v3/users/cb4ec1b6ad1d47f5b360a15a79e46ab9 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:34:14.272425 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385303f7-40ac-4258-b8b2-89d1beec1406 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:14.273263 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385303f7-40ac-4258-b8b2-89d1beec1406 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:14.273263 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385303f7-40ac-4258-b8b2-89d1beec1406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:14.292041 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-385303f7-40ac-4258-b8b2-89d1beec1406 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:34:14.293259 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-385303f7-40ac-4258-b8b2-89d1beec1406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:14.344946 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:14.364394 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1263/2544] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:34:14.374760 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714b43c-883d-4bbc-a29b-4fa503a92a3b admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:14.376183 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3714b43c-883d-4bbc-a29b-4fa503a92a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:14.438482 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714b43c-883d-4bbc-a29b-4fa503a92a3b admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:14.442967 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1e212-5d54-43f8-8094-01cf5acab411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:14.443617 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1e212-5d54-43f8-8094-01cf5acab411 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:14.443891 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1e212-5d54-43f8-8094-01cf5acab411 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:14.444166 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1e212-5d54-43f8-8094-01cf5acab411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:14.457891 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1e212-5d54-43f8-8094-01cf5acab411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:14.459659 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1e212-5d54-43f8-8094-01cf5acab411 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:14.470923 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1282/2545] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:34:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:34:14.906396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385303f7-40ac-4258-b8b2-89d1beec1406 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:14.907979 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-385303f7-40ac-4258-b8b2-89d1beec1406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:14.921453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385303f7-40ac-4258-b8b2-89d1beec1406 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:14.927215 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7b501-09d7-48be-9496-598d34bda697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:14.928079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7b501-09d7-48be-9496-598d34bda697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:14.928365 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7b501-09d7-48be-9496-598d34bda697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:14.928648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7b501-09d7-48be-9496-598d34bda697 admin admin] PATH_INFO: `/v3/projects/2b8a3ba1e6d9443bbef4618324cd930f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:14.929853 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7b501-09d7-48be-9496-598d34bda697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b8a3ba1e6d9443bbef4618324cd930f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:14.931828 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7b501-09d7-48be-9496-598d34bda697 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:15.091745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4ee7b501-09d7-48be-9496-598d34bda697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b8a3ba1e6d9443bbef4618324cd930f', 'request_id': 'req-4ee7b501-09d7-48be-9496-598d34bda697'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:15.099096 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4ee7b501-09d7-48be-9496-598d34bda697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b8a3ba1e6d9443bbef4618324cd930f', 'request_id': 'req-4ee7b501-09d7-48be-9496-598d34bda697'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:15.152481 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4ee7b501-09d7-48be-9496-598d34bda697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b8a3ba1e6d9443bbef4618324cd930f', 'request_id': 'req-4ee7b501-09d7-48be-9496-598d34bda697'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:15.164814 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4ee7b501-09d7-48be-9496-598d34bda697 admin admin] The token cache is being invalidate because project 2b8a3ba1e6d9443bbef4618324cd930f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:34:15.165109 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4ee7b501-09d7-48be-9496-598d34bda697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:15.169456 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-4ee7b501-09d7-48be-9496-598d34bda697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:15.169456 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1264/2546] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:34:14 2022] DELETE /identity/v3/projects/2b8a3ba1e6d9443bbef4618324cd930f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:34:15.171689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1e212-5d54-43f8-8094-01cf5acab411 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:15.182087 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1e212-5d54-43f8-8094-01cf5acab411 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:15.248284 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950509b-9a36-438d-80fe-be29a4a79805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:15.249183 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950509b-9a36-438d-80fe-be29a4a79805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:15.249462 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950509b-9a36-438d-80fe-be29a4a79805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:15.249739 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950509b-9a36-438d-80fe-be29a4a79805 admin admin] PATH_INFO: `/v3/users/4dee11a47a7743ed83c498c0f627ab99` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:15.250978 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950509b-9a36-438d-80fe-be29a4a79805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dee11a47a7743ed83c498c0f627ab99)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:15.253931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950509b-9a36-438d-80fe-be29a4a79805 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:15.255875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:15.446541 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3950509b-9a36-438d-80fe-be29a4a79805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dee11a47a7743ed83c498c0f627ab99'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:15.522350 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3950509b-9a36-438d-80fe-be29a4a79805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dee11a47a7743ed83c498c0f627ab99'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:15.536361 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3950509b-9a36-438d-80fe-be29a4a79805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dee11a47a7743ed83c498c0f627ab99'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:15.543305 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3950509b-9a36-438d-80fe-be29a4a79805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dee11a47a7743ed83c498c0f627ab99'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:15.544053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3950509b-9a36-438d-80fe-be29a4a79805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dee11a47a7743ed83c498c0f627ab99'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:15.551991 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1283/2547] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:34:15 2022] DELETE /identity/v3/users/4dee11a47a7743ed83c498c0f627ab99 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:34:16.015178 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7b501-09d7-48be-9496-598d34bda697 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:16.016644 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4ee7b501-09d7-48be-9496-598d34bda697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:16.033529 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7b501-09d7-48be-9496-598d34bda697 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:16.096333 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9634b1-7ea4-40ad-851f-b40a3caf977b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:16.097931 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9634b1-7ea4-40ad-851f-b40a3caf977b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:16.098251 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9634b1-7ea4-40ad-851f-b40a3caf977b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:16.098530 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9634b1-7ea4-40ad-851f-b40a3caf977b admin admin] PATH_INFO: `/v3/projects/2392c04a9f274c63a7ca4cbba6e1925c` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:16.099732 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9634b1-7ea4-40ad-851f-b40a3caf977b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2392c04a9f274c63a7ca4cbba6e1925c)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:16.101657 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9634b1-7ea4-40ad-851f-b40a3caf977b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:16.235359 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8c9634b1-7ea4-40ad-851f-b40a3caf977b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2392c04a9f274c63a7ca4cbba6e1925c', 'request_id': 'req-8c9634b1-7ea4-40ad-851f-b40a3caf977b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:16.241216 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8c9634b1-7ea4-40ad-851f-b40a3caf977b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2392c04a9f274c63a7ca4cbba6e1925c', 'request_id': 'req-8c9634b1-7ea4-40ad-851f-b40a3caf977b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:16.344154 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8c9634b1-7ea4-40ad-851f-b40a3caf977b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2392c04a9f274c63a7ca4cbba6e1925c', 'request_id': 'req-8c9634b1-7ea4-40ad-851f-b40a3caf977b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:16.355956 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8c9634b1-7ea4-40ad-851f-b40a3caf977b admin admin] The token cache is being invalidate because project 2392c04a9f274c63a7ca4cbba6e1925c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:34:16.356247 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8c9634b1-7ea4-40ad-851f-b40a3caf977b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:16.356869 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8c9634b1-7ea4-40ad-851f-b40a3caf977b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:16.358535 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1265/2548] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:34:16 2022] DELETE /identity/v3/projects/2392c04a9f274c63a7ca4cbba6e1925c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:34:16.364146 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672e707-8174-40d7-b9f0-db150cb888c0 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:16.364654 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672e707-8174-40d7-b9f0-db150cb888c0 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:16.364764 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672e707-8174-40d7-b9f0-db150cb888c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:16.384657 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e672e707-8174-40d7-b9f0-db150cb888c0 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:34:16.385865 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e672e707-8174-40d7-b9f0-db150cb888c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:16.447626 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1284/2549] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:34:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:34:16.455634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5d788-033c-4959-9793-5a354275155b None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:16.456532 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5d788-033c-4959-9793-5a354275155b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:16.456817 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5d788-033c-4959-9793-5a354275155b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:16.463235 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:16.476646 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-9ea5d788-033c-4959-9793-5a354275155b None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:34:16.477796 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9ea5d788-033c-4959-9793-5a354275155b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:16.486370 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1266/2550] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:34:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:34:16.491771 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672e707-8174-40d7-b9f0-db150cb888c0 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:16.501842 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672e707-8174-40d7-b9f0-db150cb888c0 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:16.507745 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbf25f-c2e2-4e0b-868f-6de7057b32e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:16.508465 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbf25f-c2e2-4e0b-868f-6de7057b32e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:16.508772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbf25f-c2e2-4e0b-868f-6de7057b32e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:16.509051 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbf25f-c2e2-4e0b-868f-6de7057b32e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:16.509776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbf25f-c2e2-4e0b-868f-6de7057b32e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:34:16.510130 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbf25f-c2e2-4e0b-868f-6de7057b32e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:16.514668 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbf25f-c2e2-4e0b-868f-6de7057b32e9 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:16.524540 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1285/2551] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:34:16.528832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5d788-033c-4959-9793-5a354275155b None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:16.538093 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5d788-033c-4959-9793-5a354275155b None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:16.542810 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5729e-6e5f-4c36-bb49-9275c7d2b2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:16.543448 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5729e-6e5f-4c36-bb49-9275c7d2b2ce admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:16.543726 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5729e-6e5f-4c36-bb49-9275c7d2b2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:16.544829 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5729e-6e5f-4c36-bb49-9275c7d2b2ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:16.545639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5729e-6e5f-4c36-bb49-9275c7d2b2ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:16.547858 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5729e-6e5f-4c36-bb49-9275c7d2b2ce admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:16.668520 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1267/2552] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:34:16 2022] POST /identity/v3/projects => generated 355 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:34:16.672656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbf25f-c2e2-4e0b-868f-6de7057b32e9 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:16.683318 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbf25f-c2e2-4e0b-868f-6de7057b32e9 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:16.739138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc28cb-7d82-4e49-a4b3-47578de37822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:16.739719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc28cb-7d82-4e49-a4b3-47578de37822 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:16.740269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc28cb-7d82-4e49-a4b3-47578de37822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:16.740545 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc28cb-7d82-4e49-a4b3-47578de37822 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:16.741230 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc28cb-7d82-4e49-a4b3-47578de37822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:16.743164 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc28cb-7d82-4e49-a4b3-47578de37822 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:16.878203 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:16.884263 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1286/2553] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:34:16 2022] POST /identity/v3/users => generated 278 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:34:16.888438 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5729e-6e5f-4c36-bb49-9275c7d2b2ce admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:16.898703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5729e-6e5f-4c36-bb49-9275c7d2b2ce admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:16.903227 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055d3f7-9335-42e8-9638-4d2dc53a1952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:16.903874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055d3f7-9335-42e8-9638-4d2dc53a1952 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:16.904159 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055d3f7-9335-42e8-9638-4d2dc53a1952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:16.904439 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055d3f7-9335-42e8-9638-4d2dc53a1952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:16.905237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055d3f7-9335-42e8-9638-4d2dc53a1952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:16.906891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055d3f7-9335-42e8-9638-4d2dc53a1952 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:16.917332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1268/2554] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:34:16.921218 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc28cb-7d82-4e49-a4b3-47578de37822 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:16.931974 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc28cb-7d82-4e49-a4b3-47578de37822 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:16.937292 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da5b2c-5754-4824-b3b3-7182e1e773c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:16.937944 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da5b2c-5754-4824-b3b3-7182e1e773c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:16.938269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da5b2c-5754-4824-b3b3-7182e1e773c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:16.938552 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da5b2c-5754-4824-b3b3-7182e1e773c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:16.939310 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da5b2c-5754-4824-b3b3-7182e1e773c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:16.940914 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da5b2c-5754-4824-b3b3-7182e1e773c8 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:16.951514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1287/2555] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:34:16.955597 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055d3f7-9335-42e8-9638-4d2dc53a1952 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:16.965637 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055d3f7-9335-42e8-9638-4d2dc53a1952 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:16.970179 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109d239-e611-40b1-bc2c-6dae5776789e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:16.971051 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109d239-e611-40b1-bc2c-6dae5776789e admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:16.971335 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109d239-e611-40b1-bc2c-6dae5776789e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:16.971611 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109d239-e611-40b1-bc2c-6dae5776789e admin admin] PATH_INFO: `/v3/projects/bd8fd2cf0f2542ddbef21aab7a3818af/users/5783432d70af4dce84db9bc2dcd091c1/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:16.986914 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109d239-e611-40b1-bc2c-6dae5776789e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8fd2cf0f2542ddbef21aab7a3818af, user_id=5783432d70af4dce84db9bc2dcd091c1, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:16.998223 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109d239-e611-40b1-bc2c-6dae5776789e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:17.066785 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1269/2556] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:34:16 2022] PUT /identity/v3/projects/bd8fd2cf0f2542ddbef21aab7a3818af/users/5783432d70af4dce84db9bc2dcd091c1/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:34:17.077098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d9360-a75d-4647-bcbf-751e831da4a7 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:17.077388 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d9360-a75d-4647-bcbf-751e831da4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:17.077665 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d9360-a75d-4647-bcbf-751e831da4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:17.104585 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-bb9d9360-a75d-4647-bcbf-751e831da4a7 None None] MFA Rules not processed for user `5783432d70af4dce84db9bc2dcd091c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:34:17.105802 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-bb9d9360-a75d-4647-bcbf-751e831da4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:17.170841 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1288/2557] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:34:17 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:34:17.174919 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109d239-e611-40b1-bc2c-6dae5776789e admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:17.238338 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109d239-e611-40b1-bc2c-6dae5776789e admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:17.243371 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407ebfe-e990-4631-b9e5-315de415b840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:17.244024 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407ebfe-e990-4631-b9e5-315de415b840 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:17.244310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407ebfe-e990-4631-b9e5-315de415b840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:17.244586 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407ebfe-e990-4631-b9e5-315de415b840 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:17.245266 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f407ebfe-e990-4631-b9e5-315de415b840 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:17.247204 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f407ebfe-e990-4631-b9e5-315de415b840 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:17.381710 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1270/2558] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:34:17 2022] POST /identity/v3/projects => generated 357 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:34:17.385447 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d9360-a75d-4647-bcbf-751e831da4a7 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:17.393683 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d9360-a75d-4647-bcbf-751e831da4a7 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:17.451087 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67e490-1337-4782-b03a-d371b6a3210e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:17.451792 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67e490-1337-4782-b03a-d371b6a3210e admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:17.452077 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67e490-1337-4782-b03a-d371b6a3210e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:17.452358 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67e490-1337-4782-b03a-d371b6a3210e admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:17.453044 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67e490-1337-4782-b03a-d371b6a3210e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:17.455059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67e490-1337-4782-b03a-d371b6a3210e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:17.577054 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1289/2559] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:34:17 2022] POST /identity/v3/users => generated 285 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:34:17.580810 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407ebfe-e990-4631-b9e5-315de415b840 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:17.592314 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407ebfe-e990-4631-b9e5-315de415b840 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:17.597107 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b513a-a611-401f-9f22-1e5a00202985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:17.598380 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b513a-a611-401f-9f22-1e5a00202985 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:17.598646 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b513a-a611-401f-9f22-1e5a00202985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:17.603887 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b513a-a611-401f-9f22-1e5a00202985 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:17.603887 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b513a-a611-401f-9f22-1e5a00202985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:17.603887 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b513a-a611-401f-9f22-1e5a00202985 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:17.613397 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1271/2560] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:34:17.617962 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67e490-1337-4782-b03a-d371b6a3210e admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:17.638300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67e490-1337-4782-b03a-d371b6a3210e admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:17.638300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28337d-f9b1-4c35-ac9a-2c94d5d85d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:17.638300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28337d-f9b1-4c35-ac9a-2c94d5d85d21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:17.638300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28337d-f9b1-4c35-ac9a-2c94d5d85d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:17.638725 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28337d-f9b1-4c35-ac9a-2c94d5d85d21 admin admin] PATH_INFO: `/v3/projects/e7beb24101c0426195a7f3feee55b284/users/35486913603645beac0361e984ae0314/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:17.652984 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f28337d-f9b1-4c35-ac9a-2c94d5d85d21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7beb24101c0426195a7f3feee55b284, user_id=35486913603645beac0361e984ae0314, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:17.655867 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f28337d-f9b1-4c35-ac9a-2c94d5d85d21 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:17.738525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1290/2561] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:34:17 2022] PUT /identity/v3/projects/e7beb24101c0426195a7f3feee55b284/users/35486913603645beac0361e984ae0314/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:34:17.742750 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b513a-a611-401f-9f22-1e5a00202985 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:17.752766 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b513a-a611-401f-9f22-1e5a00202985 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:17.809314 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c7d6f-ecd7-4275-9911-ea083ef9a834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:17.809975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c7d6f-ecd7-4275-9911-ea083ef9a834 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:17.810323 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c7d6f-ecd7-4275-9911-ea083ef9a834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:17.810625 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c7d6f-ecd7-4275-9911-ea083ef9a834 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:17.811349 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c7d6f-ecd7-4275-9911-ea083ef9a834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:17.813022 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c7d6f-ecd7-4275-9911-ea083ef9a834 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:17.819355 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:17.824352 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1272/2562] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:34:17.828532 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28337d-f9b1-4c35-ac9a-2c94d5d85d21 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:17.839555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28337d-f9b1-4c35-ac9a-2c94d5d85d21 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:17.844217 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066d398-1134-4965-aafd-f91be04b86db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:17.845091 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066d398-1134-4965-aafd-f91be04b86db admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:17.845374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066d398-1134-4965-aafd-f91be04b86db admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:17.845677 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066d398-1134-4965-aafd-f91be04b86db admin admin] PATH_INFO: `/v3/projects/e7beb24101c0426195a7f3feee55b284/users/35486913603645beac0361e984ae0314/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:17.847875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066d398-1134-4965-aafd-f91be04b86db admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7beb24101c0426195a7f3feee55b284, user_id=35486913603645beac0361e984ae0314, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:17.850538 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066d398-1134-4965-aafd-f91be04b86db admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:17.860848 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1291/2563] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:34:17 2022] PUT /identity/v3/projects/e7beb24101c0426195a7f3feee55b284/users/35486913603645beac0361e984ae0314/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:34:17.872037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ce9ee-b1d3-4785-93e3-cd207acf09b7 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:17.872322 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ce9ee-b1d3-4785-93e3-cd207acf09b7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:17.872595 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ce9ee-b1d3-4785-93e3-cd207acf09b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:17.899960 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-da3ce9ee-b1d3-4785-93e3-cd207acf09b7 None None] MFA Rules not processed for user `35486913603645beac0361e984ae0314`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:34:17.901189 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-da3ce9ee-b1d3-4785-93e3-cd207acf09b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:17.969550 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1273/2564] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:34:17 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:34:17.980956 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066d398-1134-4965-aafd-f91be04b86db admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:17.982835 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4066d398-1134-4965-aafd-f91be04b86db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:18.015869 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:18.053961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066d398-1134-4965-aafd-f91be04b86db admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:18.053961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1752b88-dec7-453f-9373-969aa7ac49b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:18.053961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1752b88-dec7-453f-9373-969aa7ac49b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:18.053961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1752b88-dec7-453f-9373-969aa7ac49b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:18.054459 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1752b88-dec7-453f-9373-969aa7ac49b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:18.056755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1752b88-dec7-453f-9373-969aa7ac49b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:18.058216 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1752b88-dec7-453f-9373-969aa7ac49b4 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:18.068285 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1292/2565] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:34:17 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:34:18.308141 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ce9ee-b1d3-4785-93e3-cd207acf09b7 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:18.318896 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ce9ee-b1d3-4785-93e3-cd207acf09b7 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:18.322458 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e5fbf-5cfe-4591-8b2a-df4f9d84baec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:18.323097 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e5fbf-5cfe-4591-8b2a-df4f9d84baec service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:18.323380 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e5fbf-5cfe-4591-8b2a-df4f9d84baec service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:18.323684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e5fbf-5cfe-4591-8b2a-df4f9d84baec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:18.382110 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e5fbf-5cfe-4591-8b2a-df4f9d84baec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:18.383603 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e5fbf-5cfe-4591-8b2a-df4f9d84baec service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:18.392582 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1274/2566] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:34:18 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:34:20.193772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1752b88-dec7-453f-9373-969aa7ac49b4 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:20.195195 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c1752b88-dec7-453f-9373-969aa7ac49b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:20.252458 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1752b88-dec7-453f-9373-969aa7ac49b4 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:20.256160 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eefdff-4002-4afa-9637-e3ec61616325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:20.256812 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eefdff-4002-4afa-9637-e3ec61616325 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:20.261267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eefdff-4002-4afa-9637-e3ec61616325 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:20.261267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eefdff-4002-4afa-9637-e3ec61616325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:20.261267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-08eefdff-4002-4afa-9637-e3ec61616325 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:20.325311 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eefdff-4002-4afa-9637-e3ec61616325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:20.326855 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eefdff-4002-4afa-9637-e3ec61616325 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:20.340472 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1293/2567] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:34:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:34:24.356719 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e5fbf-5cfe-4591-8b2a-df4f9d84baec service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:24.358421 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c06e5fbf-5cfe-4591-8b2a-df4f9d84baec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:24.373751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e5fbf-5cfe-4591-8b2a-df4f9d84baec service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:24.378393 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a114a-a84e-4ec7-a4f1-6369c8a76d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:24.379978 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a114a-a84e-4ec7-a4f1-6369c8a76d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:24.380257 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a114a-a84e-4ec7-a4f1-6369c8a76d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:24.380530 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a114a-a84e-4ec7-a4f1-6369c8a76d32 admin admin] PATH_INFO: `/v3/users/db2792db73c24a75a449894faf6fbf73` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:24.381709 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a114a-a84e-4ec7-a4f1-6369c8a76d32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db2792db73c24a75a449894faf6fbf73)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:24.383671 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a114a-a84e-4ec7-a4f1-6369c8a76d32 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:24.642720 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-976a114a-a84e-4ec7-a4f1-6369c8a76d32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db2792db73c24a75a449894faf6fbf73'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:24.650449 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-976a114a-a84e-4ec7-a4f1-6369c8a76d32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db2792db73c24a75a449894faf6fbf73'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:24.662108 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-976a114a-a84e-4ec7-a4f1-6369c8a76d32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db2792db73c24a75a449894faf6fbf73'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:24.662867 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-976a114a-a84e-4ec7-a4f1-6369c8a76d32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db2792db73c24a75a449894faf6fbf73'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:24.666699 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:24.785023 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-976a114a-a84e-4ec7-a4f1-6369c8a76d32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db2792db73c24a75a449894faf6fbf73'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:24.792501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1275/2568] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:34:24 2022] DELETE /identity/v3/users/db2792db73c24a75a449894faf6fbf73 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:34:25.061642 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eefdff-4002-4afa-9637-e3ec61616325 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:25.072395 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eefdff-4002-4afa-9637-e3ec61616325 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:25.138696 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0529a10-8f55-405e-8894-0333dbd88277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:25.139622 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0529a10-8f55-405e-8894-0333dbd88277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:25.139853 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0529a10-8f55-405e-8894-0333dbd88277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:25.140164 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0529a10-8f55-405e-8894-0333dbd88277 admin admin] PATH_INFO: `/v3/projects/39964d4adc0941f5838e415d9efeb9ce` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:25.141359 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0529a10-8f55-405e-8894-0333dbd88277 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39964d4adc0941f5838e415d9efeb9ce)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:25.143343 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0529a10-8f55-405e-8894-0333dbd88277 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:25.169381 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:25.283083 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b0529a10-8f55-405e-8894-0333dbd88277 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39964d4adc0941f5838e415d9efeb9ce', 'request_id': 'req-b0529a10-8f55-405e-8894-0333dbd88277'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:25.385623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b0529a10-8f55-405e-8894-0333dbd88277 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39964d4adc0941f5838e415d9efeb9ce', 'request_id': 'req-b0529a10-8f55-405e-8894-0333dbd88277'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:25.394010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b0529a10-8f55-405e-8894-0333dbd88277 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39964d4adc0941f5838e415d9efeb9ce', 'request_id': 'req-b0529a10-8f55-405e-8894-0333dbd88277'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:25.416133 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b0529a10-8f55-405e-8894-0333dbd88277 admin admin] The token cache is being invalidate because project 39964d4adc0941f5838e415d9efeb9ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:34:25.416497 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b0529a10-8f55-405e-8894-0333dbd88277 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:25.417297 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b0529a10-8f55-405e-8894-0333dbd88277 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:25.419169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1294/2569] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:34:25 2022] DELETE /identity/v3/projects/39964d4adc0941f5838e415d9efeb9ce => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:34:25.424206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041411e2-aba3-49ff-b41e-57574c00038d None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:25.426663 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041411e2-aba3-49ff-b41e-57574c00038d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:25.426663 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041411e2-aba3-49ff-b41e-57574c00038d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:25.444340 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-041411e2-aba3-49ff-b41e-57574c00038d None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:34:25.445611 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-041411e2-aba3-49ff-b41e-57574c00038d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:25.507377 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1276/2570] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:34:25.515396 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acea1b-208e-4dee-8b81-42badb8f52e1 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:25.515734 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acea1b-208e-4dee-8b81-42badb8f52e1 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:25.516014 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acea1b-208e-4dee-8b81-42badb8f52e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:25.536097 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-68acea1b-208e-4dee-8b81-42badb8f52e1 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:34:25.537236 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-68acea1b-208e-4dee-8b81-42badb8f52e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:25.545561 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1295/2571] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:34:25.549956 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041411e2-aba3-49ff-b41e-57574c00038d None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:25.560224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041411e2-aba3-49ff-b41e-57574c00038d None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:25.565119 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855950e-a97b-4074-bd12-ba9e96fae1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:25.565775 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855950e-a97b-4074-bd12-ba9e96fae1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:25.566221 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855950e-a97b-4074-bd12-ba9e96fae1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:25.566397 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855950e-a97b-4074-bd12-ba9e96fae1f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:25.567554 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855950e-a97b-4074-bd12-ba9e96fae1f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:34:25.567752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855950e-a97b-4074-bd12-ba9e96fae1f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:25.569420 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855950e-a97b-4074-bd12-ba9e96fae1f8 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:25.581718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1277/2572] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:34:25.589479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acea1b-208e-4dee-8b81-42badb8f52e1 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:25.600313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acea1b-208e-4dee-8b81-42badb8f52e1 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:25.605437 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0634751-9c3b-4e13-82ae-4d030d264f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:25.606153 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0634751-9c3b-4e13-82ae-4d030d264f93 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:25.606440 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0634751-9c3b-4e13-82ae-4d030d264f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:25.606715 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0634751-9c3b-4e13-82ae-4d030d264f93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:25.607403 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0634751-9c3b-4e13-82ae-4d030d264f93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:25.609293 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0634751-9c3b-4e13-82ae-4d030d264f93 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:25.707977 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1296/2573] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:34:25 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:34:25.712061 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855950e-a97b-4074-bd12-ba9e96fae1f8 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:25.722366 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855950e-a97b-4074-bd12-ba9e96fae1f8 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:25.787451 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96737122-8ddd-46c8-b79b-76063b52d53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:25.788261 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96737122-8ddd-46c8-b79b-76063b52d53f admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:25.788548 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96737122-8ddd-46c8-b79b-76063b52d53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:25.788824 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96737122-8ddd-46c8-b79b-76063b52d53f admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:25.789515 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96737122-8ddd-46c8-b79b-76063b52d53f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:25.791538 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96737122-8ddd-46c8-b79b-76063b52d53f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:25.991028 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1278/2574] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:34:25 2022] POST /identity/v3/users => generated 283 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:34:25.995125 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0634751-9c3b-4e13-82ae-4d030d264f93 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:26.006409 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0634751-9c3b-4e13-82ae-4d030d264f93 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:26.020152 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b45707-c68b-42fa-aac1-ec2cccc065c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:26.021466 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b45707-c68b-42fa-aac1-ec2cccc065c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:26.021757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b45707-c68b-42fa-aac1-ec2cccc065c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:26.022087 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b45707-c68b-42fa-aac1-ec2cccc065c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:26.022885 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b45707-c68b-42fa-aac1-ec2cccc065c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:26.024497 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b45707-c68b-42fa-aac1-ec2cccc065c4 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:26.038921 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1297/2575] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:34:26.040227 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96737122-8ddd-46c8-b79b-76063b52d53f admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:26.053040 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96737122-8ddd-46c8-b79b-76063b52d53f admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:26.058449 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ce227-20df-4a2d-b6a9-c0e7437843bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:26.059117 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ce227-20df-4a2d-b6a9-c0e7437843bf admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:26.059404 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ce227-20df-4a2d-b6a9-c0e7437843bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:26.059887 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ce227-20df-4a2d-b6a9-c0e7437843bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:26.060650 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ce227-20df-4a2d-b6a9-c0e7437843bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:26.062617 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ce227-20df-4a2d-b6a9-c0e7437843bf admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:26.080009 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1279/2576] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:34:26.082095 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b45707-c68b-42fa-aac1-ec2cccc065c4 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:26.094638 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b45707-c68b-42fa-aac1-ec2cccc065c4 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:26.099370 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407578ad-a362-44d8-a7bd-5c531c78be89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:26.100256 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407578ad-a362-44d8-a7bd-5c531c78be89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:26.100540 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407578ad-a362-44d8-a7bd-5c531c78be89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:26.100816 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407578ad-a362-44d8-a7bd-5c531c78be89 admin admin] PATH_INFO: `/v3/projects/228f59de96e94527aa4ef169480d5705/users/f0866577ca474d15a02c92d7a29537e3/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:26.116020 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407578ad-a362-44d8-a7bd-5c531c78be89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=228f59de96e94527aa4ef169480d5705, user_id=f0866577ca474d15a02c92d7a29537e3, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:26.118999 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407578ad-a362-44d8-a7bd-5c531c78be89 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:26.200145 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1298/2577] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:34:26 2022] PUT /identity/v3/projects/228f59de96e94527aa4ef169480d5705/users/f0866577ca474d15a02c92d7a29537e3/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:34:26.211886 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13beb5e-831e-4a57-8e68-d80bb270d63e None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:26.212229 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13beb5e-831e-4a57-8e68-d80bb270d63e None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:26.215975 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13beb5e-831e-4a57-8e68-d80bb270d63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:26.242670 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-e13beb5e-831e-4a57-8e68-d80bb270d63e None None] MFA Rules not processed for user `f0866577ca474d15a02c92d7a29537e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:34:26.243863 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e13beb5e-831e-4a57-8e68-d80bb270d63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:26.295480 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:26.314744 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1280/2578] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:34:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:34:26.325866 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407578ad-a362-44d8-a7bd-5c531c78be89 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:26.327676 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-407578ad-a362-44d8-a7bd-5c531c78be89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:26.384237 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407578ad-a362-44d8-a7bd-5c531c78be89 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:26.387893 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b4e78-090c-47b8-a564-ba67ee37975d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:26.388532 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b4e78-090c-47b8-a564-ba67ee37975d service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:26.388814 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b4e78-090c-47b8-a564-ba67ee37975d service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:26.389089 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b4e78-090c-47b8-a564-ba67ee37975d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:26.397526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b4e78-090c-47b8-a564-ba67ee37975d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:26.398922 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b4e78-090c-47b8-a564-ba67ee37975d service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:26.407642 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1299/2579] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:34:26 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:34:33.572251 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13beb5e-831e-4a57-8e68-d80bb270d63e None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:33.572251 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e13beb5e-831e-4a57-8e68-d80bb270d63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:33.645960 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13beb5e-831e-4a57-8e68-d80bb270d63e None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:33.651690 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79411da-8bda-4f8b-a581-79582b707d43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:33.652414 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79411da-8bda-4f8b-a581-79582b707d43 service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:33.652735 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79411da-8bda-4f8b-a581-79582b707d43 service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:33.653020 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79411da-8bda-4f8b-a581-79582b707d43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:33.654874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f79411da-8bda-4f8b-a581-79582b707d43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:33.668243 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79411da-8bda-4f8b-a581-79582b707d43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:33.669876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79411da-8bda-4f8b-a581-79582b707d43 service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:33.680757 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1281/2580] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:34:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:34:36.403725 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=68,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:37.083759 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b4e78-090c-47b8-a564-ba67ee37975d service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:37.146096 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b4e78-090c-47b8-a564-ba67ee37975d service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:37.155558 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010c729-b56f-4c5e-ad76-009ce8e8a267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:37.161875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010c729-b56f-4c5e-ad76-009ce8e8a267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:37.161875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010c729-b56f-4c5e-ad76-009ce8e8a267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:37.161875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010c729-b56f-4c5e-ad76-009ce8e8a267 admin admin] PATH_INFO: `/v3/users/f0866577ca474d15a02c92d7a29537e3` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:37.161875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010c729-b56f-4c5e-ad76-009ce8e8a267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0866577ca474d15a02c92d7a29537e3)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:37.161875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010c729-b56f-4c5e-ad76-009ce8e8a267 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:37.325455 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f010c729-b56f-4c5e-ad76-009ce8e8a267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0866577ca474d15a02c92d7a29537e3'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:37.400062 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f010c729-b56f-4c5e-ad76-009ce8e8a267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0866577ca474d15a02c92d7a29537e3'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:37.413977 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f010c729-b56f-4c5e-ad76-009ce8e8a267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0866577ca474d15a02c92d7a29537e3'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:37.421161 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f010c729-b56f-4c5e-ad76-009ce8e8a267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0866577ca474d15a02c92d7a29537e3'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:37.422018 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f010c729-b56f-4c5e-ad76-009ce8e8a267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0866577ca474d15a02c92d7a29537e3'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:37.439463 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1300/2581] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:34:37 2022] DELETE /identity/v3/users/f0866577ca474d15a02c92d7a29537e3 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:34:37.445040 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d1fc8-9186-417c-9133-69b425b32c59 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:37.445582 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d1fc8-9186-417c-9133-69b425b32c59 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:37.445582 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d1fc8-9186-417c-9133-69b425b32c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:37.464349 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-8f9d1fc8-9186-417c-9133-69b425b32c59 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:34:37.465870 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8f9d1fc8-9186-417c-9133-69b425b32c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:37.530880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1282/2582] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:34:37.540578 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010c729-b56f-4c5e-ad76-009ce8e8a267 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:37.542270 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f010c729-b56f-4c5e-ad76-009ce8e8a267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:37.618676 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010c729-b56f-4c5e-ad76-009ce8e8a267 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:37.623121 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c717189-ffdf-493e-94f8-ce1ea9f88634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:37.624082 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c717189-ffdf-493e-94f8-ce1ea9f88634 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:37.624471 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c717189-ffdf-493e-94f8-ce1ea9f88634 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:37.624752 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c717189-ffdf-493e-94f8-ce1ea9f88634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:37.636354 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c717189-ffdf-493e-94f8-ce1ea9f88634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:37.638039 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c717189-ffdf-493e-94f8-ce1ea9f88634 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:37.641449 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d1fc8-9186-417c-9133-69b425b32c59 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:37.650905 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1301/2583] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:34:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:34:37.660998 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d1fc8-9186-417c-9133-69b425b32c59 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:37.665074 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749449c5-c817-4363-ae44-808266c17b67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:37.665737 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749449c5-c817-4363-ae44-808266c17b67 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:37.666019 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749449c5-c817-4363-ae44-808266c17b67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:37.666507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749449c5-c817-4363-ae44-808266c17b67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:37.668561 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-749449c5-c817-4363-ae44-808266c17b67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:37.752151 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749449c5-c817-4363-ae44-808266c17b67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:37.753807 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749449c5-c817-4363-ae44-808266c17b67 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:37.766750 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1283/2584] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:34:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:34:38.307614 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c717189-ffdf-493e-94f8-ce1ea9f88634 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:38.309747 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6c717189-ffdf-493e-94f8-ce1ea9f88634 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:38.331491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c717189-ffdf-493e-94f8-ce1ea9f88634 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:38.361488 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae266e1-9f83-49ee-a955-886763f01b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:38.361488 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae266e1-9f83-49ee-a955-886763f01b7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:38.361488 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae266e1-9f83-49ee-a955-886763f01b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:38.361488 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae266e1-9f83-49ee-a955-886763f01b7f admin admin] PATH_INFO: `/v3/projects/228f59de96e94527aa4ef169480d5705` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:38.362039 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae266e1-9f83-49ee-a955-886763f01b7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=228f59de96e94527aa4ef169480d5705)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:38.363583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae266e1-9f83-49ee-a955-886763f01b7f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:38.389325 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:38.493888 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-eae266e1-9f83-49ee-a955-886763f01b7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '228f59de96e94527aa4ef169480d5705', 'request_id': 'req-eae266e1-9f83-49ee-a955-886763f01b7f'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:38.576010 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-eae266e1-9f83-49ee-a955-886763f01b7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '228f59de96e94527aa4ef169480d5705', 'request_id': 'req-eae266e1-9f83-49ee-a955-886763f01b7f'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:38.584332 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-eae266e1-9f83-49ee-a955-886763f01b7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '228f59de96e94527aa4ef169480d5705', 'request_id': 'req-eae266e1-9f83-49ee-a955-886763f01b7f'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:38.602179 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-eae266e1-9f83-49ee-a955-886763f01b7f admin admin] The token cache is being invalidate because project 228f59de96e94527aa4ef169480d5705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:34:38.602671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-eae266e1-9f83-49ee-a955-886763f01b7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:38.603574 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-eae266e1-9f83-49ee-a955-886763f01b7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:38.605439 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1302/2585] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:34:38 2022] DELETE /identity/v3/projects/228f59de96e94527aa4ef169480d5705 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:34:38.611863 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56057040-f1a0-489b-a7fa-f07912f24d5c None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:38.612335 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56057040-f1a0-489b-a7fa-f07912f24d5c None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:38.612335 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56057040-f1a0-489b-a7fa-f07912f24d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:38.636353 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-56057040-f1a0-489b-a7fa-f07912f24d5c None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:34:38.644903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-56057040-f1a0-489b-a7fa-f07912f24d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:38.644903 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:38.701787 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1284/2586] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:34:38.709669 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3a248-89ce-4e8d-b2ff-b4d894264a6a None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:38.709952 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3a248-89ce-4e8d-b2ff-b4d894264a6a None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:38.710265 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3a248-89ce-4e8d-b2ff-b4d894264a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:38.729194 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-38a3a248-89ce-4e8d-b2ff-b4d894264a6a None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:34:38.730655 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-38a3a248-89ce-4e8d-b2ff-b4d894264a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:38.739436 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1303/2587] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:34:38.744368 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56057040-f1a0-489b-a7fa-f07912f24d5c None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:38.755639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56057040-f1a0-489b-a7fa-f07912f24d5c None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:38.762348 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdf26e-9dd7-492f-a33e-21f52a4d78eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:38.763164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdf26e-9dd7-492f-a33e-21f52a4d78eb admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:38.763549 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdf26e-9dd7-492f-a33e-21f52a4d78eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:38.763957 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdf26e-9dd7-492f-a33e-21f52a4d78eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:38.765134 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cdf26e-9dd7-492f-a33e-21f52a4d78eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:34:38.765643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cdf26e-9dd7-492f-a33e-21f52a4d78eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:38.767504 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cdf26e-9dd7-492f-a33e-21f52a4d78eb admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:38.780602 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1285/2588] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:34:38.785529 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3a248-89ce-4e8d-b2ff-b4d894264a6a None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:38.795744 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3a248-89ce-4e8d-b2ff-b4d894264a6a None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:38.801472 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a859adf-fa74-4777-9d3b-ef15a2d445dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:38.802392 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a859adf-fa74-4777-9d3b-ef15a2d445dc admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:38.802848 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a859adf-fa74-4777-9d3b-ef15a2d445dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:38.803906 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a859adf-fa74-4777-9d3b-ef15a2d445dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:38.804807 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a859adf-fa74-4777-9d3b-ef15a2d445dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:38.806948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a859adf-fa74-4777-9d3b-ef15a2d445dc admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:38.951954 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1304/2589] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:34:38 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:34:38.959919 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdf26e-9dd7-492f-a33e-21f52a4d78eb admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:38.971768 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdf26e-9dd7-492f-a33e-21f52a4d78eb admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:38.977091 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a859adf-fa74-4777-9d3b-ef15a2d445dc admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:38.979134 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2a859adf-fa74-4777-9d3b-ef15a2d445dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:39.039552 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db456577-9b51-41df-bc05-f88ef12ab2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:39.040232 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db456577-9b51-41df-bc05-f88ef12ab2e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:39.040507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db456577-9b51-41df-bc05-f88ef12ab2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:39.040782 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db456577-9b51-41df-bc05-f88ef12ab2e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:39.041470 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db456577-9b51-41df-bc05-f88ef12ab2e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:39.043421 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db456577-9b51-41df-bc05-f88ef12ab2e3 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:39.048553 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a859adf-fa74-4777-9d3b-ef15a2d445dc admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:39.054610 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0305db61-3e31-4ac0-a4fb-a65bed2f4e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:39.055498 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305db61-3e31-4ac0-a4fb-a65bed2f4e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:39.055954 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305db61-3e31-4ac0-a4fb-a65bed2f4e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:39.056875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305db61-3e31-4ac0-a4fb-a65bed2f4e66 admin admin] PATH_INFO: `/v3/users/5783432d70af4dce84db9bc2dcd091c1` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:39.058169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0305db61-3e31-4ac0-a4fb-a65bed2f4e66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5783432d70af4dce84db9bc2dcd091c1)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:39.060173 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0305db61-3e31-4ac0-a4fb-a65bed2f4e66 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:39.182324 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1286/2590] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:34:38 2022] POST /identity/v3/users => generated 289 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:34:39.186567 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db456577-9b51-41df-bc05-f88ef12ab2e3 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:39.197264 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db456577-9b51-41df-bc05-f88ef12ab2e3 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:39.220504 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab325139-caae-49bd-a13c-f9e7071ec4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:39.221189 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab325139-caae-49bd-a13c-f9e7071ec4cf admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:39.221469 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab325139-caae-49bd-a13c-f9e7071ec4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:39.221744 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab325139-caae-49bd-a13c-f9e7071ec4cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:39.223260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab325139-caae-49bd-a13c-f9e7071ec4cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:39.225548 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab325139-caae-49bd-a13c-f9e7071ec4cf admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:39.240653 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1287/2591] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:34:39.241721 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab325139-caae-49bd-a13c-f9e7071ec4cf admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:39.253811 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab325139-caae-49bd-a13c-f9e7071ec4cf admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:39.260153 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66676d3e-ae9b-42d5-aef4-a90c4e965540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:39.260845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66676d3e-ae9b-42d5-aef4-a90c4e965540 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:39.261125 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66676d3e-ae9b-42d5-aef4-a90c4e965540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:39.261396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66676d3e-ae9b-42d5-aef4-a90c4e965540 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:39.262149 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66676d3e-ae9b-42d5-aef4-a90c4e965540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:39.263748 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66676d3e-ae9b-42d5-aef4-a90c4e965540 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:39.278372 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1288/2592] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:34:39.279434 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66676d3e-ae9b-42d5-aef4-a90c4e965540 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:39.293454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66676d3e-ae9b-42d5-aef4-a90c4e965540 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:39.299017 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0305db61-3e31-4ac0-a4fb-a65bed2f4e66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5783432d70af4dce84db9bc2dcd091c1'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:39.299273 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a494fc-676a-40e6-b58f-2dae239de38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:39.300187 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a494fc-676a-40e6-b58f-2dae239de38d admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:39.300617 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a494fc-676a-40e6-b58f-2dae239de38d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:39.300981 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a494fc-676a-40e6-b58f-2dae239de38d admin admin] PATH_INFO: `/v3/projects/5487dc8dd888471fa98fc22132e2f798/users/5ad58998f74e47a9bcfb13409341640c/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:39.321146 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a494fc-676a-40e6-b58f-2dae239de38d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5487dc8dd888471fa98fc22132e2f798, user_id=5ad58998f74e47a9bcfb13409341640c, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:39.323862 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a494fc-676a-40e6-b58f-2dae239de38d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:39.398355 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0305db61-3e31-4ac0-a4fb-a65bed2f4e66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5783432d70af4dce84db9bc2dcd091c1'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:39.407514 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1289/2593] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:34:39 2022] PUT /identity/v3/projects/5487dc8dd888471fa98fc22132e2f798/users/5ad58998f74e47a9bcfb13409341640c/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:34:39.421731 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac01ee7-cda3-4a6b-aba4-f2534e4fdfc6 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:39.422136 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac01ee7-cda3-4a6b-aba4-f2534e4fdfc6 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:39.422477 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac01ee7-cda3-4a6b-aba4-f2534e4fdfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:39.424430 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0305db61-3e31-4ac0-a4fb-a65bed2f4e66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5783432d70af4dce84db9bc2dcd091c1'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:39.433092 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:39.435910 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0305db61-3e31-4ac0-a4fb-a65bed2f4e66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5783432d70af4dce84db9bc2dcd091c1'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:39.437218 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0305db61-3e31-4ac0-a4fb-a65bed2f4e66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5783432d70af4dce84db9bc2dcd091c1'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:39.446776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1305/2594] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:34:38 2022] DELETE /identity/v3/users/5783432d70af4dce84db9bc2dcd091c1 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:34:39.451211 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178d08c-9a93-4237-9302-0b53317380c4 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:39.451509 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178d08c-9a93-4237-9302-0b53317380c4 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:39.451790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178d08c-9a93-4237-9302-0b53317380c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:39.457423 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-2ac01ee7-cda3-4a6b-aba4-f2534e4fdfc6 None None] MFA Rules not processed for user `5ad58998f74e47a9bcfb13409341640c`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:34:39.459882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2ac01ee7-cda3-4a6b-aba4-f2534e4fdfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:39.470200 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b178d08c-9a93-4237-9302-0b53317380c4 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:34:39.471776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b178d08c-9a93-4237-9302-0b53317380c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:39.496732 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:39.537772 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1290/2595] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:34:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:34:39.542318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac01ee7-cda3-4a6b-aba4-f2534e4fdfc6 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:39.543834 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2ac01ee7-cda3-4a6b-aba4-f2534e4fdfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:39.545453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1306/2596] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:34:39.558524 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac01ee7-cda3-4a6b-aba4-f2534e4fdfc6 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:39.560729 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178d08c-9a93-4237-9302-0b53317380c4 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:39.562285 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b178d08c-9a93-4237-9302-0b53317380c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:39.563638 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b94cf2-bb90-4e12-8ef4-ca5b0cde793d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:39.564230 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b94cf2-bb90-4e12-8ef4-ca5b0cde793d admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:39.564686 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b94cf2-bb90-4e12-8ef4-ca5b0cde793d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:39.565072 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b94cf2-bb90-4e12-8ef4-ca5b0cde793d admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:39.565761 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b94cf2-bb90-4e12-8ef4-ca5b0cde793d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:39.567910 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b94cf2-bb90-4e12-8ef4-ca5b0cde793d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:39.627861 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178d08c-9a93-4237-9302-0b53317380c4 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:39.631996 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edcb719-1aa3-49a7-8dda-5fecbb9d0341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:39.636103 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcb719-1aa3-49a7-8dda-5fecbb9d0341 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:39.636103 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcb719-1aa3-49a7-8dda-5fecbb9d0341 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:39.636103 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcb719-1aa3-49a7-8dda-5fecbb9d0341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:39.642404 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edcb719-1aa3-49a7-8dda-5fecbb9d0341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:39.643945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edcb719-1aa3-49a7-8dda-5fecbb9d0341 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:39.657882 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1307/2597] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:34:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:34:39.664140 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1291/2598] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:34:39 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:34:39.665282 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edcb719-1aa3-49a7-8dda-5fecbb9d0341 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:39.676714 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edcb719-1aa3-49a7-8dda-5fecbb9d0341 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:39.743862 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ff1c7-8923-45a6-bbf1-50baba22847d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:39.744582 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ff1c7-8923-45a6-bbf1-50baba22847d admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:39.744868 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ff1c7-8923-45a6-bbf1-50baba22847d admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:39.745150 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ff1c7-8923-45a6-bbf1-50baba22847d admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:39.745845 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ff1c7-8923-45a6-bbf1-50baba22847d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:39.747804 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ff1c7-8923-45a6-bbf1-50baba22847d admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:39.875616 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1308/2599] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:34:39 2022] POST /identity/v3/users => generated 295 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:34:39.877304 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b94cf2-bb90-4e12-8ef4-ca5b0cde793d admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:39.888310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b94cf2-bb90-4e12-8ef4-ca5b0cde793d admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:39.893911 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937cdba-7675-4d34-9898-757286bef9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:39.894701 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937cdba-7675-4d34-9898-757286bef9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:39.894985 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937cdba-7675-4d34-9898-757286bef9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:39.895263 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937cdba-7675-4d34-9898-757286bef9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:39.895996 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937cdba-7675-4d34-9898-757286bef9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:39.898384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937cdba-7675-4d34-9898-757286bef9e1 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:39.919652 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1292/2600] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:34:39.921268 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ff1c7-8923-45a6-bbf1-50baba22847d admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:39.937134 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ff1c7-8923-45a6-bbf1-50baba22847d admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:39.941257 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0c7d8-ab40-4656-9e36-e166000e45ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:39.942164 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0c7d8-ab40-4656-9e36-e166000e45ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:39.942451 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0c7d8-ab40-4656-9e36-e166000e45ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:39.942754 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0c7d8-ab40-4656-9e36-e166000e45ad admin admin] PATH_INFO: `/v3/projects/13cb9ed6e9c8498cb25767c037d7bc58/users/449488020abe4ecba565bf6849074bdb/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:39.963211 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0c7d8-ab40-4656-9e36-e166000e45ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=13cb9ed6e9c8498cb25767c037d7bc58, user_id=449488020abe4ecba565bf6849074bdb, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:39.966004 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0c7d8-ab40-4656-9e36-e166000e45ad admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:40.046215 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1309/2601] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:34:39 2022] PUT /identity/v3/projects/13cb9ed6e9c8498cb25767c037d7bc58/users/449488020abe4ecba565bf6849074bdb/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:34:40.050660 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937cdba-7675-4d34-9898-757286bef9e1 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:40.062875 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937cdba-7675-4d34-9898-757286bef9e1 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:40.144079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d24cce-1258-40fb-bcc6-baae970b6444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:40.144751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d24cce-1258-40fb-bcc6-baae970b6444 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:40.145036 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d24cce-1258-40fb-bcc6-baae970b6444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:40.145338 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d24cce-1258-40fb-bcc6-baae970b6444 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:40.146079 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d24cce-1258-40fb-bcc6-baae970b6444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:40.147856 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d24cce-1258-40fb-bcc6-baae970b6444 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:40.164098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1293/2602] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:34:40.165498 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0c7d8-ab40-4656-9e36-e166000e45ad admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:40.173370 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:40.179965 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0c7d8-ab40-4656-9e36-e166000e45ad admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:40.185719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857c308-16ea-421b-8b9b-389e19b4a530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:40.187020 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857c308-16ea-421b-8b9b-389e19b4a530 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:40.188057 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857c308-16ea-421b-8b9b-389e19b4a530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:40.188515 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857c308-16ea-421b-8b9b-389e19b4a530 admin admin] PATH_INFO: `/v3/projects/13cb9ed6e9c8498cb25767c037d7bc58/users/449488020abe4ecba565bf6849074bdb/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:40.191487 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857c308-16ea-421b-8b9b-389e19b4a530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13cb9ed6e9c8498cb25767c037d7bc58, user_id=449488020abe4ecba565bf6849074bdb, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:40.194654 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857c308-16ea-421b-8b9b-389e19b4a530 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:40.210812 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1310/2603] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:34:40 2022] PUT /identity/v3/projects/13cb9ed6e9c8498cb25767c037d7bc58/users/449488020abe4ecba565bf6849074bdb/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:34:40.220728 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a790140-df00-4d31-85ae-10295d11099b None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:40.222787 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a790140-df00-4d31-85ae-10295d11099b None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:40.222787 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a790140-df00-4d31-85ae-10295d11099b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:40.226475 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857c308-16ea-421b-8b9b-389e19b4a530 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:40.236174 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e857c308-16ea-421b-8b9b-389e19b4a530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:40.269897 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-5a790140-df00-4d31-85ae-10295d11099b None None] MFA Rules not processed for user `449488020abe4ecba565bf6849074bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:34:40.272450 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5a790140-df00-4d31-85ae-10295d11099b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:40.348578 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857c308-16ea-421b-8b9b-389e19b4a530 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:40.358907 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc453cc-c2ba-4a97-8bbb-ead2c90a27de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:40.358907 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc453cc-c2ba-4a97-8bbb-ead2c90a27de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:40.358907 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc453cc-c2ba-4a97-8bbb-ead2c90a27de admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:40.358907 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc453cc-c2ba-4a97-8bbb-ead2c90a27de admin admin] PATH_INFO: `/v3/projects/bd8fd2cf0f2542ddbef21aab7a3818af` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:40.360253 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc453cc-c2ba-4a97-8bbb-ead2c90a27de admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd8fd2cf0f2542ddbef21aab7a3818af)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:40.360253 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc453cc-c2ba-4a97-8bbb-ead2c90a27de admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:40.384180 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1294/2604] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:34:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:34:40.396264 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a790140-df00-4d31-85ae-10295d11099b None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:40.398635 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5a790140-df00-4d31-85ae-10295d11099b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:40.435513 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:40.479683 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a790140-df00-4d31-85ae-10295d11099b None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:40.483389 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef2a10-24fb-4daa-8957-9ef9d0b5da49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:40.484090 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef2a10-24fb-4daa-8957-9ef9d0b5da49 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:40.484373 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef2a10-24fb-4daa-8957-9ef9d0b5da49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:40.484645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef2a10-24fb-4daa-8957-9ef9d0b5da49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:40.533193 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fdc453cc-c2ba-4a97-8bbb-ead2c90a27de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd8fd2cf0f2542ddbef21aab7a3818af', 'request_id': 'req-fdc453cc-c2ba-4a97-8bbb-ead2c90a27de'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:40.555572 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef2a10-24fb-4daa-8957-9ef9d0b5da49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:40.558018 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef2a10-24fb-4daa-8957-9ef9d0b5da49 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:40.572794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1295/2605] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:34:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:34:40.587150 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6ecc5-0797-4b3c-ab2a-baae3d25f328 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:40.587592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6ecc5-0797-4b3c-ab2a-baae3d25f328 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:40.587996 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6ecc5-0797-4b3c-ab2a-baae3d25f328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:40.611643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-98d6ecc5-0797-4b3c-ab2a-baae3d25f328 None None] MFA Rules not processed for user `063ce3b820a74d648d709ab6ac4d7be2`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:34:40.612926 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-98d6ecc5-0797-4b3c-ab2a-baae3d25f328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:40.641887 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fdc453cc-c2ba-4a97-8bbb-ead2c90a27de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd8fd2cf0f2542ddbef21aab7a3818af', 'request_id': 'req-fdc453cc-c2ba-4a97-8bbb-ead2c90a27de'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:40.654281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fdc453cc-c2ba-4a97-8bbb-ead2c90a27de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd8fd2cf0f2542ddbef21aab7a3818af', 'request_id': 'req-fdc453cc-c2ba-4a97-8bbb-ead2c90a27de'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:40.679680 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fdc453cc-c2ba-4a97-8bbb-ead2c90a27de admin admin] The token cache is being invalidate because project bd8fd2cf0f2542ddbef21aab7a3818af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:34:40.680555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fdc453cc-c2ba-4a97-8bbb-ead2c90a27de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:40.682204 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-fdc453cc-c2ba-4a97-8bbb-ead2c90a27de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:40.686091 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1311/2606] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:34:40 2022] DELETE /identity/v3/projects/bd8fd2cf0f2542ddbef21aab7a3818af => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:34:40.691921 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc453cc-c2ba-4a97-8bbb-ead2c90a27de admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:40.692312 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1296/2607] 10.222.0.13 () {58 vars in 967 bytes} [Tue Jul 5 21:34:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:34:40.693594 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-fdc453cc-c2ba-4a97-8bbb-ead2c90a27de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:40.752913 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6ecc5-0797-4b3c-ab2a-baae3d25f328 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:40.754409 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-98d6ecc5-0797-4b3c-ab2a-baae3d25f328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:40.808778 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc453cc-c2ba-4a97-8bbb-ead2c90a27de admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:40.815371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5818e3-0a40-4a30-9bd0-6d0b7358e064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:40.816254 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5818e3-0a40-4a30-9bd0-6d0b7358e064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:40.816543 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5818e3-0a40-4a30-9bd0-6d0b7358e064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:40.816827 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5818e3-0a40-4a30-9bd0-6d0b7358e064 admin admin] PATH_INFO: `/v3/users/35486913603645beac0361e984ae0314` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:40.819036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5818e3-0a40-4a30-9bd0-6d0b7358e064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35486913603645beac0361e984ae0314)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:40.820875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5818e3-0a40-4a30-9bd0-6d0b7358e064 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:40.847703 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:40.859291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6ecc5-0797-4b3c-ab2a-baae3d25f328 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:40.864900 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2666ad8-6e05-4dd6-8a10-3638879a80e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '441be62a077444b9b9f78714e24a760a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:40.865830 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2666ad8-6e05-4dd6-8a10-3638879a80e7 service swift] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:40.866296 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2666ad8-6e05-4dd6-8a10-3638879a80e7 service swift] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:40.866735 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2666ad8-6e05-4dd6-8a10-3638879a80e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:40.875926 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2666ad8-6e05-4dd6-8a10-3638879a80e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:40.877625 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2666ad8-6e05-4dd6-8a10-3638879a80e7 service swift] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:40.891602 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1297/2608] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Jul 5 21:34:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 21:34:41.080095 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ce5818e3-0a40-4a30-9bd0-6d0b7358e064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35486913603645beac0361e984ae0314'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:41.177668 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ce5818e3-0a40-4a30-9bd0-6d0b7358e064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35486913603645beac0361e984ae0314'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:41.191670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ce5818e3-0a40-4a30-9bd0-6d0b7358e064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35486913603645beac0361e984ae0314'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:41.199109 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ce5818e3-0a40-4a30-9bd0-6d0b7358e064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35486913603645beac0361e984ae0314'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:41.199824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ce5818e3-0a40-4a30-9bd0-6d0b7358e064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35486913603645beac0361e984ae0314'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:41.206036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1312/2609] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:34:40 2022] DELETE /identity/v3/users/35486913603645beac0361e984ae0314 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:34:41.692906 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2666ad8-6e05-4dd6-8a10-3638879a80e7 service swift] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:41.712373 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2666ad8-6e05-4dd6-8a10-3638879a80e7 service swift] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:41.717480 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:41.769854 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5dac8e-0da7-404b-9c8c-741c5bc86b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:41.770676 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5dac8e-0da7-404b-9c8c-741c5bc86b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:41.770961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5dac8e-0da7-404b-9c8c-741c5bc86b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:41.771242 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5dac8e-0da7-404b-9c8c-741c5bc86b07 admin admin] PATH_INFO: `/v3/projects/e7beb24101c0426195a7f3feee55b284` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:41.772491 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5dac8e-0da7-404b-9c8c-741c5bc86b07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7beb24101c0426195a7f3feee55b284)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:41.774474 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5dac8e-0da7-404b-9c8c-741c5bc86b07 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:41.980787 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-3c5dac8e-0da7-404b-9c8c-741c5bc86b07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7beb24101c0426195a7f3feee55b284', 'request_id': 'req-3c5dac8e-0da7-404b-9c8c-741c5bc86b07'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:41.986349 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-3c5dac8e-0da7-404b-9c8c-741c5bc86b07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7beb24101c0426195a7f3feee55b284', 'request_id': 'req-3c5dac8e-0da7-404b-9c8c-741c5bc86b07'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:42.201566 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-3c5dac8e-0da7-404b-9c8c-741c5bc86b07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7beb24101c0426195a7f3feee55b284', 'request_id': 'req-3c5dac8e-0da7-404b-9c8c-741c5bc86b07'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:42.214773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-3c5dac8e-0da7-404b-9c8c-741c5bc86b07 admin admin] The token cache is being invalidate because project e7beb24101c0426195a7f3feee55b284 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:34:42.215058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-3c5dac8e-0da7-404b-9c8c-741c5bc86b07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:42.215699 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-3c5dac8e-0da7-404b-9c8c-741c5bc86b07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:42.217244 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1298/2610] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:34:41 2022] DELETE /identity/v3/projects/e7beb24101c0426195a7f3feee55b284 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:34:42.223404 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f14bd-ef45-4bee-a831-b1575ddbd685 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:42.223897 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f14bd-ef45-4bee-a831-b1575ddbd685 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:42.223994 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f14bd-ef45-4bee-a831-b1575ddbd685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:42.242594 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-863f14bd-ef45-4bee-a831-b1575ddbd685 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:34:42.243804 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-863f14bd-ef45-4bee-a831-b1575ddbd685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:42.306638 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1313/2611] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:34:42.314501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d29dd-47bc-42ea-b9f2-3f2dfd6f8550 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:42.314896 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d29dd-47bc-42ea-b9f2-3f2dfd6f8550 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:42.315238 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d29dd-47bc-42ea-b9f2-3f2dfd6f8550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:42.337123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-9b2d29dd-47bc-42ea-b9f2-3f2dfd6f8550 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:34:42.338300 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9b2d29dd-47bc-42ea-b9f2-3f2dfd6f8550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:42.346531 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1299/2612] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:34:42.350870 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f14bd-ef45-4bee-a831-b1575ddbd685 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:42.360943 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f14bd-ef45-4bee-a831-b1575ddbd685 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:42.366068 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc252f-dc71-4595-957b-99f37c4a1187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:42.366758 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc252f-dc71-4595-957b-99f37c4a1187 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:42.367053 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc252f-dc71-4595-957b-99f37c4a1187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:42.367331 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc252f-dc71-4595-957b-99f37c4a1187 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:42.368215 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc252f-dc71-4595-957b-99f37c4a1187 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:34:42.368527 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc252f-dc71-4595-957b-99f37c4a1187 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:42.370149 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc252f-dc71-4595-957b-99f37c4a1187 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:42.386910 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1314/2613] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:34:42.388205 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d29dd-47bc-42ea-b9f2-3f2dfd6f8550 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:42.398628 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d29dd-47bc-42ea-b9f2-3f2dfd6f8550 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:42.403659 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2053b5-b984-421d-a8d6-aa5ffa2e1284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:42.404379 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2053b5-b984-421d-a8d6-aa5ffa2e1284 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:42.404747 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2053b5-b984-421d-a8d6-aa5ffa2e1284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:42.405086 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2053b5-b984-421d-a8d6-aa5ffa2e1284 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:42.405885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2053b5-b984-421d-a8d6-aa5ffa2e1284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:42.407907 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2053b5-b984-421d-a8d6-aa5ffa2e1284 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:42.568058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1300/2614] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:34:42 2022] POST /identity/v3/projects => generated 367 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:34:42.572705 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc252f-dc71-4595-957b-99f37c4a1187 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:42.582828 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc252f-dc71-4595-957b-99f37c4a1187 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:42.645578 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cbc27-4eac-46f4-8475-73e36d806b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:42.646312 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cbc27-4eac-46f4-8475-73e36d806b49 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:42.646600 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cbc27-4eac-46f4-8475-73e36d806b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:42.646883 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cbc27-4eac-46f4-8475-73e36d806b49 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:42.647623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cbc27-4eac-46f4-8475-73e36d806b49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:42.649572 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cbc27-4eac-46f4-8475-73e36d806b49 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:42.751120 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1315/2615] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:34:42 2022] POST /identity/v3/users => generated 284 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:34:42.754946 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2053b5-b984-421d-a8d6-aa5ffa2e1284 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:42.767315 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2053b5-b984-421d-a8d6-aa5ffa2e1284 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:42.772095 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500dfa6-98b1-4d57-bdf4-c57b7355a2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:42.777971 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500dfa6-98b1-4d57-bdf4-c57b7355a2bc admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:42.777971 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500dfa6-98b1-4d57-bdf4-c57b7355a2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:42.777971 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500dfa6-98b1-4d57-bdf4-c57b7355a2bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:42.777971 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500dfa6-98b1-4d57-bdf4-c57b7355a2bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:42.777971 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500dfa6-98b1-4d57-bdf4-c57b7355a2bc admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:42.789833 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1301/2616] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:34:42.791702 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cbc27-4eac-46f4-8475-73e36d806b49 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:42.802107 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cbc27-4eac-46f4-8475-73e36d806b49 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:42.807548 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76775d6-0e7d-44d8-9cff-7c1c7b7337b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:42.808202 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76775d6-0e7d-44d8-9cff-7c1c7b7337b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:42.808488 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76775d6-0e7d-44d8-9cff-7c1c7b7337b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:42.808766 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76775d6-0e7d-44d8-9cff-7c1c7b7337b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:42.809491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76775d6-0e7d-44d8-9cff-7c1c7b7337b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:42.811112 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76775d6-0e7d-44d8-9cff-7c1c7b7337b4 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:42.823100 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1316/2617] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:34:42.827330 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500dfa6-98b1-4d57-bdf4-c57b7355a2bc admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:42.838780 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500dfa6-98b1-4d57-bdf4-c57b7355a2bc admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:42.843832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbb4b5-08ad-49e8-b847-c435ea46b2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:42.844720 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbb4b5-08ad-49e8-b847-c435ea46b2ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:42.844996 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbb4b5-08ad-49e8-b847-c435ea46b2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:42.845265 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbb4b5-08ad-49e8-b847-c435ea46b2ae admin admin] PATH_INFO: `/v3/projects/02134d30ff7e413aa2ffe31ebcb9a738/users/5fb27da6feb9456baa00e9dcd7f01916/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:42.863442 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbb4b5-08ad-49e8-b847-c435ea46b2ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=02134d30ff7e413aa2ffe31ebcb9a738, user_id=5fb27da6feb9456baa00e9dcd7f01916, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:42.867504 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbb4b5-08ad-49e8-b847-c435ea46b2ae admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:42.989499 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1302/2618] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:34:42 2022] PUT /identity/v3/projects/02134d30ff7e413aa2ffe31ebcb9a738/users/5fb27da6feb9456baa00e9dcd7f01916/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:34:43.002155 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d23ee0-7d20-45ea-9179-0c6373d49efe None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:43.002568 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d23ee0-7d20-45ea-9179-0c6373d49efe None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:43.003329 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d23ee0-7d20-45ea-9179-0c6373d49efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:43.018927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:43.033289 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-23d23ee0-7d20-45ea-9179-0c6373d49efe None None] MFA Rules not processed for user `5fb27da6feb9456baa00e9dcd7f01916`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:34:43.034549 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-23d23ee0-7d20-45ea-9179-0c6373d49efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:43.098870 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1317/2619] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:34:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:34:43.105100 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbb4b5-08ad-49e8-b847-c435ea46b2ae admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:43.179435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:43.218770 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbb4b5-08ad-49e8-b847-c435ea46b2ae admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:43.226424 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c099669-e284-47c9-9f27-c5009c860ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:43.227104 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c099669-e284-47c9-9f27-c5009c860ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:43.227387 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c099669-e284-47c9-9f27-c5009c860ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:43.227741 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c099669-e284-47c9-9f27-c5009c860ca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:43.229223 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c099669-e284-47c9-9f27-c5009c860ca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:43.231220 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c099669-e284-47c9-9f27-c5009c860ca7 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:43.326418 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1303/2620] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:34:43 2022] POST /identity/v3/projects => generated 365 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:34:43.327997 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d23ee0-7d20-45ea-9179-0c6373d49efe None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:43.344393 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d23ee0-7d20-45ea-9179-0c6373d49efe None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:43.446912 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a270804-2842-444d-a0a7-e7f72b0557ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:43.447714 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a270804-2842-444d-a0a7-e7f72b0557ec admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:43.448099 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a270804-2842-444d-a0a7-e7f72b0557ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:43.448439 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a270804-2842-444d-a0a7-e7f72b0557ec admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:43.449345 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a270804-2842-444d-a0a7-e7f72b0557ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:43.451442 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a270804-2842-444d-a0a7-e7f72b0557ec admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:43.550514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1318/2621] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:34:43 2022] POST /identity/v3/users => generated 289 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:34:43.555324 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c099669-e284-47c9-9f27-c5009c860ca7 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:43.566774 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c099669-e284-47c9-9f27-c5009c860ca7 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:43.572376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da6e84-5b81-43d8-a119-b001bebd5df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:43.573139 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da6e84-5b81-43d8-a119-b001bebd5df1 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:43.573492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da6e84-5b81-43d8-a119-b001bebd5df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:43.573836 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da6e84-5b81-43d8-a119-b001bebd5df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:43.574684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da6e84-5b81-43d8-a119-b001bebd5df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:43.576374 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da6e84-5b81-43d8-a119-b001bebd5df1 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:43.591751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1304/2622] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:34:43.597327 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a270804-2842-444d-a0a7-e7f72b0557ec admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:43.608742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a270804-2842-444d-a0a7-e7f72b0557ec admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:43.614194 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3fca6-5393-40c3-b3a7-d059be34cb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:43.615657 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3fca6-5393-40c3-b3a7-d059be34cb34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:43.616056 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3fca6-5393-40c3-b3a7-d059be34cb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:43.616465 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3fca6-5393-40c3-b3a7-d059be34cb34 admin admin] PATH_INFO: `/v3/projects/ae915e2165ec450abeb59e5dc1a8b0c3/users/7af7c7b3cc874e3f8c2deb947a5e4a72/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:43.633789 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3fca6-5393-40c3-b3a7-d059be34cb34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae915e2165ec450abeb59e5dc1a8b0c3, user_id=7af7c7b3cc874e3f8c2deb947a5e4a72, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:43.636458 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3fca6-5393-40c3-b3a7-d059be34cb34 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:43.745288 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1319/2623] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:34:43 2022] PUT /identity/v3/projects/ae915e2165ec450abeb59e5dc1a8b0c3/users/7af7c7b3cc874e3f8c2deb947a5e4a72/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:34:43.749434 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da6e84-5b81-43d8-a119-b001bebd5df1 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:43.760604 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da6e84-5b81-43d8-a119-b001bebd5df1 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:43.822523 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab3014-eb46-4c19-9186-162ed801bd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:43.823198 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab3014-eb46-4c19-9186-162ed801bd9f admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:43.823490 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab3014-eb46-4c19-9186-162ed801bd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:43.823765 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab3014-eb46-4c19-9186-162ed801bd9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:43.824498 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab3014-eb46-4c19-9186-162ed801bd9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:43.826102 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab3014-eb46-4c19-9186-162ed801bd9f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:43.837103 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1305/2624] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:34:43.841369 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3fca6-5393-40c3-b3a7-d059be34cb34 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:43.852282 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3fca6-5393-40c3-b3a7-d059be34cb34 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:43.856979 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b1ee8-a6c6-441c-b0d2-594752edc4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:43.857867 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b1ee8-a6c6-441c-b0d2-594752edc4e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:43.858171 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b1ee8-a6c6-441c-b0d2-594752edc4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:43.858454 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b1ee8-a6c6-441c-b0d2-594752edc4e6 admin admin] PATH_INFO: `/v3/projects/ae915e2165ec450abeb59e5dc1a8b0c3/users/7af7c7b3cc874e3f8c2deb947a5e4a72/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:43.860468 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b1ee8-a6c6-441c-b0d2-594752edc4e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae915e2165ec450abeb59e5dc1a8b0c3, user_id=7af7c7b3cc874e3f8c2deb947a5e4a72, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:43.863219 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b1ee8-a6c6-441c-b0d2-594752edc4e6 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:43.874608 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1320/2625] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:34:43 2022] PUT /identity/v3/projects/ae915e2165ec450abeb59e5dc1a8b0c3/users/7af7c7b3cc874e3f8c2deb947a5e4a72/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:34:43.885780 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed623612-c97c-46cf-939c-762576b6d19a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:43.885996 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed623612-c97c-46cf-939c-762576b6d19a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:43.886315 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed623612-c97c-46cf-939c-762576b6d19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:43.914187 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-ed623612-c97c-46cf-939c-762576b6d19a None None] MFA Rules not processed for user `7af7c7b3cc874e3f8c2deb947a5e4a72`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:34:43.915405 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ed623612-c97c-46cf-939c-762576b6d19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:43.993330 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1306/2626] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:34:43 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:34:44.004108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b1ee8-a6c6-441c-b0d2-594752edc4e6 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:44.006217 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5e1b1ee8-a6c6-441c-b0d2-594752edc4e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:44.066886 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed623612-c97c-46cf-939c-762576b6d19a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:44.068616 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ed623612-c97c-46cf-939c-762576b6d19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:44.097809 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:44.104750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b1ee8-a6c6-441c-b0d2-594752edc4e6 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:44.109712 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df32dc-17c1-4d0c-8c47-8bf0b87d0253 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:44.111502 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df32dc-17c1-4d0c-8c47-8bf0b87d0253 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:44.111798 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df32dc-17c1-4d0c-8c47-8bf0b87d0253 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:44.112085 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df32dc-17c1-4d0c-8c47-8bf0b87d0253 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:44.112863 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:44.124497 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df32dc-17c1-4d0c-8c47-8bf0b87d0253 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:44.126139 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df32dc-17c1-4d0c-8c47-8bf0b87d0253 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:44.138832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed623612-c97c-46cf-939c-762576b6d19a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:44.142982 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84144d0-a3cc-4f4a-a261-762f0e7ee73a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:44.144164 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84144d0-a3cc-4f4a-a261-762f0e7ee73a service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:44.144751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84144d0-a3cc-4f4a-a261-762f0e7ee73a service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:44.145188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84144d0-a3cc-4f4a-a261-762f0e7ee73a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:44.148046 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a84144d0-a3cc-4f4a-a261-762f0e7ee73a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:44.149729 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1321/2627] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:34:44 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:34:44.228857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84144d0-a3cc-4f4a-a261-762f0e7ee73a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:44.230339 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84144d0-a3cc-4f4a-a261-762f0e7ee73a service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:44.240270 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1307/2628] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:34:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:34:44.401326 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df32dc-17c1-4d0c-8c47-8bf0b87d0253 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:44.411030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df32dc-17c1-4d0c-8c47-8bf0b87d0253 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:44.426040 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b143a0-fff1-49bc-9722-579575fda53a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:44.426733 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b143a0-fff1-49bc-9722-579575fda53a service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:44.427021 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b143a0-fff1-49bc-9722-579575fda53a service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:44.427819 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b143a0-fff1-49bc-9722-579575fda53a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:44.528846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b143a0-fff1-49bc-9722-579575fda53a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:44.531229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b143a0-fff1-49bc-9722-579575fda53a service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:44.563286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1322/2629] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:34:44 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:34:50.357132 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84144d0-a3cc-4f4a-a261-762f0e7ee73a service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:50.358789 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a84144d0-a3cc-4f4a-a261-762f0e7ee73a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:50.432661 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84144d0-a3cc-4f4a-a261-762f0e7ee73a service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:50.437327 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f51f5-65c0-4062-bca9-64792271cc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:50.438217 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f51f5-65c0-4062-bca9-64792271cc34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:50.438496 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f51f5-65c0-4062-bca9-64792271cc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:50.438766 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f51f5-65c0-4062-bca9-64792271cc34 admin admin] PATH_INFO: `/v3/users/b5520ffe9cbd422b9a4794dca2e5d444` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:50.439991 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f51f5-65c0-4062-bca9-64792271cc34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5520ffe9cbd422b9a4794dca2e5d444)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:50.441919 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f51f5-65c0-4062-bca9-64792271cc34 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:50.705028 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ca2f51f5-65c0-4062-bca9-64792271cc34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5520ffe9cbd422b9a4794dca2e5d444'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:50.713304 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ca2f51f5-65c0-4062-bca9-64792271cc34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5520ffe9cbd422b9a4794dca2e5d444'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:50.725685 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ca2f51f5-65c0-4062-bca9-64792271cc34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5520ffe9cbd422b9a4794dca2e5d444'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:50.726411 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ca2f51f5-65c0-4062-bca9-64792271cc34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5520ffe9cbd422b9a4794dca2e5d444'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:50.851538 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ca2f51f5-65c0-4062-bca9-64792271cc34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5520ffe9cbd422b9a4794dca2e5d444'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:50.854047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:50.858603 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1308/2630] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:34:50 2022] DELETE /identity/v3/users/b5520ffe9cbd422b9a4794dca2e5d444 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:34:51.145229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b143a0-fff1-49bc-9722-579575fda53a service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:51.156393 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b143a0-fff1-49bc-9722-579575fda53a service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:51.217521 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b503d6-3253-492d-a796-a1a9e03b422e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:51.218425 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b503d6-3253-492d-a796-a1a9e03b422e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:51.218711 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b503d6-3253-492d-a796-a1a9e03b422e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:51.218992 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b503d6-3253-492d-a796-a1a9e03b422e admin admin] PATH_INFO: `/v3/projects/e1d7648c74b4459683d0da60b9ce1a43` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:51.220168 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b503d6-3253-492d-a796-a1a9e03b422e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1d7648c74b4459683d0da60b9ce1a43)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:51.222059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b503d6-3253-492d-a796-a1a9e03b422e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:51.356433 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-22b503d6-3253-492d-a796-a1a9e03b422e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1d7648c74b4459683d0da60b9ce1a43', 'request_id': 'req-22b503d6-3253-492d-a796-a1a9e03b422e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:51.450583 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-22b503d6-3253-492d-a796-a1a9e03b422e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1d7648c74b4459683d0da60b9ce1a43', 'request_id': 'req-22b503d6-3253-492d-a796-a1a9e03b422e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:51.459265 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-22b503d6-3253-492d-a796-a1a9e03b422e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1d7648c74b4459683d0da60b9ce1a43', 'request_id': 'req-22b503d6-3253-492d-a796-a1a9e03b422e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:51.472292 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-22b503d6-3253-492d-a796-a1a9e03b422e admin admin] The token cache is being invalidate because project e1d7648c74b4459683d0da60b9ce1a43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:34:51.472596 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-22b503d6-3253-492d-a796-a1a9e03b422e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:51.473279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-22b503d6-3253-492d-a796-a1a9e03b422e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:51.475569 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1323/2631] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:34:51 2022] DELETE /identity/v3/projects/e1d7648c74b4459683d0da60b9ce1a43 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:34:51.479671 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f51f5-65c0-4062-bca9-64792271cc34 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:51.484142 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-ca2f51f5-65c0-4062-bca9-64792271cc34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:51.498736 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f51f5-65c0-4062-bca9-64792271cc34 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:51.561048 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4887f-b3eb-46e2-8343-2c6797f883bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:51.561925 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4887f-b3eb-46e2-8343-2c6797f883bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:51.562235 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4887f-b3eb-46e2-8343-2c6797f883bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:51.562517 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4887f-b3eb-46e2-8343-2c6797f883bd admin admin] PATH_INFO: `/v3/users/eb281985113d45bbbbaf1a0fbc628689` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:51.563752 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4887f-b3eb-46e2-8343-2c6797f883bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb281985113d45bbbbaf1a0fbc628689)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:51.565867 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4887f-b3eb-46e2-8343-2c6797f883bd admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:51.792226 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-49e4887f-b3eb-46e2-8343-2c6797f883bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb281985113d45bbbbaf1a0fbc628689'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:51.799422 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-49e4887f-b3eb-46e2-8343-2c6797f883bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb281985113d45bbbbaf1a0fbc628689'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:51.814378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-49e4887f-b3eb-46e2-8343-2c6797f883bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb281985113d45bbbbaf1a0fbc628689'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:51.814378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-49e4887f-b3eb-46e2-8343-2c6797f883bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb281985113d45bbbbaf1a0fbc628689'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:51.859617 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b503d6-3253-492d-a796-a1a9e03b422e admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:51.861046 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-22b503d6-3253-492d-a796-a1a9e03b422e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:51.875063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b503d6-3253-492d-a796-a1a9e03b422e admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:51.879746 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0165f1c-e72a-4bf2-8203-bc27f8333aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:51.882711 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0165f1c-e72a-4bf2-8203-bc27f8333aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:51.882711 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0165f1c-e72a-4bf2-8203-bc27f8333aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:51.882711 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0165f1c-e72a-4bf2-8203-bc27f8333aae admin admin] PATH_INFO: `/v3/users/5fb27da6feb9456baa00e9dcd7f01916` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:51.882991 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0165f1c-e72a-4bf2-8203-bc27f8333aae admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fb27da6feb9456baa00e9dcd7f01916)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:51.884983 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0165f1c-e72a-4bf2-8203-bc27f8333aae admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:51.899181 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:51.904055 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-49e4887f-b3eb-46e2-8343-2c6797f883bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb281985113d45bbbbaf1a0fbc628689'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:51.910746 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1309/2632] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:34:51 2022] DELETE /identity/v3/users/eb281985113d45bbbbaf1a0fbc628689 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:34:52.215442 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4887f-b3eb-46e2-8343-2c6797f883bd admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:52.216971 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-49e4887f-b3eb-46e2-8343-2c6797f883bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:52.261031 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e0165f1c-e72a-4bf2-8203-bc27f8333aae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fb27da6feb9456baa00e9dcd7f01916'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:52.284569 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4887f-b3eb-46e2-8343-2c6797f883bd admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:52.289934 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac5824-5d2e-4ab1-a1db-0b3b9b4c7d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:52.290841 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac5824-5d2e-4ab1-a1db-0b3b9b4c7d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:52.291131 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac5824-5d2e-4ab1-a1db-0b3b9b4c7d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:52.291460 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac5824-5d2e-4ab1-a1db-0b3b9b4c7d97 admin admin] PATH_INFO: `/v3/projects/919917e3440d49e2975beb7ec7aaaa2b` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:52.292635 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac5824-5d2e-4ab1-a1db-0b3b9b4c7d97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=919917e3440d49e2975beb7ec7aaaa2b)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:52.294566 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac5824-5d2e-4ab1-a1db-0b3b9b4c7d97 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:52.317583 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:52.342103 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e0165f1c-e72a-4bf2-8203-bc27f8333aae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fb27da6feb9456baa00e9dcd7f01916'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:52.355393 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e0165f1c-e72a-4bf2-8203-bc27f8333aae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fb27da6feb9456baa00e9dcd7f01916'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:52.362343 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e0165f1c-e72a-4bf2-8203-bc27f8333aae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fb27da6feb9456baa00e9dcd7f01916'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:52.362998 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-e0165f1c-e72a-4bf2-8203-bc27f8333aae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fb27da6feb9456baa00e9dcd7f01916'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:52.369340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1324/2633] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:34:51 2022] DELETE /identity/v3/users/5fb27da6feb9456baa00e9dcd7f01916 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:34:52.373663 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86de0cf-42d4-4752-8c87-e01d29649daa None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:52.373960 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86de0cf-42d4-4752-8c87-e01d29649daa None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:52.374281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86de0cf-42d4-4752-8c87-e01d29649daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:52.393353 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-c86de0cf-42d4-4752-8c87-e01d29649daa None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:34:52.394625 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c86de0cf-42d4-4752-8c87-e01d29649daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:52.452868 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1325/2634] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:34:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:34:52.462945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86de0cf-42d4-4752-8c87-e01d29649daa None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:52.464377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c86de0cf-42d4-4752-8c87-e01d29649daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:52.485493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-f4ac5824-5d2e-4ab1-a1db-0b3b9b4c7d97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '919917e3440d49e2975beb7ec7aaaa2b', 'request_id': 'req-f4ac5824-5d2e-4ab1-a1db-0b3b9b4c7d97'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:52.492350 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-f4ac5824-5d2e-4ab1-a1db-0b3b9b4c7d97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '919917e3440d49e2975beb7ec7aaaa2b', 'request_id': 'req-f4ac5824-5d2e-4ab1-a1db-0b3b9b4c7d97'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:52.526433 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86de0cf-42d4-4752-8c87-e01d29649daa None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:52.570026 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:52.574535 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115247f9-4ae7-41d3-a4d9-39a9993ca4d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:52.575279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115247f9-4ae7-41d3-a4d9-39a9993ca4d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:52.575621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115247f9-4ae7-41d3-a4d9-39a9993ca4d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:52.575932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115247f9-4ae7-41d3-a4d9-39a9993ca4d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:52.599080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-f4ac5824-5d2e-4ab1-a1db-0b3b9b4c7d97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '919917e3440d49e2975beb7ec7aaaa2b', 'request_id': 'req-f4ac5824-5d2e-4ab1-a1db-0b3b9b4c7d97'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:52.611290 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-f4ac5824-5d2e-4ab1-a1db-0b3b9b4c7d97 admin admin] The token cache is being invalidate because project 919917e3440d49e2975beb7ec7aaaa2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:34:52.611576 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-f4ac5824-5d2e-4ab1-a1db-0b3b9b4c7d97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:52.612218 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-f4ac5824-5d2e-4ab1-a1db-0b3b9b4c7d97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:52.614077 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1310/2635] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:34:52 2022] DELETE /identity/v3/projects/919917e3440d49e2975beb7ec7aaaa2b => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:34:52.640016 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115247f9-4ae7-41d3-a4d9-39a9993ca4d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:52.641595 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115247f9-4ae7-41d3-a4d9-39a9993ca4d7 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:52.653554 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1326/2636] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:34:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:34:53.162012 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac5824-5d2e-4ab1-a1db-0b3b9b4c7d97 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:53.163488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f4ac5824-5d2e-4ab1-a1db-0b3b9b4c7d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:53.180780 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac5824-5d2e-4ab1-a1db-0b3b9b4c7d97 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:53.186216 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4900f-221b-44a8-85d5-063d29be8f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:53.187587 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4900f-221b-44a8-85d5-063d29be8f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:53.191277 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4900f-221b-44a8-85d5-063d29be8f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:53.191277 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4900f-221b-44a8-85d5-063d29be8f73 admin admin] PATH_INFO: `/v3/projects/02134d30ff7e413aa2ffe31ebcb9a738` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:53.191277 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4900f-221b-44a8-85d5-063d29be8f73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02134d30ff7e413aa2ffe31ebcb9a738)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:53.191277 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4900f-221b-44a8-85d5-063d29be8f73 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:53.335424 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-87e4900f-221b-44a8-85d5-063d29be8f73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02134d30ff7e413aa2ffe31ebcb9a738', 'request_id': 'req-87e4900f-221b-44a8-85d5-063d29be8f73'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:53.341363 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-87e4900f-221b-44a8-85d5-063d29be8f73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02134d30ff7e413aa2ffe31ebcb9a738', 'request_id': 'req-87e4900f-221b-44a8-85d5-063d29be8f73'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:53.423716 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-87e4900f-221b-44a8-85d5-063d29be8f73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02134d30ff7e413aa2ffe31ebcb9a738', 'request_id': 'req-87e4900f-221b-44a8-85d5-063d29be8f73'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:53.435083 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-87e4900f-221b-44a8-85d5-063d29be8f73 admin admin] The token cache is being invalidate because project 02134d30ff7e413aa2ffe31ebcb9a738 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:34:53.435368 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-87e4900f-221b-44a8-85d5-063d29be8f73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:53.435988 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-87e4900f-221b-44a8-85d5-063d29be8f73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:53.437513 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1311/2637] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:34:53 2022] DELETE /identity/v3/projects/02134d30ff7e413aa2ffe31ebcb9a738 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:34:53.441467 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115247f9-4ae7-41d3-a4d9-39a9993ca4d7 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:53.443392 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-115247f9-4ae7-41d3-a4d9-39a9993ca4d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:53.455633 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115247f9-4ae7-41d3-a4d9-39a9993ca4d7 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:53.512757 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e795d-85ee-4ba8-90d6-c6086842d737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:53.513623 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e795d-85ee-4ba8-90d6-c6086842d737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:53.513905 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e795d-85ee-4ba8-90d6-c6086842d737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:53.514238 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e795d-85ee-4ba8-90d6-c6086842d737 admin admin] PATH_INFO: `/v3/users/7af7c7b3cc874e3f8c2deb947a5e4a72` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:53.515398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e795d-85ee-4ba8-90d6-c6086842d737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7af7c7b3cc874e3f8c2deb947a5e4a72)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:53.517321 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e795d-85ee-4ba8-90d6-c6086842d737 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:53.694669 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ff0e795d-85ee-4ba8-90d6-c6086842d737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7af7c7b3cc874e3f8c2deb947a5e4a72'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:53.772393 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ff0e795d-85ee-4ba8-90d6-c6086842d737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7af7c7b3cc874e3f8c2deb947a5e4a72'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:53.784841 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ff0e795d-85ee-4ba8-90d6-c6086842d737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7af7c7b3cc874e3f8c2deb947a5e4a72'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:53.792138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ff0e795d-85ee-4ba8-90d6-c6086842d737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7af7c7b3cc874e3f8c2deb947a5e4a72'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:53.792776 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-ff0e795d-85ee-4ba8-90d6-c6086842d737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7af7c7b3cc874e3f8c2deb947a5e4a72'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:53.798672 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1327/2638] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:34:53 2022] DELETE /identity/v3/users/7af7c7b3cc874e3f8c2deb947a5e4a72 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:34:54.361623 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4900f-221b-44a8-85d5-063d29be8f73 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:54.363192 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-87e4900f-221b-44a8-85d5-063d29be8f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:54.376514 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4900f-221b-44a8-85d5-063d29be8f73 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:54.438859 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547e51f-f4fa-4ad7-b72f-efdd6e3d6ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:54.439723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547e51f-f4fa-4ad7-b72f-efdd6e3d6ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:54.440035 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547e51f-f4fa-4ad7-b72f-efdd6e3d6ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:54.440332 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547e51f-f4fa-4ad7-b72f-efdd6e3d6ddd admin admin] PATH_INFO: `/v3/projects/ae915e2165ec450abeb59e5dc1a8b0c3` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:54.441544 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9547e51f-f4fa-4ad7-b72f-efdd6e3d6ddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae915e2165ec450abeb59e5dc1a8b0c3)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:54.445991 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9547e51f-f4fa-4ad7-b72f-efdd6e3d6ddd admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:54.660815 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:54.670737 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9547e51f-f4fa-4ad7-b72f-efdd6e3d6ddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae915e2165ec450abeb59e5dc1a8b0c3', 'request_id': 'req-9547e51f-f4fa-4ad7-b72f-efdd6e3d6ddd'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:54.675948 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9547e51f-f4fa-4ad7-b72f-efdd6e3d6ddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae915e2165ec450abeb59e5dc1a8b0c3', 'request_id': 'req-9547e51f-f4fa-4ad7-b72f-efdd6e3d6ddd'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:54.749102 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9547e51f-f4fa-4ad7-b72f-efdd6e3d6ddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae915e2165ec450abeb59e5dc1a8b0c3', 'request_id': 'req-9547e51f-f4fa-4ad7-b72f-efdd6e3d6ddd'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:54.760719 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9547e51f-f4fa-4ad7-b72f-efdd6e3d6ddd admin admin] The token cache is being invalidate because project ae915e2165ec450abeb59e5dc1a8b0c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:34:54.761009 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9547e51f-f4fa-4ad7-b72f-efdd6e3d6ddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:54.761663 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9547e51f-f4fa-4ad7-b72f-efdd6e3d6ddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:34:54.763250 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1312/2639] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:34:54 2022] DELETE /identity/v3/projects/ae915e2165ec450abeb59e5dc1a8b0c3 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:34:54.768267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c9a7f-69af-404a-8084-ff59f5fb321b None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:54.768731 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c9a7f-69af-404a-8084-ff59f5fb321b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:54.768851 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c9a7f-69af-404a-8084-ff59f5fb321b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:54.787043 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-508c9a7f-69af-404a-8084-ff59f5fb321b None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:34:54.789274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-508c9a7f-69af-404a-8084-ff59f5fb321b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:54.801227 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:34:54.846677 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1328/2640] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:34:54.855830 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b7620-d60e-4380-b986-91979b4f2964 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:54.856179 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b7620-d60e-4380-b986-91979b4f2964 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:54.856417 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b7620-d60e-4380-b986-91979b4f2964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:54.875383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-fc3b7620-d60e-4380-b986-91979b4f2964 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:34:54.876621 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-fc3b7620-d60e-4380-b986-91979b4f2964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:54.884944 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1313/2641] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:34:54.889089 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c9a7f-69af-404a-8084-ff59f5fb321b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:54.899723 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c9a7f-69af-404a-8084-ff59f5fb321b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:54.904642 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd84bed-be36-455e-b0fe-6dff6fb4725c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:54.905331 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd84bed-be36-455e-b0fe-6dff6fb4725c admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:54.905625 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd84bed-be36-455e-b0fe-6dff6fb4725c admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:54.905937 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd84bed-be36-455e-b0fe-6dff6fb4725c admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:54.906724 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd84bed-be36-455e-b0fe-6dff6fb4725c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:34:54.907039 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd84bed-be36-455e-b0fe-6dff6fb4725c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:54.908686 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd84bed-be36-455e-b0fe-6dff6fb4725c admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:54.921512 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1329/2642] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:34:54.925932 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b7620-d60e-4380-b986-91979b4f2964 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:54.935630 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b7620-d60e-4380-b986-91979b4f2964 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:54.940409 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5133c-a325-46dc-b12e-2c807972ea57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:54.941058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5133c-a325-46dc-b12e-2c807972ea57 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:54.942095 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5133c-a325-46dc-b12e-2c807972ea57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:54.942095 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5133c-a325-46dc-b12e-2c807972ea57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:54.942583 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5133c-a325-46dc-b12e-2c807972ea57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:54.944644 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5133c-a325-46dc-b12e-2c807972ea57 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:55.061890 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1314/2643] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:34:54 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:34:55.066185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd84bed-be36-455e-b0fe-6dff6fb4725c admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:55.077671 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd84bed-be36-455e-b0fe-6dff6fb4725c admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:55.134589 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcb5a5-1551-4c12-ae3c-c8e15633a55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:55.135427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcb5a5-1551-4c12-ae3c-c8e15633a55f admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:55.135729 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcb5a5-1551-4c12-ae3c-c8e15633a55f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:55.136006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcb5a5-1551-4c12-ae3c-c8e15633a55f admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:55.136685 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdcb5a5-1551-4c12-ae3c-c8e15633a55f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:55.138641 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdcb5a5-1551-4c12-ae3c-c8e15633a55f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:55.235275 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1330/2644] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:34:55 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:34:55.239652 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5133c-a325-46dc-b12e-2c807972ea57 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:55.250402 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5133c-a325-46dc-b12e-2c807972ea57 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:55.255136 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d55d4-8bf4-418c-b930-6081a3ddeb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:55.255789 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d55d4-8bf4-418c-b930-6081a3ddeb9d admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:55.256620 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d55d4-8bf4-418c-b930-6081a3ddeb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:55.256904 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d55d4-8bf4-418c-b930-6081a3ddeb9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:55.257771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d55d4-8bf4-418c-b930-6081a3ddeb9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:55.259408 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d55d4-8bf4-418c-b930-6081a3ddeb9d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:55.270442 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1315/2645] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:34:55.275271 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcb5a5-1551-4c12-ae3c-c8e15633a55f admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:55.285838 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcb5a5-1551-4c12-ae3c-c8e15633a55f admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:55.290866 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403bac1-4c22-4523-8f21-96e6f13f8069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:55.291523 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403bac1-4c22-4523-8f21-96e6f13f8069 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:55.293104 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403bac1-4c22-4523-8f21-96e6f13f8069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:55.293104 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403bac1-4c22-4523-8f21-96e6f13f8069 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:55.293104 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403bac1-4c22-4523-8f21-96e6f13f8069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:55.294422 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403bac1-4c22-4523-8f21-96e6f13f8069 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:55.307847 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1331/2646] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:34:55.309041 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d55d4-8bf4-418c-b930-6081a3ddeb9d admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:55.320995 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d55d4-8bf4-418c-b930-6081a3ddeb9d admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:55.326025 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37e080-a77a-4a85-ae19-ba675d5634a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:55.326950 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37e080-a77a-4a85-ae19-ba675d5634a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:55.327236 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37e080-a77a-4a85-ae19-ba675d5634a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:55.327518 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37e080-a77a-4a85-ae19-ba675d5634a6 admin admin] PATH_INFO: `/v3/projects/8f23ede6a1364ea0b7dd9720a84de932/users/7f6d00f7cc254f66beebb27b6a0627ce/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:55.348517 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37e080-a77a-4a85-ae19-ba675d5634a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f23ede6a1364ea0b7dd9720a84de932, user_id=7f6d00f7cc254f66beebb27b6a0627ce, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:55.351463 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37e080-a77a-4a85-ae19-ba675d5634a6 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:55.467564 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1316/2647] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:34:55 2022] PUT /identity/v3/projects/8f23ede6a1364ea0b7dd9720a84de932/users/7f6d00f7cc254f66beebb27b6a0627ce/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:34:55.478707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2096cb-3b52-47e0-b757-e49ce4a61189 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:55.479001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2096cb-3b52-47e0-b757-e49ce4a61189 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:55.479281 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2096cb-3b52-47e0-b757-e49ce4a61189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:55.507364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-4e2096cb-3b52-47e0-b757-e49ce4a61189 None None] MFA Rules not processed for user `7f6d00f7cc254f66beebb27b6a0627ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:34:55.508622 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4e2096cb-3b52-47e0-b757-e49ce4a61189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:55.572259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1332/2648] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:34:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:34:55.583368 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37e080-a77a-4a85-ae19-ba675d5634a6 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:34:55.585175 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-0f37e080-a77a-4a85-ae19-ba675d5634a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:34:55.648419 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37e080-a77a-4a85-ae19-ba675d5634a6 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:34:55.652073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2013a-17c5-4955-9396-9489ef6e9207 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '436d7cc587bc4b2a8a3242fc39876ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:34:55.652710 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2013a-17c5-4955-9396-9489ef6e9207 service glance] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:34:55.652987 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2013a-17c5-4955-9396-9489ef6e9207 service glance] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:34:55.653259 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2013a-17c5-4955-9396-9489ef6e9207 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:34:55.661829 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2013a-17c5-4955-9396-9489ef6e9207 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:34:55.663329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2013a-17c5-4955-9396-9489ef6e9207 service glance] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:34:55.672510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1317/2649] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:34:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:35:00.069113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2096cb-3b52-47e0-b757-e49ce4a61189 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:00.074683 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4e2096cb-3b52-47e0-b757-e49ce4a61189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:00.089764 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:00.149616 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2096cb-3b52-47e0-b757-e49ce4a61189 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:00.154791 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cadf9-ceec-4d08-9cc5-c94be1c0af1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:00.155778 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cadf9-ceec-4d08-9cc5-c94be1c0af1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:00.156069 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cadf9-ceec-4d08-9cc5-c94be1c0af1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:00.156348 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cadf9-ceec-4d08-9cc5-c94be1c0af1e admin admin] PATH_INFO: `/v3/users/5ad58998f74e47a9bcfb13409341640c` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:00.157545 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46cadf9-ceec-4d08-9cc5-c94be1c0af1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ad58998f74e47a9bcfb13409341640c)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:00.159511 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46cadf9-ceec-4d08-9cc5-c94be1c0af1e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:00.403898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d46cadf9-ceec-4d08-9cc5-c94be1c0af1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ad58998f74e47a9bcfb13409341640c'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:00.495821 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d46cadf9-ceec-4d08-9cc5-c94be1c0af1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ad58998f74e47a9bcfb13409341640c'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:00.510062 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d46cadf9-ceec-4d08-9cc5-c94be1c0af1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ad58998f74e47a9bcfb13409341640c'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:00.517072 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d46cadf9-ceec-4d08-9cc5-c94be1c0af1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ad58998f74e47a9bcfb13409341640c'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:00.517803 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d46cadf9-ceec-4d08-9cc5-c94be1c0af1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ad58998f74e47a9bcfb13409341640c'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:00.524834 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1333/2650] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:35:00 2022] DELETE /identity/v3/users/5ad58998f74e47a9bcfb13409341640c => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:00.529396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c6d9d-0636-4cb7-aac3-216fe30ca6ee None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:00.529881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c6d9d-0636-4cb7-aac3-216fe30ca6ee None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:00.529980 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c6d9d-0636-4cb7-aac3-216fe30ca6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:00.549185 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-3e5c6d9d-0636-4cb7-aac3-216fe30ca6ee None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:00.550461 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3e5c6d9d-0636-4cb7-aac3-216fe30ca6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:00.612602 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1318/2651] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:35:00.623054 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cadf9-ceec-4d08-9cc5-c94be1c0af1e admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:00.624513 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-d46cadf9-ceec-4d08-9cc5-c94be1c0af1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:00.683693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cadf9-ceec-4d08-9cc5-c94be1c0af1e admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:00.687319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a93bd-cb46-46d6-8008-93243c1c90bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:00.687970 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a93bd-cb46-46d6-8008-93243c1c90bb service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:00.688253 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a93bd-cb46-46d6-8008-93243c1c90bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:00.688533 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a93bd-cb46-46d6-8008-93243c1c90bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:00.698150 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a93bd-cb46-46d6-8008-93243c1c90bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:00.699584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a93bd-cb46-46d6-8008-93243c1c90bb service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:00.709403 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1334/2652] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:35:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:35:01.143658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c6d9d-0636-4cb7-aac3-216fe30ca6ee None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:01.145209 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3e5c6d9d-0636-4cb7-aac3-216fe30ca6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:01.152772 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:01.158795 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c6d9d-0636-4cb7-aac3-216fe30ca6ee None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:01.164799 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d2fb5-890b-478f-80ec-d9bab1c500d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:01.168937 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d2fb5-890b-478f-80ec-d9bab1c500d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:01.168937 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d2fb5-890b-478f-80ec-d9bab1c500d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:01.168937 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d2fb5-890b-478f-80ec-d9bab1c500d7 admin admin] PATH_INFO: `/v3/projects/5487dc8dd888471fa98fc22132e2f798` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:01.171140 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d2fb5-890b-478f-80ec-d9bab1c500d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5487dc8dd888471fa98fc22132e2f798)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:01.173314 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d2fb5-890b-478f-80ec-d9bab1c500d7 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:01.306138 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8c0d2fb5-890b-478f-80ec-d9bab1c500d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5487dc8dd888471fa98fc22132e2f798', 'request_id': 'req-8c0d2fb5-890b-478f-80ec-d9bab1c500d7'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:01.311358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8c0d2fb5-890b-478f-80ec-d9bab1c500d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5487dc8dd888471fa98fc22132e2f798', 'request_id': 'req-8c0d2fb5-890b-478f-80ec-d9bab1c500d7'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:01.381069 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8c0d2fb5-890b-478f-80ec-d9bab1c500d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5487dc8dd888471fa98fc22132e2f798', 'request_id': 'req-8c0d2fb5-890b-478f-80ec-d9bab1c500d7'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:01.393963 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8c0d2fb5-890b-478f-80ec-d9bab1c500d7 admin admin] The token cache is being invalidate because project 5487dc8dd888471fa98fc22132e2f798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:35:01.394282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8c0d2fb5-890b-478f-80ec-d9bab1c500d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:01.395000 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8c0d2fb5-890b-478f-80ec-d9bab1c500d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:01.396600 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1319/2653] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:35:01 2022] DELETE /identity/v3/projects/5487dc8dd888471fa98fc22132e2f798 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:01.401166 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a93bd-cb46-46d6-8008-93243c1c90bb service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:01.411438 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a93bd-cb46-46d6-8008-93243c1c90bb service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:01.447296 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:01.477492 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7f5b9-167d-42e3-a6b1-80a4c074214c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:01.477492 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7f5b9-167d-42e3-a6b1-80a4c074214c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:01.477492 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7f5b9-167d-42e3-a6b1-80a4c074214c admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:01.477492 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7f5b9-167d-42e3-a6b1-80a4c074214c admin admin] PATH_INFO: `/v3/users/449488020abe4ecba565bf6849074bdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:01.478174 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7f5b9-167d-42e3-a6b1-80a4c074214c admin admin] RBAC: Authorizing `identity:delete_user(user_id=449488020abe4ecba565bf6849074bdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:01.479659 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7f5b9-167d-42e3-a6b1-80a4c074214c admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:01.706843 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-10e7f5b9-167d-42e3-a6b1-80a4c074214c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '449488020abe4ecba565bf6849074bdb'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:01.857567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-10e7f5b9-167d-42e3-a6b1-80a4c074214c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '449488020abe4ecba565bf6849074bdb'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:01.872160 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-10e7f5b9-167d-42e3-a6b1-80a4c074214c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '449488020abe4ecba565bf6849074bdb'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:01.879535 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-10e7f5b9-167d-42e3-a6b1-80a4c074214c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '449488020abe4ecba565bf6849074bdb'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:01.880270 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-10e7f5b9-167d-42e3-a6b1-80a4c074214c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '449488020abe4ecba565bf6849074bdb'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:01.887352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1335/2654] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:35:01 2022] DELETE /identity/v3/users/449488020abe4ecba565bf6849074bdb => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:01.898601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957daf9-aced-4005-9aed-601d5196984d None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:01.898601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957daf9-aced-4005-9aed-601d5196984d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:01.898601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957daf9-aced-4005-9aed-601d5196984d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:01.915672 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-4957daf9-aced-4005-9aed-601d5196984d None None] MFA Rules not processed for user `063ce3b820a74d648d709ab6ac4d7be2`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:01.916882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4957daf9-aced-4005-9aed-601d5196984d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:01.982644 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1320/2655] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Jul 5 21:35:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:35:01.995735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7f5b9-167d-42e3-a6b1-80a4c074214c admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:01.997178 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-10e7f5b9-167d-42e3-a6b1-80a4c074214c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:02.073641 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7f5b9-167d-42e3-a6b1-80a4c074214c admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:02.081118 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d1e0d-6726-4379-b788-78657817e430 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '441be62a077444b9b9f78714e24a760a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:02.081118 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d1e0d-6726-4379-b788-78657817e430 service swift] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:02.081118 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d1e0d-6726-4379-b788-78657817e430 service swift] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:02.081118 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d1e0d-6726-4379-b788-78657817e430 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:02.090340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d1e0d-6726-4379-b788-78657817e430 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:02.091975 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d1e0d-6726-4379-b788-78657817e430 service swift] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:02.101085 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1336/2656] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Jul 5 21:35:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 21:35:02.329641 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957daf9-aced-4005-9aed-601d5196984d None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:02.330334 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4957daf9-aced-4005-9aed-601d5196984d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:02.457792 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957daf9-aced-4005-9aed-601d5196984d None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:02.462754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529164ff-2ca1-429c-85f7-049f3f4be51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:02.463650 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529164ff-2ca1-429c-85f7-049f3f4be51c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:02.463931 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529164ff-2ca1-429c-85f7-049f3f4be51c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:02.464208 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529164ff-2ca1-429c-85f7-049f3f4be51c admin admin] PATH_INFO: `/v3/projects/13cb9ed6e9c8498cb25767c037d7bc58` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:02.472885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529164ff-2ca1-429c-85f7-049f3f4be51c admin admin] RBAC: Authorizing `identity:delete_project(project_id=13cb9ed6e9c8498cb25767c037d7bc58)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:02.474878 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529164ff-2ca1-429c-85f7-049f3f4be51c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:02.577547 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:02.603281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-529164ff-2ca1-429c-85f7-049f3f4be51c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13cb9ed6e9c8498cb25767c037d7bc58', 'request_id': 'req-529164ff-2ca1-429c-85f7-049f3f4be51c'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:02.609310 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-529164ff-2ca1-429c-85f7-049f3f4be51c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13cb9ed6e9c8498cb25767c037d7bc58', 'request_id': 'req-529164ff-2ca1-429c-85f7-049f3f4be51c'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:02.697588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-529164ff-2ca1-429c-85f7-049f3f4be51c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13cb9ed6e9c8498cb25767c037d7bc58', 'request_id': 'req-529164ff-2ca1-429c-85f7-049f3f4be51c'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:02.710100 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-529164ff-2ca1-429c-85f7-049f3f4be51c admin admin] The token cache is being invalidate because project 13cb9ed6e9c8498cb25767c037d7bc58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:35:02.712185 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-529164ff-2ca1-429c-85f7-049f3f4be51c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:02.712185 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-529164ff-2ca1-429c-85f7-049f3f4be51c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:02.712771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1321/2657] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:35:02 2022] DELETE /identity/v3/projects/13cb9ed6e9c8498cb25767c037d7bc58 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:02.718854 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7f3be-cfec-4c39-8ff8-a235183ca8f1 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:02.719421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7f3be-cfec-4c39-8ff8-a235183ca8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:02.719508 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7f3be-cfec-4c39-8ff8-a235183ca8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:02.743197 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-09c7f3be-cfec-4c39-8ff8-a235183ca8f1 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:02.744496 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-09c7f3be-cfec-4c39-8ff8-a235183ca8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:02.801744 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:02.822859 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1337/2658] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:35:02.830955 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad8ac0-433b-4414-9e45-c6ff307c9d59 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:02.832623 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad8ac0-433b-4414-9e45-c6ff307c9d59 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:02.832879 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad8ac0-433b-4414-9e45-c6ff307c9d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:02.867224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-abad8ac0-433b-4414-9e45-c6ff307c9d59 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:02.872858 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-abad8ac0-433b-4414-9e45-c6ff307c9d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:02.883648 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1322/2659] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:35:02.888384 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7f3be-cfec-4c39-8ff8-a235183ca8f1 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:02.906846 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7f3be-cfec-4c39-8ff8-a235183ca8f1 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:02.919986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6766254-d9db-4c51-97ff-8a18c2aae598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:02.920795 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6766254-d9db-4c51-97ff-8a18c2aae598 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:02.921189 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6766254-d9db-4c51-97ff-8a18c2aae598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:02.921518 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6766254-d9db-4c51-97ff-8a18c2aae598 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:02.922311 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6766254-d9db-4c51-97ff-8a18c2aae598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:35:02.922628 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6766254-d9db-4c51-97ff-8a18c2aae598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:02.924283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6766254-d9db-4c51-97ff-8a18c2aae598 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:02.939873 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1338/2660] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:35:02.944683 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad8ac0-433b-4414-9e45-c6ff307c9d59 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:02.955367 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad8ac0-433b-4414-9e45-c6ff307c9d59 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:02.961440 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51488f06-a929-42ce-b2c5-e5fee7cf5578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:02.962144 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51488f06-a929-42ce-b2c5-e5fee7cf5578 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:02.962467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51488f06-a929-42ce-b2c5-e5fee7cf5578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:02.962744 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51488f06-a929-42ce-b2c5-e5fee7cf5578 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:02.963434 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51488f06-a929-42ce-b2c5-e5fee7cf5578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:02.965443 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51488f06-a929-42ce-b2c5-e5fee7cf5578 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:03.048492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1323/2661] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:35:02 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:35:03.053127 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6766254-d9db-4c51-97ff-8a18c2aae598 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:03.065890 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6766254-d9db-4c51-97ff-8a18c2aae598 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:03.137887 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4dd59-f6fc-4665-8668-e9e1a0b74aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:03.138761 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4dd59-f6fc-4665-8668-e9e1a0b74aab admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:03.139162 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4dd59-f6fc-4665-8668-e9e1a0b74aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:03.139581 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4dd59-f6fc-4665-8668-e9e1a0b74aab admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:03.140446 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4dd59-f6fc-4665-8668-e9e1a0b74aab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:03.142475 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4dd59-f6fc-4665-8668-e9e1a0b74aab admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:03.238894 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1339/2662] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:35:03 2022] POST /identity/v3/users => generated 284 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:35:03.239769 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51488f06-a929-42ce-b2c5-e5fee7cf5578 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:03.256366 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51488f06-a929-42ce-b2c5-e5fee7cf5578 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:03.261782 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed3e1c-8bf1-44fe-96b4-0ba72d77808b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:03.262721 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed3e1c-8bf1-44fe-96b4-0ba72d77808b admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:03.265308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed3e1c-8bf1-44fe-96b4-0ba72d77808b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:03.265669 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed3e1c-8bf1-44fe-96b4-0ba72d77808b admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:03.266516 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed3e1c-8bf1-44fe-96b4-0ba72d77808b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:03.268206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed3e1c-8bf1-44fe-96b4-0ba72d77808b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:03.290006 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1324/2663] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:35:03.294973 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4dd59-f6fc-4665-8668-e9e1a0b74aab admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:03.309692 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4dd59-f6fc-4665-8668-e9e1a0b74aab admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:03.314750 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39860e67-60f7-45d2-ad76-9ec3cfcdc45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:03.315416 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39860e67-60f7-45d2-ad76-9ec3cfcdc45c admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:03.315703 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39860e67-60f7-45d2-ad76-9ec3cfcdc45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:03.315982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39860e67-60f7-45d2-ad76-9ec3cfcdc45c admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:03.316712 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39860e67-60f7-45d2-ad76-9ec3cfcdc45c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:03.318374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39860e67-60f7-45d2-ad76-9ec3cfcdc45c admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:03.337228 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1340/2664] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:35:03.343149 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed3e1c-8bf1-44fe-96b4-0ba72d77808b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:03.356688 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed3e1c-8bf1-44fe-96b4-0ba72d77808b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:03.362819 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19656db4-3865-4173-9e28-f0a31407c4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:03.365245 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19656db4-3865-4173-9e28-f0a31407c4c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:03.366888 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19656db4-3865-4173-9e28-f0a31407c4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:03.367424 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19656db4-3865-4173-9e28-f0a31407c4c2 admin admin] PATH_INFO: `/v3/projects/bdb2d42ea10d4c6a87b163e7da10674b/users/39f57950d3db4c75aaf902b7696703c1/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:03.384927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19656db4-3865-4173-9e28-f0a31407c4c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdb2d42ea10d4c6a87b163e7da10674b, user_id=39f57950d3db4c75aaf902b7696703c1, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:03.390299 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19656db4-3865-4173-9e28-f0a31407c4c2 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:03.458085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1325/2665] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:35:03 2022] PUT /identity/v3/projects/bdb2d42ea10d4c6a87b163e7da10674b/users/39f57950d3db4c75aaf902b7696703c1/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:03.469811 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e611d-77da-46e9-8191-5bbf8ec11650 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:03.470111 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e611d-77da-46e9-8191-5bbf8ec11650 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:03.470447 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e611d-77da-46e9-8191-5bbf8ec11650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:03.511991 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-284e611d-77da-46e9-8191-5bbf8ec11650 None None] MFA Rules not processed for user `39f57950d3db4c75aaf902b7696703c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:03.513554 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-284e611d-77da-46e9-8191-5bbf8ec11650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:03.608659 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1341/2666] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:35:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:35:03.610214 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19656db4-3865-4173-9e28-f0a31407c4c2 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:03.705720 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19656db4-3865-4173-9e28-f0a31407c4c2 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:03.710547 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40564abd-ee61-4ee6-a8a1-515809ff5d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:03.711221 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40564abd-ee61-4ee6-a8a1-515809ff5d6b admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:03.711870 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40564abd-ee61-4ee6-a8a1-515809ff5d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:03.712157 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40564abd-ee61-4ee6-a8a1-515809ff5d6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:03.712866 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40564abd-ee61-4ee6-a8a1-515809ff5d6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:03.714837 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40564abd-ee61-4ee6-a8a1-515809ff5d6b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:03.829905 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1326/2667] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:35:03 2022] POST /identity/v3/projects => generated 367 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:35:03.831180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e611d-77da-46e9-8191-5bbf8ec11650 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:03.844124 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e611d-77da-46e9-8191-5bbf8ec11650 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:03.910578 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:03.934732 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08087bca-1950-4316-9518-2b7daf6192e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:03.935418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08087bca-1950-4316-9518-2b7daf6192e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:03.936207 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08087bca-1950-4316-9518-2b7daf6192e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:03.936344 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08087bca-1950-4316-9518-2b7daf6192e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:03.936947 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08087bca-1950-4316-9518-2b7daf6192e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:03.939022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08087bca-1950-4316-9518-2b7daf6192e8 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:04.034307 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1342/2668] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:35:03 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:35:04.035225 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40564abd-ee61-4ee6-a8a1-515809ff5d6b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:04.046852 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40564abd-ee61-4ee6-a8a1-515809ff5d6b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:04.053610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a40f9-f5c3-4bf1-91a0-7d38dcdb7b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:04.054405 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a40f9-f5c3-4bf1-91a0-7d38dcdb7b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:04.054697 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a40f9-f5c3-4bf1-91a0-7d38dcdb7b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:04.054979 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a40f9-f5c3-4bf1-91a0-7d38dcdb7b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:04.055868 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a40f9-f5c3-4bf1-91a0-7d38dcdb7b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:04.057355 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a40f9-f5c3-4bf1-91a0-7d38dcdb7b93 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:04.075851 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1327/2669] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:35:04.080340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08087bca-1950-4316-9518-2b7daf6192e8 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:04.093169 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08087bca-1950-4316-9518-2b7daf6192e8 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:04.098492 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37888beb-240e-4352-985e-950781447bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:04.099476 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37888beb-240e-4352-985e-950781447bb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:04.099689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37888beb-240e-4352-985e-950781447bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:04.100000 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37888beb-240e-4352-985e-950781447bb8 admin admin] PATH_INFO: `/v3/projects/57dd8e4beda64d899501e700cbcb12a7/users/ce5ef24e746c46adbb380173a3193a8b/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:04.119775 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37888beb-240e-4352-985e-950781447bb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57dd8e4beda64d899501e700cbcb12a7, user_id=ce5ef24e746c46adbb380173a3193a8b, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:04.122492 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37888beb-240e-4352-985e-950781447bb8 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:04.178971 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1343/2670] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:35:04 2022] PUT /identity/v3/projects/57dd8e4beda64d899501e700cbcb12a7/users/ce5ef24e746c46adbb380173a3193a8b/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:04.183128 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a40f9-f5c3-4bf1-91a0-7d38dcdb7b93 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:04.194668 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a40f9-f5c3-4bf1-91a0-7d38dcdb7b93 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:04.235498 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:04.271353 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87d8e1-7fe2-4a95-addb-e33da6be34ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:04.273583 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87d8e1-7fe2-4a95-addb-e33da6be34ea admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:04.274027 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87d8e1-7fe2-4a95-addb-e33da6be34ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:04.274829 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87d8e1-7fe2-4a95-addb-e33da6be34ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:04.276229 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87d8e1-7fe2-4a95-addb-e33da6be34ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:04.278804 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87d8e1-7fe2-4a95-addb-e33da6be34ea admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:04.290337 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1328/2671] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:35:04.294424 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37888beb-240e-4352-985e-950781447bb8 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:04.306404 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37888beb-240e-4352-985e-950781447bb8 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:04.311481 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd853d-1a1a-4b5d-b4fc-805e3e97ec9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:04.312380 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd853d-1a1a-4b5d-b4fc-805e3e97ec9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:04.312902 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd853d-1a1a-4b5d-b4fc-805e3e97ec9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:04.313192 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd853d-1a1a-4b5d-b4fc-805e3e97ec9e admin admin] PATH_INFO: `/v3/projects/57dd8e4beda64d899501e700cbcb12a7/users/ce5ef24e746c46adbb380173a3193a8b/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:04.316105 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd853d-1a1a-4b5d-b4fc-805e3e97ec9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=57dd8e4beda64d899501e700cbcb12a7, user_id=ce5ef24e746c46adbb380173a3193a8b, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:04.319568 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd853d-1a1a-4b5d-b4fc-805e3e97ec9e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:04.334184 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1344/2672] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:35:04 2022] PUT /identity/v3/projects/57dd8e4beda64d899501e700cbcb12a7/users/ce5ef24e746c46adbb380173a3193a8b/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:04.345033 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed3285-ee4a-43f0-b1da-6d319a8addf6 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:04.345486 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed3285-ee4a-43f0-b1da-6d319a8addf6 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:04.345866 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed3285-ee4a-43f0-b1da-6d319a8addf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:04.382612 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-b3ed3285-ee4a-43f0-b1da-6d319a8addf6 None None] MFA Rules not processed for user `ce5ef24e746c46adbb380173a3193a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:04.383941 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b3ed3285-ee4a-43f0-b1da-6d319a8addf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:04.472451 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1329/2673] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:35:04 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:35:04.486955 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd853d-1a1a-4b5d-b4fc-805e3e97ec9e admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:04.489051 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-70fd853d-1a1a-4b5d-b4fc-805e3e97ec9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:04.568181 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd853d-1a1a-4b5d-b4fc-805e3e97ec9e admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:04.573153 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7e52a-82f2-4319-ae12-79c028c11739 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:04.573847 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7e52a-82f2-4319-ae12-79c028c11739 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:04.574156 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7e52a-82f2-4319-ae12-79c028c11739 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:04.574445 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7e52a-82f2-4319-ae12-79c028c11739 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:04.590305 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7e52a-82f2-4319-ae12-79c028c11739 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:04.590305 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7e52a-82f2-4319-ae12-79c028c11739 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:04.603398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1345/2674] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:35:04 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:35:04.708490 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed3285-ee4a-43f0-b1da-6d319a8addf6 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:04.710242 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b3ed3285-ee4a-43f0-b1da-6d319a8addf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:04.728309 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed3285-ee4a-43f0-b1da-6d319a8addf6 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:04.736137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd507947-2953-4eeb-a276-09c724acb55a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:04.736855 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd507947-2953-4eeb-a276-09c724acb55a service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:04.737143 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd507947-2953-4eeb-a276-09c724acb55a service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:04.737479 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd507947-2953-4eeb-a276-09c724acb55a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:04.815283 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd507947-2953-4eeb-a276-09c724acb55a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:04.816786 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd507947-2953-4eeb-a276-09c724acb55a service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:04.832751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1330/2675] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:35:04 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:35:10.218735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7e52a-82f2-4319-ae12-79c028c11739 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:10.320238 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7e52a-82f2-4319-ae12-79c028c11739 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:10.327114 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8813d-2559-454b-b04d-af82ed06d425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:10.328188 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8813d-2559-454b-b04d-af82ed06d425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:10.328787 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8813d-2559-454b-b04d-af82ed06d425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:10.329806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8813d-2559-454b-b04d-af82ed06d425 admin admin] PATH_INFO: `/v3/users/39f57950d3db4c75aaf902b7696703c1` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:10.331685 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8813d-2559-454b-b04d-af82ed06d425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39f57950d3db4c75aaf902b7696703c1)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:10.333875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8813d-2559-454b-b04d-af82ed06d425 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:10.531626 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:10.546250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f3a8813d-2559-454b-b04d-af82ed06d425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39f57950d3db4c75aaf902b7696703c1'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:10.634077 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f3a8813d-2559-454b-b04d-af82ed06d425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39f57950d3db4c75aaf902b7696703c1'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:10.647822 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f3a8813d-2559-454b-b04d-af82ed06d425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39f57950d3db4c75aaf902b7696703c1'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:10.657753 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f3a8813d-2559-454b-b04d-af82ed06d425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39f57950d3db4c75aaf902b7696703c1'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:10.659139 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f3a8813d-2559-454b-b04d-af82ed06d425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39f57950d3db4c75aaf902b7696703c1'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:10.666329 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1346/2676] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:35:10 2022] DELETE /identity/v3/users/39f57950d3db4c75aaf902b7696703c1 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:10.671288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e10465-b968-4953-a59f-b5fd9857ef7f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:10.672920 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e10465-b968-4953-a59f-b5fd9857ef7f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:10.673383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e10465-b968-4953-a59f-b5fd9857ef7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:10.695054 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-77e10465-b968-4953-a59f-b5fd9857ef7f None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:10.698767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-77e10465-b968-4953-a59f-b5fd9857ef7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:10.746084 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:10.760562 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1331/2677] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:35:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:35:10.770248 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8813d-2559-454b-b04d-af82ed06d425 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:10.772475 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f3a8813d-2559-454b-b04d-af82ed06d425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:10.844652 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8813d-2559-454b-b04d-af82ed06d425 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:10.851748 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae88f5-0c81-4bcd-b12a-4ffe8e53b238 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:10.853030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae88f5-0c81-4bcd-b12a-4ffe8e53b238 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:10.853591 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae88f5-0c81-4bcd-b12a-4ffe8e53b238 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:10.854090 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae88f5-0c81-4bcd-b12a-4ffe8e53b238 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:10.877203 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae88f5-0c81-4bcd-b12a-4ffe8e53b238 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:10.878928 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae88f5-0c81-4bcd-b12a-4ffe8e53b238 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:10.901199 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1347/2678] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:35:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:35:11.460745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e10465-b968-4953-a59f-b5fd9857ef7f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:11.462315 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-77e10465-b968-4953-a59f-b5fd9857ef7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:11.481855 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e10465-b968-4953-a59f-b5fd9857ef7f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:11.491257 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53241ef6-29e9-4f46-9aac-61648b63a450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:11.492375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53241ef6-29e9-4f46-9aac-61648b63a450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:11.492750 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53241ef6-29e9-4f46-9aac-61648b63a450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:11.493121 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53241ef6-29e9-4f46-9aac-61648b63a450 admin admin] PATH_INFO: `/v3/projects/bdb2d42ea10d4c6a87b163e7da10674b` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:11.494545 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53241ef6-29e9-4f46-9aac-61648b63a450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdb2d42ea10d4c6a87b163e7da10674b)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:11.496895 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53241ef6-29e9-4f46-9aac-61648b63a450 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:11.862023 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-53241ef6-29e9-4f46-9aac-61648b63a450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdb2d42ea10d4c6a87b163e7da10674b', 'request_id': 'req-53241ef6-29e9-4f46-9aac-61648b63a450'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:11.868358 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-53241ef6-29e9-4f46-9aac-61648b63a450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdb2d42ea10d4c6a87b163e7da10674b', 'request_id': 'req-53241ef6-29e9-4f46-9aac-61648b63a450'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:12.004927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-53241ef6-29e9-4f46-9aac-61648b63a450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdb2d42ea10d4c6a87b163e7da10674b', 'request_id': 'req-53241ef6-29e9-4f46-9aac-61648b63a450'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:12.017952 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-53241ef6-29e9-4f46-9aac-61648b63a450 admin admin] The token cache is being invalidate because project bdb2d42ea10d4c6a87b163e7da10674b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:35:12.018268 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-53241ef6-29e9-4f46-9aac-61648b63a450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:12.018924 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-53241ef6-29e9-4f46-9aac-61648b63a450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:12.020494 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1332/2679] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:35:11 2022] DELETE /identity/v3/projects/bdb2d42ea10d4c6a87b163e7da10674b => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:12.025270 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae88f5-0c81-4bcd-b12a-4ffe8e53b238 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:12.035080 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae88f5-0c81-4bcd-b12a-4ffe8e53b238 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:12.092640 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7858c-21b7-42aa-95d6-4ae811f3870a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:12.095207 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7858c-21b7-42aa-95d6-4ae811f3870a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:12.095207 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7858c-21b7-42aa-95d6-4ae811f3870a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:12.095207 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7858c-21b7-42aa-95d6-4ae811f3870a admin admin] PATH_INFO: `/v3/users/ce5ef24e746c46adbb380173a3193a8b` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:12.095539 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7858c-21b7-42aa-95d6-4ae811f3870a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce5ef24e746c46adbb380173a3193a8b)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:12.097195 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7858c-21b7-42aa-95d6-4ae811f3870a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:12.367208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-07b7858c-21b7-42aa-95d6-4ae811f3870a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce5ef24e746c46adbb380173a3193a8b'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:12.451490 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-07b7858c-21b7-42aa-95d6-4ae811f3870a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce5ef24e746c46adbb380173a3193a8b'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:12.457994 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:12.468684 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-07b7858c-21b7-42aa-95d6-4ae811f3870a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce5ef24e746c46adbb380173a3193a8b'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:12.477376 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-07b7858c-21b7-42aa-95d6-4ae811f3870a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce5ef24e746c46adbb380173a3193a8b'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:12.478382 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-07b7858c-21b7-42aa-95d6-4ae811f3870a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce5ef24e746c46adbb380173a3193a8b'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:12.502922 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1348/2680] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:35:12 2022] DELETE /identity/v3/users/ce5ef24e746c46adbb380173a3193a8b => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:13.148987 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53241ef6-29e9-4f46-9aac-61648b63a450 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:13.150451 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-53241ef6-29e9-4f46-9aac-61648b63a450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:13.166433 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53241ef6-29e9-4f46-9aac-61648b63a450 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:13.225985 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc761d3-9261-4a16-9534-fedfd8d77a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:13.227005 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc761d3-9261-4a16-9534-fedfd8d77a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:13.227286 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc761d3-9261-4a16-9534-fedfd8d77a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:13.227560 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc761d3-9261-4a16-9534-fedfd8d77a6b admin admin] PATH_INFO: `/v3/projects/57dd8e4beda64d899501e700cbcb12a7` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:13.228858 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc761d3-9261-4a16-9534-fedfd8d77a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=57dd8e4beda64d899501e700cbcb12a7)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:13.230809 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc761d3-9261-4a16-9534-fedfd8d77a6b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:13.411578 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ebc761d3-9261-4a16-9534-fedfd8d77a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57dd8e4beda64d899501e700cbcb12a7', 'request_id': 'req-ebc761d3-9261-4a16-9534-fedfd8d77a6b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:13.417398 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ebc761d3-9261-4a16-9534-fedfd8d77a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57dd8e4beda64d899501e700cbcb12a7', 'request_id': 'req-ebc761d3-9261-4a16-9534-fedfd8d77a6b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:13.501991 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ebc761d3-9261-4a16-9534-fedfd8d77a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57dd8e4beda64d899501e700cbcb12a7', 'request_id': 'req-ebc761d3-9261-4a16-9534-fedfd8d77a6b'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:13.515175 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ebc761d3-9261-4a16-9534-fedfd8d77a6b admin admin] The token cache is being invalidate because project 57dd8e4beda64d899501e700cbcb12a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:35:13.515459 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ebc761d3-9261-4a16-9534-fedfd8d77a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:13.516104 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-ebc761d3-9261-4a16-9534-fedfd8d77a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:13.517688 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1333/2681] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:35:13 2022] DELETE /identity/v3/projects/57dd8e4beda64d899501e700cbcb12a7 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:13.522661 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2c131-c2e0-41f5-a88e-9ef73cf41665 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:13.523142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2c131-c2e0-41f5-a88e-9ef73cf41665 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:13.523279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2c131-c2e0-41f5-a88e-9ef73cf41665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:13.541694 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-a6d2c131-c2e0-41f5-a88e-9ef73cf41665 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:13.542964 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a6d2c131-c2e0-41f5-a88e-9ef73cf41665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:13.605871 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1349/2682] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:35:13.614190 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e11941-b25b-45d1-8ab0-57efd055347a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:13.614484 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e11941-b25b-45d1-8ab0-57efd055347a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:13.614762 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e11941-b25b-45d1-8ab0-57efd055347a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:13.622980 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:13.634519 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-25e11941-b25b-45d1-8ab0-57efd055347a None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:13.635718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-25e11941-b25b-45d1-8ab0-57efd055347a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:13.643941 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1334/2683] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:35:13.649506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2c131-c2e0-41f5-a88e-9ef73cf41665 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:13.659054 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2c131-c2e0-41f5-a88e-9ef73cf41665 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:13.664669 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdb199-de33-44bb-bc8a-dad0fefe45cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:13.664669 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdb199-de33-44bb-bc8a-dad0fefe45cd admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:13.664669 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdb199-de33-44bb-bc8a-dad0fefe45cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:13.665133 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdb199-de33-44bb-bc8a-dad0fefe45cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:13.665529 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fdb199-de33-44bb-bc8a-dad0fefe45cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:35:13.665831 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fdb199-de33-44bb-bc8a-dad0fefe45cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:13.667452 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fdb199-de33-44bb-bc8a-dad0fefe45cd admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:13.679937 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1350/2684] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:35:13.684254 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e11941-b25b-45d1-8ab0-57efd055347a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:13.694142 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e11941-b25b-45d1-8ab0-57efd055347a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:13.698919 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b0c2b-e3b9-4da7-b804-ad2732426ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:13.699628 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b0c2b-e3b9-4da7-b804-ad2732426ce4 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:13.699913 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b0c2b-e3b9-4da7-b804-ad2732426ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:13.700192 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b0c2b-e3b9-4da7-b804-ad2732426ce4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:13.700891 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b0c2b-e3b9-4da7-b804-ad2732426ce4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:13.702864 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b0c2b-e3b9-4da7-b804-ad2732426ce4 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:13.830609 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1335/2685] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:35:13 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:35:13.832606 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdb199-de33-44bb-bc8a-dad0fefe45cd admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:13.843396 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdb199-de33-44bb-bc8a-dad0fefe45cd admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:13.903336 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c579367-7e2a-4b33-9943-1cc4912b2175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:13.904030 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c579367-7e2a-4b33-9943-1cc4912b2175 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:13.904328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c579367-7e2a-4b33-9943-1cc4912b2175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:13.904735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c579367-7e2a-4b33-9943-1cc4912b2175 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:13.905332 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c579367-7e2a-4b33-9943-1cc4912b2175 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:13.907283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c579367-7e2a-4b33-9943-1cc4912b2175 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:14.016695 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1351/2686] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:35:13 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:35:14.019255 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b0c2b-e3b9-4da7-b804-ad2732426ce4 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:14.029956 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b0c2b-e3b9-4da7-b804-ad2732426ce4 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:14.034895 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a176e0-2433-4ed3-8d8c-eb81f13717e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:14.035517 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a176e0-2433-4ed3-8d8c-eb81f13717e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:14.035792 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a176e0-2433-4ed3-8d8c-eb81f13717e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:14.036084 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a176e0-2433-4ed3-8d8c-eb81f13717e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:14.037361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a176e0-2433-4ed3-8d8c-eb81f13717e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:14.039225 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a176e0-2433-4ed3-8d8c-eb81f13717e6 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:14.050077 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1336/2687] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:35:14.055015 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c579367-7e2a-4b33-9943-1cc4912b2175 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:14.065317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c579367-7e2a-4b33-9943-1cc4912b2175 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:14.070157 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47978f1-c862-4151-953c-6d7238602f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:14.070836 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47978f1-c862-4151-953c-6d7238602f04 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:14.071101 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47978f1-c862-4151-953c-6d7238602f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:14.071406 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47978f1-c862-4151-953c-6d7238602f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:14.072126 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47978f1-c862-4151-953c-6d7238602f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:14.073710 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47978f1-c862-4151-953c-6d7238602f04 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:14.084601 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1352/2688] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:35:14.088989 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a176e0-2433-4ed3-8d8c-eb81f13717e6 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:14.098843 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a176e0-2433-4ed3-8d8c-eb81f13717e6 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:14.104483 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0d726-22b6-4c8e-a895-1fa550cbd110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:14.105354 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0d726-22b6-4c8e-a895-1fa550cbd110 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:14.105634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0d726-22b6-4c8e-a895-1fa550cbd110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:14.105908 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0d726-22b6-4c8e-a895-1fa550cbd110 admin admin] PATH_INFO: `/v3/projects/cd42d149359f49f89810860af9beada3/users/7b2911f6410f48c0800a10fdd43fe157/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:14.121335 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0d726-22b6-4c8e-a895-1fa550cbd110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd42d149359f49f89810860af9beada3, user_id=7b2911f6410f48c0800a10fdd43fe157, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:14.124230 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0d726-22b6-4c8e-a895-1fa550cbd110 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:14.216202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1337/2689] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:35:14 2022] PUT /identity/v3/projects/cd42d149359f49f89810860af9beada3/users/7b2911f6410f48c0800a10fdd43fe157/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:14.226808 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3feb8-eade-4186-b2f9-c391783401bc None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:14.227124 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3feb8-eade-4186-b2f9-c391783401bc None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:14.227410 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3feb8-eade-4186-b2f9-c391783401bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:14.254638 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-a1b3feb8-eade-4186-b2f9-c391783401bc None None] MFA Rules not processed for user `7b2911f6410f48c0800a10fdd43fe157`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:14.255939 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a1b3feb8-eade-4186-b2f9-c391783401bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:14.285274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:14.320240 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1353/2690] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:35:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:35:14.324875 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0d726-22b6-4c8e-a895-1fa550cbd110 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:14.355839 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3feb8-eade-4186-b2f9-c391783401bc None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:14.358343 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-a1b3feb8-eade-4186-b2f9-c391783401bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:14.401245 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0d726-22b6-4c8e-a895-1fa550cbd110 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:14.406685 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e859040-c775-4ff2-a4e4-4d02eec7efe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:14.407349 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e859040-c775-4ff2-a4e4-4d02eec7efe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:14.407634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e859040-c775-4ff2-a4e4-4d02eec7efe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:14.407914 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e859040-c775-4ff2-a4e4-4d02eec7efe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:14.408621 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e859040-c775-4ff2-a4e4-4d02eec7efe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:14.410611 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e859040-c775-4ff2-a4e4-4d02eec7efe7 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:14.430724 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3feb8-eade-4186-b2f9-c391783401bc None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:14.435504 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebac6a8-7293-4a51-9618-ad661f28fb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:14.439209 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebac6a8-7293-4a51-9618-ad661f28fb86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:14.439209 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebac6a8-7293-4a51-9618-ad661f28fb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:14.439209 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebac6a8-7293-4a51-9618-ad661f28fb86 admin admin] PATH_INFO: `/v3/users/7f6d00f7cc254f66beebb27b6a0627ce` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:14.439209 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebac6a8-7293-4a51-9618-ad661f28fb86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f6d00f7cc254f66beebb27b6a0627ce)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:14.440091 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebac6a8-7293-4a51-9618-ad661f28fb86 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:14.494407 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1338/2691] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:35:14 2022] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:35:14.495361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e859040-c775-4ff2-a4e4-4d02eec7efe7 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:14.559040 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e859040-c775-4ff2-a4e4-4d02eec7efe7 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:14.563798 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26c807-865a-46ca-b51e-78d496311da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:14.564488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26c807-865a-46ca-b51e-78d496311da3 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:14.564760 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26c807-865a-46ca-b51e-78d496311da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:14.565040 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26c807-865a-46ca-b51e-78d496311da3 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:14.565741 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26c807-865a-46ca-b51e-78d496311da3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:14.567723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26c807-865a-46ca-b51e-78d496311da3 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:14.658784 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0ebac6a8-7293-4a51-9618-ad661f28fb86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f6d00f7cc254f66beebb27b6a0627ce'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:14.675260 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1339/2692] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:35:14 2022] POST /identity/v3/users => generated 300 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:35:14.676583 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26c807-865a-46ca-b51e-78d496311da3 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:14.686992 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26c807-865a-46ca-b51e-78d496311da3 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:14.691882 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a82b1c-169e-4b93-99b1-4f3d1b260ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:14.692535 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a82b1c-169e-4b93-99b1-4f3d1b260ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:14.692818 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a82b1c-169e-4b93-99b1-4f3d1b260ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:14.693604 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a82b1c-169e-4b93-99b1-4f3d1b260ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:14.694427 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a82b1c-169e-4b93-99b1-4f3d1b260ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:14.699939 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a82b1c-169e-4b93-99b1-4f3d1b260ca3 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:14.706306 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1340/2693] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:35:14.710946 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a82b1c-169e-4b93-99b1-4f3d1b260ca3 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:14.717078 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:14.719326 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0ebac6a8-7293-4a51-9618-ad661f28fb86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f6d00f7cc254f66beebb27b6a0627ce'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:14.721099 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a82b1c-169e-4b93-99b1-4f3d1b260ca3 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:14.726500 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499d053-a16e-472c-977f-b2e7faabb968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:14.727537 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499d053-a16e-472c-977f-b2e7faabb968 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:14.727897 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499d053-a16e-472c-977f-b2e7faabb968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:14.728239 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499d053-a16e-472c-977f-b2e7faabb968 admin admin] PATH_INFO: `/v3/projects/d94dde538cfd4c96b15ad15ff0a65a68/users/14631cf856534da2a362f603d272c6da/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:14.737141 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0ebac6a8-7293-4a51-9618-ad661f28fb86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f6d00f7cc254f66beebb27b6a0627ce'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:14.746017 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e499d053-a16e-472c-977f-b2e7faabb968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d94dde538cfd4c96b15ad15ff0a65a68, user_id=14631cf856534da2a362f603d272c6da, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:14.747871 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0ebac6a8-7293-4a51-9618-ad661f28fb86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f6d00f7cc254f66beebb27b6a0627ce'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:14.748164 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-0ebac6a8-7293-4a51-9618-ad661f28fb86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f6d00f7cc254f66beebb27b6a0627ce'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:14.749322 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e499d053-a16e-472c-977f-b2e7faabb968 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:14.755325 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1354/2694] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:35:14 2022] DELETE /identity/v3/users/7f6d00f7cc254f66beebb27b6a0627ce => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:14.760194 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c576f-6a4a-4c23-98f0-3822ee1b3d69 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:14.760506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c576f-6a4a-4c23-98f0-3822ee1b3d69 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:14.760786 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c576f-6a4a-4c23-98f0-3822ee1b3d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:14.780061 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-e63c576f-6a4a-4c23-98f0-3822ee1b3d69 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:14.781283 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e63c576f-6a4a-4c23-98f0-3822ee1b3d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:14.817076 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1341/2695] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:35:14 2022] PUT /identity/v3/projects/d94dde538cfd4c96b15ad15ff0a65a68/users/14631cf856534da2a362f603d272c6da/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:35:14.821940 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499d053-a16e-472c-977f-b2e7faabb968 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:14.824406 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e499d053-a16e-472c-977f-b2e7faabb968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:14.832735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:14.851526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1355/2696] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:35:14.860847 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c576f-6a4a-4c23-98f0-3822ee1b3d69 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:14.862355 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-e63c576f-6a4a-4c23-98f0-3822ee1b3d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:14.897350 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499d053-a16e-472c-977f-b2e7faabb968 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:14.902053 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85a379-21b3-4147-91df-5e802be4d84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:14.902816 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85a379-21b3-4147-91df-5e802be4d84e admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:14.903099 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85a379-21b3-4147-91df-5e802be4d84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:14.903374 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85a379-21b3-4147-91df-5e802be4d84e admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:14.904130 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85a379-21b3-4147-91df-5e802be4d84e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:14.905769 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85a379-21b3-4147-91df-5e802be4d84e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:14.916262 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1342/2697] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:35:14.920410 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85a379-21b3-4147-91df-5e802be4d84e admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:14.923519 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c576f-6a4a-4c23-98f0-3822ee1b3d69 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:14.932076 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85a379-21b3-4147-91df-5e802be4d84e admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:14.937198 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bc126-d3cb-489b-a920-25b84782c97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:14.938251 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bc126-d3cb-489b-a920-25b84782c97f admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:14.943294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bc126-d3cb-489b-a920-25b84782c97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:14.943294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bc126-d3cb-489b-a920-25b84782c97f admin admin] PATH_INFO: `/v3/projects/d94dde538cfd4c96b15ad15ff0a65a68/users/14631cf856534da2a362f603d272c6da/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:14.943294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443bc126-d3cb-489b-a920-25b84782c97f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d94dde538cfd4c96b15ad15ff0a65a68, user_id=14631cf856534da2a362f603d272c6da, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:14.945058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443bc126-d3cb-489b-a920-25b84782c97f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:14.957962 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1343/2698] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:35:14 2022] PUT /identity/v3/projects/d94dde538cfd4c96b15ad15ff0a65a68/users/14631cf856534da2a362f603d272c6da/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:35:14.968760 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c961bd3-ef9d-4251-9c49-64703d295a92 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:14.969048 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c961bd3-ef9d-4251-9c49-64703d295a92 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:14.969330 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c961bd3-ef9d-4251-9c49-64703d295a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:14.983092 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df94e8-d8a7-4e8e-9ec1-502c1be81cf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:14.983837 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df94e8-d8a7-4e8e-9ec1-502c1be81cf7 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:14.984292 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df94e8-d8a7-4e8e-9ec1-502c1be81cf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:14.985188 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df94e8-d8a7-4e8e-9ec1-502c1be81cf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:14.997677 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df94e8-d8a7-4e8e-9ec1-502c1be81cf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:14.999461 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df94e8-d8a7-4e8e-9ec1-502c1be81cf7 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:15.004245 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-2c961bd3-ef9d-4251-9c49-64703d295a92 None None] MFA Rules not processed for user `14631cf856534da2a362f603d272c6da`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:15.004245 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2c961bd3-ef9d-4251-9c49-64703d295a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:15.010469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1356/2699] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:35:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:35:15.076577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1344/2700] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:35:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:35:15.088627 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df94e8-d8a7-4e8e-9ec1-502c1be81cf7 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:15.090321 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f4df94e8-d8a7-4e8e-9ec1-502c1be81cf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:15.164593 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df94e8-d8a7-4e8e-9ec1-502c1be81cf7 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:15.213584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39785499-4492-438e-aa33-59086fa0a55d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:15.214258 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39785499-4492-438e-aa33-59086fa0a55d service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:15.214595 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39785499-4492-438e-aa33-59086fa0a55d service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:15.214877 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39785499-4492-438e-aa33-59086fa0a55d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:15.224066 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39785499-4492-438e-aa33-59086fa0a55d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:15.226553 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39785499-4492-438e-aa33-59086fa0a55d service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:15.238975 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1357/2701] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:35:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:35:15.265995 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c961bd3-ef9d-4251-9c49-64703d295a92 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:15.317761 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:15.332163 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c961bd3-ef9d-4251-9c49-64703d295a92 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:15.337621 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119e534-9a78-450b-a2b0-386e5cbeb79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:15.338533 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119e534-9a78-450b-a2b0-386e5cbeb79a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:15.338821 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119e534-9a78-450b-a2b0-386e5cbeb79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:15.339107 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119e534-9a78-450b-a2b0-386e5cbeb79a admin admin] PATH_INFO: `/v3/users/7b2911f6410f48c0800a10fdd43fe157` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:15.340321 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119e534-9a78-450b-a2b0-386e5cbeb79a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b2911f6410f48c0800a10fdd43fe157)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:15.342388 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119e534-9a78-450b-a2b0-386e5cbeb79a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:15.549652 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39785499-4492-438e-aa33-59086fa0a55d service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:15.551097 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-39785499-4492-438e-aa33-59086fa0a55d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:15.566421 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39785499-4492-438e-aa33-59086fa0a55d service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:15.571765 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c1adc-80e5-445d-8cce-b4bb4d02945e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:15.577377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c1adc-80e5-445d-8cce-b4bb4d02945e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:15.577377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c1adc-80e5-445d-8cce-b4bb4d02945e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:15.577377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c1adc-80e5-445d-8cce-b4bb4d02945e admin admin] PATH_INFO: `/v3/projects/8f23ede6a1364ea0b7dd9720a84de932` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:15.577377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c1adc-80e5-445d-8cce-b4bb4d02945e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f23ede6a1364ea0b7dd9720a84de932)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:15.577377 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c1adc-80e5-445d-8cce-b4bb4d02945e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:15.579357 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:15.611904 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2119e534-9a78-450b-a2b0-386e5cbeb79a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b2911f6410f48c0800a10fdd43fe157'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:15.619509 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2119e534-9a78-450b-a2b0-386e5cbeb79a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b2911f6410f48c0800a10fdd43fe157'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:15.631720 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2119e534-9a78-450b-a2b0-386e5cbeb79a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b2911f6410f48c0800a10fdd43fe157'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:15.634792 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2119e534-9a78-450b-a2b0-386e5cbeb79a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b2911f6410f48c0800a10fdd43fe157'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:15.695997 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-236c1adc-80e5-445d-8cce-b4bb4d02945e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f23ede6a1364ea0b7dd9720a84de932', 'request_id': 'req-236c1adc-80e5-445d-8cce-b4bb4d02945e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:15.707400 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2119e534-9a78-450b-a2b0-386e5cbeb79a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b2911f6410f48c0800a10fdd43fe157'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:15.714317 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1345/2702] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:35:15 2022] DELETE /identity/v3/users/7b2911f6410f48c0800a10fdd43fe157 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:15.719387 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3de34-1fb9-4bed-8536-cbc26d54478f None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:15.719678 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3de34-1fb9-4bed-8536-cbc26d54478f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:15.719974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3de34-1fb9-4bed-8536-cbc26d54478f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:15.738374 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-00f3de34-1fb9-4bed-8536-cbc26d54478f None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:15.743284 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-00f3de34-1fb9-4bed-8536-cbc26d54478f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:15.759423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-236c1adc-80e5-445d-8cce-b4bb4d02945e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f23ede6a1364ea0b7dd9720a84de932', 'request_id': 'req-236c1adc-80e5-445d-8cce-b4bb4d02945e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:15.765607 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-236c1adc-80e5-445d-8cce-b4bb4d02945e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f23ede6a1364ea0b7dd9720a84de932', 'request_id': 'req-236c1adc-80e5-445d-8cce-b4bb4d02945e'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:15.777836 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-236c1adc-80e5-445d-8cce-b4bb4d02945e admin admin] The token cache is being invalidate because project 8f23ede6a1364ea0b7dd9720a84de932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:35:15.778072 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-236c1adc-80e5-445d-8cce-b4bb4d02945e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:15.778752 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-236c1adc-80e5-445d-8cce-b4bb4d02945e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:15.780304 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1358/2703] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:35:15 2022] DELETE /identity/v3/projects/8f23ede6a1364ea0b7dd9720a84de932 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:35:15.784999 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b7051-4b77-4de7-ab52-a1b2d8104cea None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:15.785374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b7051-4b77-4de7-ab52-a1b2d8104cea None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:15.785734 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b7051-4b77-4de7-ab52-a1b2d8104cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:15.800551 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1346/2704] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:35:15.804820 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-164b7051-4b77-4de7-ab52-a1b2d8104cea None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:15.806135 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-164b7051-4b77-4de7-ab52-a1b2d8104cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:15.809738 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3de34-1fb9-4bed-8536-cbc26d54478f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:15.811122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-00f3de34-1fb9-4bed-8536-cbc26d54478f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:15.814499 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1359/2705] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:35:15.822057 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082201a8-a924-4eb4-b726-dc27ccc396a2 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:15.822371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082201a8-a924-4eb4-b726-dc27ccc396a2 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:15.822655 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082201a8-a924-4eb4-b726-dc27ccc396a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:15.841429 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-082201a8-a924-4eb4-b726-dc27ccc396a2 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:15.846593 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-082201a8-a924-4eb4-b726-dc27ccc396a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:15.851446 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1360/2706] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:35:15.855531 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082201a8-a924-4eb4-b726-dc27ccc396a2 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:15.865018 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082201a8-a924-4eb4-b726-dc27ccc396a2 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:15.869832 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbb0cd-b0b7-44bf-845f-a24b22f95ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:15.870498 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbb0cd-b0b7-44bf-845f-a24b22f95ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:15.870786 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbb0cd-b0b7-44bf-845f-a24b22f95ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:15.871065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbb0cd-b0b7-44bf-845f-a24b22f95ea3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:15.871946 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbb0cd-b0b7-44bf-845f-a24b22f95ea3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:35:15.872255 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbb0cd-b0b7-44bf-845f-a24b22f95ea3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:15.873253 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3de34-1fb9-4bed-8536-cbc26d54478f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:15.873842 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbb0cd-b0b7-44bf-845f-a24b22f95ea3 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:15.876994 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddf8d4-ff2c-449f-8dc9-e43695269211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:15.877635 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddf8d4-ff2c-449f-8dc9-e43695269211 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:15.877915 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddf8d4-ff2c-449f-8dc9-e43695269211 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:15.878231 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddf8d4-ff2c-449f-8dc9-e43695269211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:15.885991 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1361/2707] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:35:15.887703 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ddf8d4-ff2c-449f-8dc9-e43695269211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:15.889268 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ddf8d4-ff2c-449f-8dc9-e43695269211 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:15.890668 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbb0cd-b0b7-44bf-845f-a24b22f95ea3 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:15.901457 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1347/2708] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:35:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:35:15.903402 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbb0cd-b0b7-44bf-845f-a24b22f95ea3 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:15.908203 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80ca63-0908-4e3a-8b79-3dc32ae3f0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:15.908889 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80ca63-0908-4e3a-8b79-3dc32ae3f0ea admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:15.909177 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80ca63-0908-4e3a-8b79-3dc32ae3f0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:15.909590 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80ca63-0908-4e3a-8b79-3dc32ae3f0ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:15.910313 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80ca63-0908-4e3a-8b79-3dc32ae3f0ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:15.912819 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80ca63-0908-4e3a-8b79-3dc32ae3f0ea admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:16.033443 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1362/2709] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:35:15 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:35:16.037792 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddf8d4-ff2c-449f-8dc9-e43695269211 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:16.053423 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddf8d4-ff2c-449f-8dc9-e43695269211 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:16.061962 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:16.115035 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3744b69-47d7-4170-8cda-f644f41a347b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:16.115927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3744b69-47d7-4170-8cda-f644f41a347b admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:16.116340 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3744b69-47d7-4170-8cda-f644f41a347b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:16.116691 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3744b69-47d7-4170-8cda-f644f41a347b admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:16.117427 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3744b69-47d7-4170-8cda-f644f41a347b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:16.119387 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3744b69-47d7-4170-8cda-f644f41a347b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:16.226485 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1348/2710] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:35:16 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:35:16.230874 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80ca63-0908-4e3a-8b79-3dc32ae3f0ea admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:16.243160 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80ca63-0908-4e3a-8b79-3dc32ae3f0ea admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:16.249591 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7bc14-1778-4f02-8431-08c193360955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:16.250293 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7bc14-1778-4f02-8431-08c193360955 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:16.250584 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7bc14-1778-4f02-8431-08c193360955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:16.250874 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7bc14-1778-4f02-8431-08c193360955 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:16.251604 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7bc14-1778-4f02-8431-08c193360955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:16.253217 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7bc14-1778-4f02-8431-08c193360955 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:16.264568 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1363/2711] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:35:16.269029 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3744b69-47d7-4170-8cda-f644f41a347b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:16.280740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3744b69-47d7-4170-8cda-f644f41a347b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:16.289483 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc571a-9514-46a0-9572-64a0cc089a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:16.290185 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc571a-9514-46a0-9572-64a0cc089a12 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:16.290493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc571a-9514-46a0-9572-64a0cc089a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:16.290773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc571a-9514-46a0-9572-64a0cc089a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:16.291505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc571a-9514-46a0-9572-64a0cc089a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:16.293143 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc571a-9514-46a0-9572-64a0cc089a12 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:16.304435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1349/2712] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:35:16.308571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7bc14-1778-4f02-8431-08c193360955 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:16.319320 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7bc14-1778-4f02-8431-08c193360955 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:16.324117 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde66632-4343-4235-b5e4-24bd394870d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:16.324997 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde66632-4343-4235-b5e4-24bd394870d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:16.325276 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde66632-4343-4235-b5e4-24bd394870d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:16.325548 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde66632-4343-4235-b5e4-24bd394870d5 admin admin] PATH_INFO: `/v3/projects/7e603588700b4ad7959e53ea4d03f673/users/c08ea7f7721644cbbace664438047322/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:16.344371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde66632-4343-4235-b5e4-24bd394870d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e603588700b4ad7959e53ea4d03f673, user_id=c08ea7f7721644cbbace664438047322, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:16.344371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde66632-4343-4235-b5e4-24bd394870d5 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:16.345837 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc571a-9514-46a0-9572-64a0cc089a12 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:16.347974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6bcc571a-9514-46a0-9572-64a0cc089a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:16.361879 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc571a-9514-46a0-9572-64a0cc089a12 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:16.368076 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3a34c-8117-4275-9371-c16ce96dc08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:16.368942 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3a34c-8117-4275-9371-c16ce96dc08f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:16.369279 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3a34c-8117-4275-9371-c16ce96dc08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:16.369532 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3a34c-8117-4275-9371-c16ce96dc08f admin admin] PATH_INFO: `/v3/projects/cd42d149359f49f89810860af9beada3` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:16.370762 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3a34c-8117-4275-9371-c16ce96dc08f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd42d149359f49f89810860af9beada3)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:16.372737 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3a34c-8117-4275-9371-c16ce96dc08f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:16.401324 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1364/2713] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:35:16 2022] PUT /identity/v3/projects/7e603588700b4ad7959e53ea4d03f673/users/c08ea7f7721644cbbace664438047322/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:35:16.411442 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e70c3c-5a5d-40a1-ad8a-2d39860faa9b None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:16.411731 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e70c3c-5a5d-40a1-ad8a-2d39860faa9b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:16.412009 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e70c3c-5a5d-40a1-ad8a-2d39860faa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:16.438708 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-46e70c3c-5a5d-40a1-ad8a-2d39860faa9b None None] MFA Rules not processed for user `c08ea7f7721644cbbace664438047322`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:16.439976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-46e70c3c-5a5d-40a1-ad8a-2d39860faa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:16.463535 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-aca3a34c-8117-4275-9371-c16ce96dc08f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd42d149359f49f89810860af9beada3', 'request_id': 'req-aca3a34c-8117-4275-9371-c16ce96dc08f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:16.469235 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-aca3a34c-8117-4275-9371-c16ce96dc08f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd42d149359f49f89810860af9beada3', 'request_id': 'req-aca3a34c-8117-4275-9371-c16ce96dc08f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:16.503410 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:16.509529 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1365/2714] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:35:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:35:16.520519 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e70c3c-5a5d-40a1-ad8a-2d39860faa9b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:16.521937 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-46e70c3c-5a5d-40a1-ad8a-2d39860faa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:16.545965 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-aca3a34c-8117-4275-9371-c16ce96dc08f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd42d149359f49f89810860af9beada3', 'request_id': 'req-aca3a34c-8117-4275-9371-c16ce96dc08f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:16.558939 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-aca3a34c-8117-4275-9371-c16ce96dc08f admin admin] The token cache is being invalidate because project cd42d149359f49f89810860af9beada3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:35:16.559137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-aca3a34c-8117-4275-9371-c16ce96dc08f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:16.560092 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-aca3a34c-8117-4275-9371-c16ce96dc08f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:16.561656 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1350/2715] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:35:16 2022] DELETE /identity/v3/projects/cd42d149359f49f89810860af9beada3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:35:16.565617 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3a34c-8117-4275-9371-c16ce96dc08f admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:16.566983 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-aca3a34c-8117-4275-9371-c16ce96dc08f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:16.581684 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e70c3c-5a5d-40a1-ad8a-2d39860faa9b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:16.634564 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd62d10-04dc-4a70-9dc7-3b6e7b80dd37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:16.635214 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd62d10-04dc-4a70-9dc7-3b6e7b80dd37 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:16.635494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd62d10-04dc-4a70-9dc7-3b6e7b80dd37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:16.635768 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd62d10-04dc-4a70-9dc7-3b6e7b80dd37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:16.638008 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-9cd62d10-04dc-4a70-9dc7-3b6e7b80dd37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:16.643455 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3a34c-8117-4275-9371-c16ce96dc08f admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:16.648908 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04c90e-ff7b-4532-93aa-6c1e3cd39671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:16.649788 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04c90e-ff7b-4532-93aa-6c1e3cd39671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:16.650075 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04c90e-ff7b-4532-93aa-6c1e3cd39671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:16.650387 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04c90e-ff7b-4532-93aa-6c1e3cd39671 admin admin] PATH_INFO: `/v3/users/14631cf856534da2a362f603d272c6da` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:16.651605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04c90e-ff7b-4532-93aa-6c1e3cd39671 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14631cf856534da2a362f603d272c6da)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:16.653753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04c90e-ff7b-4532-93aa-6c1e3cd39671 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:16.671326 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:16.703175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd62d10-04dc-4a70-9dc7-3b6e7b80dd37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:16.704669 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd62d10-04dc-4a70-9dc7-3b6e7b80dd37 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:16.714532 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1366/2716] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:35:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:35:16.856620 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-df04c90e-ff7b-4532-93aa-6c1e3cd39671 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14631cf856534da2a362f603d272c6da'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:16.864163 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-df04c90e-ff7b-4532-93aa-6c1e3cd39671 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14631cf856534da2a362f603d272c6da'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:16.876210 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-df04c90e-ff7b-4532-93aa-6c1e3cd39671 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14631cf856534da2a362f603d272c6da'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:16.876918 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-df04c90e-ff7b-4532-93aa-6c1e3cd39671 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14631cf856534da2a362f603d272c6da'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:16.930337 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-df04c90e-ff7b-4532-93aa-6c1e3cd39671 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14631cf856534da2a362f603d272c6da'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:16.937268 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1351/2717] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:35:16 2022] DELETE /identity/v3/users/14631cf856534da2a362f603d272c6da => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:35:17.336987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd62d10-04dc-4a70-9dc7-3b6e7b80dd37 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:17.349098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd62d10-04dc-4a70-9dc7-3b6e7b80dd37 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:17.448026 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1aa95-81e2-4139-b4c3-ea12a0a822f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:17.449182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1aa95-81e2-4139-b4c3-ea12a0a822f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:17.449656 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1aa95-81e2-4139-b4c3-ea12a0a822f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:17.450110 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1aa95-81e2-4139-b4c3-ea12a0a822f5 admin admin] PATH_INFO: `/v3/projects/d94dde538cfd4c96b15ad15ff0a65a68` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:17.451437 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1aa95-81e2-4139-b4c3-ea12a0a822f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d94dde538cfd4c96b15ad15ff0a65a68)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:17.453348 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1aa95-81e2-4139-b4c3-ea12a0a822f5 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:17.467589 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:17.588439 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f5c1aa95-81e2-4139-b4c3-ea12a0a822f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd94dde538cfd4c96b15ad15ff0a65a68', 'request_id': 'req-f5c1aa95-81e2-4139-b4c3-ea12a0a822f5'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:17.672306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f5c1aa95-81e2-4139-b4c3-ea12a0a822f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd94dde538cfd4c96b15ad15ff0a65a68', 'request_id': 'req-f5c1aa95-81e2-4139-b4c3-ea12a0a822f5'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:17.679836 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f5c1aa95-81e2-4139-b4c3-ea12a0a822f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd94dde538cfd4c96b15ad15ff0a65a68', 'request_id': 'req-f5c1aa95-81e2-4139-b4c3-ea12a0a822f5'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:17.692182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f5c1aa95-81e2-4139-b4c3-ea12a0a822f5 admin admin] The token cache is being invalidate because project d94dde538cfd4c96b15ad15ff0a65a68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:35:17.692473 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f5c1aa95-81e2-4139-b4c3-ea12a0a822f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:17.693143 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f5c1aa95-81e2-4139-b4c3-ea12a0a822f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:17.695039 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1367/2718] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:35:17 2022] DELETE /identity/v3/projects/d94dde538cfd4c96b15ad15ff0a65a68 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:17.703078 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903066d-79d6-45c4-bece-99570ed16c1a None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:17.703541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903066d-79d6-45c4-bece-99570ed16c1a None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:17.703776 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903066d-79d6-45c4-bece-99570ed16c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:17.722331 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-4903066d-79d6-45c4-bece-99570ed16c1a None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:17.723642 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-4903066d-79d6-45c4-bece-99570ed16c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:17.788586 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1352/2719] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:35:17.797568 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab03c04-f7fe-4059-b4a1-76f4c668a5ab None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:17.798040 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab03c04-f7fe-4059-b4a1-76f4c668a5ab None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:17.798181 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab03c04-f7fe-4059-b4a1-76f4c668a5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:17.817798 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-fab03c04-f7fe-4059-b4a1-76f4c668a5ab None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:17.819178 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-fab03c04-f7fe-4059-b4a1-76f4c668a5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:17.828693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1368/2720] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:35:17.839094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903066d-79d6-45c4-bece-99570ed16c1a None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:17.843623 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903066d-79d6-45c4-bece-99570ed16c1a None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:17.850976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a335fad-d2d1-4d7c-afb2-54279da896a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:17.851643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a335fad-d2d1-4d7c-afb2-54279da896a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:17.851928 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a335fad-d2d1-4d7c-afb2-54279da896a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:17.852213 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a335fad-d2d1-4d7c-afb2-54279da896a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:17.853155 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a335fad-d2d1-4d7c-afb2-54279da896a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:35:17.853419 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a335fad-d2d1-4d7c-afb2-54279da896a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:17.855061 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a335fad-d2d1-4d7c-afb2-54279da896a6 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:17.868075 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1353/2721] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:35:17.872387 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab03c04-f7fe-4059-b4a1-76f4c668a5ab None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:17.882276 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab03c04-f7fe-4059-b4a1-76f4c668a5ab None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:17.887101 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86016bf-4f7e-4921-8ceb-f023c5db6272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:17.887779 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86016bf-4f7e-4921-8ceb-f023c5db6272 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:17.888065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86016bf-4f7e-4921-8ceb-f023c5db6272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:17.888347 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86016bf-4f7e-4921-8ceb-f023c5db6272 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:17.889070 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86016bf-4f7e-4921-8ceb-f023c5db6272 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:17.891015 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86016bf-4f7e-4921-8ceb-f023c5db6272 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:17.995201 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1369/2722] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:35:17 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:35:17.999331 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a335fad-d2d1-4d7c-afb2-54279da896a6 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:18.009534 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a335fad-d2d1-4d7c-afb2-54279da896a6 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:18.066138 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59982936-ce8a-4f93-8592-ef51e7acf154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:18.066826 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59982936-ce8a-4f93-8592-ef51e7acf154 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:18.067118 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59982936-ce8a-4f93-8592-ef51e7acf154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:18.067466 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59982936-ce8a-4f93-8592-ef51e7acf154 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:18.068199 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59982936-ce8a-4f93-8592-ef51e7acf154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:18.070285 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59982936-ce8a-4f93-8592-ef51e7acf154 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:18.164010 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1354/2723] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:35:17 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:35:18.168137 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86016bf-4f7e-4921-8ceb-f023c5db6272 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:18.178635 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86016bf-4f7e-4921-8ceb-f023c5db6272 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:18.184398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c30777-9507-4fba-9f2f-16b860d7a7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:18.184398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c30777-9507-4fba-9f2f-16b860d7a7ee admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:18.184398 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c30777-9507-4fba-9f2f-16b860d7a7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:18.184700 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c30777-9507-4fba-9f2f-16b860d7a7ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:18.185250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c30777-9507-4fba-9f2f-16b860d7a7ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:18.186896 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c30777-9507-4fba-9f2f-16b860d7a7ee admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:18.197336 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1370/2724] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:35:18.201168 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59982936-ce8a-4f93-8592-ef51e7acf154 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:18.212268 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59982936-ce8a-4f93-8592-ef51e7acf154 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:18.217194 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b393cc-4797-4219-81bc-8dab1721bd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:18.217933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b393cc-4797-4219-81bc-8dab1721bd6f admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:18.218262 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b393cc-4797-4219-81bc-8dab1721bd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:18.218544 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b393cc-4797-4219-81bc-8dab1721bd6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:18.219278 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b393cc-4797-4219-81bc-8dab1721bd6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:18.220874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b393cc-4797-4219-81bc-8dab1721bd6f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:18.223126 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:18.232859 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1355/2725] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:35:18.237138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c30777-9507-4fba-9f2f-16b860d7a7ee admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:18.247689 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c30777-9507-4fba-9f2f-16b860d7a7ee admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:18.252242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81753a-7eaf-45ab-a414-738ba29da2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:18.253114 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81753a-7eaf-45ab-a414-738ba29da2f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:18.253513 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81753a-7eaf-45ab-a414-738ba29da2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:18.253792 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81753a-7eaf-45ab-a414-738ba29da2f8 admin admin] PATH_INFO: `/v3/projects/806a4a1291964e02ada8b9d9db972e4f/users/82afe3648cb14595820e94902d2c0d46/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:18.268601 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81753a-7eaf-45ab-a414-738ba29da2f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=806a4a1291964e02ada8b9d9db972e4f, user_id=82afe3648cb14595820e94902d2c0d46, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:18.271997 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81753a-7eaf-45ab-a414-738ba29da2f8 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:18.363603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1371/2726] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:35:18 2022] PUT /identity/v3/projects/806a4a1291964e02ada8b9d9db972e4f/users/82afe3648cb14595820e94902d2c0d46/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:18.374039 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5932da8-9299-49eb-b1fe-452de00bf062 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:18.374435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5932da8-9299-49eb-b1fe-452de00bf062 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:18.374710 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5932da8-9299-49eb-b1fe-452de00bf062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:18.401583 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-c5932da8-9299-49eb-b1fe-452de00bf062 None None] MFA Rules not processed for user `82afe3648cb14595820e94902d2c0d46`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:18.402834 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-c5932da8-9299-49eb-b1fe-452de00bf062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:18.470320 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1356/2727] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:35:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:35:18.474562 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81753a-7eaf-45ab-a414-738ba29da2f8 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:18.541039 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81753a-7eaf-45ab-a414-738ba29da2f8 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:18.546489 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f15833-afa2-4cf2-b05b-bf6e0d7f61eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:18.547176 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f15833-afa2-4cf2-b05b-bf6e0d7f61eb admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:18.547463 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f15833-afa2-4cf2-b05b-bf6e0d7f61eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:18.547744 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f15833-afa2-4cf2-b05b-bf6e0d7f61eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:18.548431 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f15833-afa2-4cf2-b05b-bf6e0d7f61eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:18.550399 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f15833-afa2-4cf2-b05b-bf6e0d7f61eb admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:18.681065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1372/2728] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:35:18 2022] POST /identity/v3/projects => generated 383 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:35:18.683006 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5932da8-9299-49eb-b1fe-452de00bf062 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:18.694272 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5932da8-9299-49eb-b1fe-452de00bf062 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:18.752696 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e122d9d-db98-4492-9503-8733af9b5089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:18.753349 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e122d9d-db98-4492-9503-8733af9b5089 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:18.753639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e122d9d-db98-4492-9503-8733af9b5089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:18.753917 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e122d9d-db98-4492-9503-8733af9b5089 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:18.754676 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e122d9d-db98-4492-9503-8733af9b5089 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:18.757320 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e122d9d-db98-4492-9503-8733af9b5089 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:18.867214 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1357/2729] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:35:18 2022] POST /identity/v3/users => generated 298 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:35:18.871336 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f15833-afa2-4cf2-b05b-bf6e0d7f61eb admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:18.882189 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f15833-afa2-4cf2-b05b-bf6e0d7f61eb admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:18.886834 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d08cf-69d1-4bec-94bf-bf2c9ef86f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:18.887488 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d08cf-69d1-4bec-94bf-bf2c9ef86f71 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:18.887775 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d08cf-69d1-4bec-94bf-bf2c9ef86f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:18.888056 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d08cf-69d1-4bec-94bf-bf2c9ef86f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:18.888781 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d08cf-69d1-4bec-94bf-bf2c9ef86f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:18.890455 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d08cf-69d1-4bec-94bf-bf2c9ef86f71 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:18.901875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1373/2730] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:35:18.905917 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e122d9d-db98-4492-9503-8733af9b5089 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:18.916206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e122d9d-db98-4492-9503-8733af9b5089 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:18.921170 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd182fd-435f-426b-8d98-7136faff5dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:18.922059 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd182fd-435f-426b-8d98-7136faff5dda admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:18.922375 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd182fd-435f-426b-8d98-7136faff5dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:18.922655 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd182fd-435f-426b-8d98-7136faff5dda admin admin] PATH_INFO: `/v3/projects/f0ec8f4510ec4559b70d3deec84f3aa2/users/d708421c536d48f99bc29fc6c97b51c0/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:18.944967 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd182fd-435f-426b-8d98-7136faff5dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0ec8f4510ec4559b70d3deec84f3aa2, user_id=d708421c536d48f99bc29fc6c97b51c0, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:18.947191 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd182fd-435f-426b-8d98-7136faff5dda admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:19.043878 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1358/2731] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:35:18 2022] PUT /identity/v3/projects/f0ec8f4510ec4559b70d3deec84f3aa2/users/d708421c536d48f99bc29fc6c97b51c0/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:19.048066 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d08cf-69d1-4bec-94bf-bf2c9ef86f71 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:19.058738 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d08cf-69d1-4bec-94bf-bf2c9ef86f71 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:19.063472 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:19.118273 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289cb18-5e77-444f-a59c-cf60b8eb00e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:19.118964 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289cb18-5e77-444f-a59c-cf60b8eb00e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:19.119252 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289cb18-5e77-444f-a59c-cf60b8eb00e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:19.119536 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289cb18-5e77-444f-a59c-cf60b8eb00e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:19.120274 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289cb18-5e77-444f-a59c-cf60b8eb00e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:19.121988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289cb18-5e77-444f-a59c-cf60b8eb00e4 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:19.123821 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3db822-35fd-4c54-8659-8add4a221151 None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:19.124117 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3db822-35fd-4c54-8659-8add4a221151 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:19.124396 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3db822-35fd-4c54-8659-8add4a221151 None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:19.125945 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1359/2732] 10.222.0.13 () {54 vars in 921 bytes} [Tue Jul 5 21:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:35:19.132638 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edcce6-7ea7-4a49-b0a4-71c41f9a1a53 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:19.133296 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edcce6-7ea7-4a49-b0a4-71c41f9a1a53 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:19.133708 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edcce6-7ea7-4a49-b0a4-71c41f9a1a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:19.134963 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1374/2733] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:35:19.138961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289cb18-5e77-444f-a59c-cf60b8eb00e4 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:19.150352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289cb18-5e77-444f-a59c-cf60b8eb00e4 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:19.157934 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e57152-43e0-4728-b35b-7f54e9ee2b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:19.159003 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e57152-43e0-4728-b35b-7f54e9ee2b59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:19.159388 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e57152-43e0-4728-b35b-7f54e9ee2b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:19.159763 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e57152-43e0-4728-b35b-7f54e9ee2b59 admin admin] PATH_INFO: `/v3/projects/f0ec8f4510ec4559b70d3deec84f3aa2/users/d708421c536d48f99bc29fc6c97b51c0/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:19.162011 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e57152-43e0-4728-b35b-7f54e9ee2b59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0ec8f4510ec4559b70d3deec84f3aa2, user_id=d708421c536d48f99bc29fc6c97b51c0, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:19.164917 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e57152-43e0-4728-b35b-7f54e9ee2b59 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:19.175890 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1375/2734] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:35:19 2022] PUT /identity/v3/projects/f0ec8f4510ec4559b70d3deec84f3aa2/users/d708421c536d48f99bc29fc6c97b51c0/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:19.180294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-22edcce6-7ea7-4a49-b0a4-71c41f9a1a53 None None] MFA Rules not processed for user `910cd341df8943f18af2765e2a30b238`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:19.181569 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-22edcce6-7ea7-4a49-b0a4-71c41f9a1a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:19.188375 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2c9bf-d530-4a4f-8bdf-e4cf6661c9b7 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:19.189036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2c9bf-d530-4a4f-8bdf-e4cf6661c9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:19.189329 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2c9bf-d530-4a4f-8bdf-e4cf6661c9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:19.221288 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:19.225635 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-0fe2c9bf-d530-4a4f-8bdf-e4cf6661c9b7 None None] MFA Rules not processed for user `d708421c536d48f99bc29fc6c97b51c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:19.226911 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0fe2c9bf-d530-4a4f-8bdf-e4cf6661c9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:19.257114 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1360/2735] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Jul 5 21:35:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:35:19.269253 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22edcce6-7ea7-4a49-b0a4-71c41f9a1a53 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:19.270633 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-22edcce6-7ea7-4a49-b0a4-71c41f9a1a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:19.299354 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1376/2736] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:35:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:35:19.311570 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2c9bf-d530-4a4f-8bdf-e4cf6661c9b7 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:19.313073 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-0fe2c9bf-d530-4a4f-8bdf-e4cf6661c9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:19.330596 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22edcce6-7ea7-4a49-b0a4-71c41f9a1a53 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:19.334758 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabbf61-ec52-45fa-8c66-d30bfe90c8a6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '436d7cc587bc4b2a8a3242fc39876ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:19.335411 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabbf61-ec52-45fa-8c66-d30bfe90c8a6 service glance] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:19.335699 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabbf61-ec52-45fa-8c66-d30bfe90c8a6 service glance] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:19.335978 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabbf61-ec52-45fa-8c66-d30bfe90c8a6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:19.346543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabbf61-ec52-45fa-8c66-d30bfe90c8a6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:19.350529 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabbf61-ec52-45fa-8c66-d30bfe90c8a6 service glance] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:19.360073 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1361/2737] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:35:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:35:19.372210 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2c9bf-d530-4a4f-8bdf-e4cf6661c9b7 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:19.376079 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb9dd6-b3ed-425f-99b2-685ba5829ce6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:19.376727 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb9dd6-b3ed-425f-99b2-685ba5829ce6 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:19.378684 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb9dd6-b3ed-425f-99b2-685ba5829ce6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:19.378684 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb9dd6-b3ed-425f-99b2-685ba5829ce6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:19.386770 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb9dd6-b3ed-425f-99b2-685ba5829ce6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:19.388200 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb9dd6-b3ed-425f-99b2-685ba5829ce6 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:19.399860 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1377/2738] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:35:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:35:19.571811 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabbf61-ec52-45fa-8c66-d30bfe90c8a6 service glance] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:19.581331 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabbf61-ec52-45fa-8c66-d30bfe90c8a6 service glance] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:19.585517 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a21f0d-2119-4d0d-8cb1-6c17679fd5af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:19.586179 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a21f0d-2119-4d0d-8cb1-6c17679fd5af service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:19.586466 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a21f0d-2119-4d0d-8cb1-6c17679fd5af service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:19.586736 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a21f0d-2119-4d0d-8cb1-6c17679fd5af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:19.597885 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d15889-4e42-4996-a748-74be3973f487 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:19.602574 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d15889-4e42-4996-a748-74be3973f487 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:19.602574 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d15889-4e42-4996-a748-74be3973f487 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:19.602574 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1378/2739] 10.222.0.13 () {54 vars in 921 bytes} [Tue Jul 5 21:35:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:35:19.607556 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b03368-e8bb-4f4d-a33e-03dd66a24713 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:19.607835 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b03368-e8bb-4f4d-a33e-03dd66a24713 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:19.608111 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b03368-e8bb-4f4d-a33e-03dd66a24713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:19.626835 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-81b03368-e8bb-4f4d-a33e-03dd66a24713 None None] MFA Rules not processed for user `97b6b7c15770400cad4e2b52b13ad354`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:19.628036 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-81b03368-e8bb-4f4d-a33e-03dd66a24713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:19.641579 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:19.649847 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a21f0d-2119-4d0d-8cb1-6c17679fd5af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:19.651325 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a21f0d-2119-4d0d-8cb1-6c17679fd5af service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:19.660236 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1362/2740] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:35:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:35:19.684499 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1379/2741] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Jul 5 21:35:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:35:19.696962 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a21f0d-2119-4d0d-8cb1-6c17679fd5af service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:19.698450 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-22a21f0d-2119-4d0d-8cb1-6c17679fd5af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:19.711069 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a21f0d-2119-4d0d-8cb1-6c17679fd5af service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:19.714800 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e46f17-03f6-49f1-9514-0e37d825798a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:19.715437 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e46f17-03f6-49f1-9514-0e37d825798a service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:19.715720 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e46f17-03f6-49f1-9514-0e37d825798a service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:19.715998 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e46f17-03f6-49f1-9514-0e37d825798a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:19.723308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e46f17-03f6-49f1-9514-0e37d825798a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:19.725345 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e46f17-03f6-49f1-9514-0e37d825798a service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:19.733166 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1363/2742] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:35:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:35:19.829073 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e39314-4aee-4bea-923d-cfd4f37a824b None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:19.829073 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e39314-4aee-4bea-923d-cfd4f37a824b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:19.829073 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e39314-4aee-4bea-923d-cfd4f37a824b None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:19.829073 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1380/2743] 10.222.0.13 () {54 vars in 921 bytes} [Tue Jul 5 21:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:35:19.833148 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba020e1-08e2-4d70-84ac-71c1ef0cfbd9 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:19.833600 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba020e1-08e2-4d70-84ac-71c1ef0cfbd9 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:19.833695 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba020e1-08e2-4d70-84ac-71c1ef0cfbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:19.853971 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-dba020e1-08e2-4d70-84ac-71c1ef0cfbd9 None None] MFA Rules not processed for user `910cd341df8943f18af2765e2a30b238`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:19.855256 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-dba020e1-08e2-4d70-84ac-71c1ef0cfbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:19.866216 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1364/2744] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Jul 5 21:35:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:35:19.877096 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e39314-4aee-4bea-923d-cfd4f37a824b None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:19.889321 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e39314-4aee-4bea-923d-cfd4f37a824b None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:19.895549 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c9683-c016-4f9d-9ec7-b33153a79156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:19.895549 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c9683-c016-4f9d-9ec7-b33153a79156 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:19.895549 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c9683-c016-4f9d-9ec7-b33153a79156 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:19.895549 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c9683-c016-4f9d-9ec7-b33153a79156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:19.906495 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c9683-c016-4f9d-9ec7-b33153a79156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:19.908034 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c9683-c016-4f9d-9ec7-b33153a79156 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:19.919871 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1381/2745] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:35:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:35:20.221130 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba020e1-08e2-4d70-84ac-71c1ef0cfbd9 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:20.276787 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:20.288958 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba020e1-08e2-4d70-84ac-71c1ef0cfbd9 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:20.293743 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327ecd2-e942-4377-8347-b7e47cc99dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:20.294643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327ecd2-e942-4377-8347-b7e47cc99dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:20.294931 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327ecd2-e942-4377-8347-b7e47cc99dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:20.295209 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327ecd2-e942-4377-8347-b7e47cc99dec admin admin] PATH_INFO: `/v3/users/82afe3648cb14595820e94902d2c0d46` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:20.296395 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327ecd2-e942-4377-8347-b7e47cc99dec admin admin] RBAC: Authorizing `identity:delete_user(user_id=82afe3648cb14595820e94902d2c0d46)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:20.298366 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327ecd2-e942-4377-8347-b7e47cc99dec admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:20.573334 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-1327ecd2-e942-4377-8347-b7e47cc99dec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82afe3648cb14595820e94902d2c0d46'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:20.580403 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-1327ecd2-e942-4377-8347-b7e47cc99dec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82afe3648cb14595820e94902d2c0d46'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:20.597037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-1327ecd2-e942-4377-8347-b7e47cc99dec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82afe3648cb14595820e94902d2c0d46'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:20.597708 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-1327ecd2-e942-4377-8347-b7e47cc99dec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82afe3648cb14595820e94902d2c0d46'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:20.667765 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-1327ecd2-e942-4377-8347-b7e47cc99dec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82afe3648cb14595820e94902d2c0d46'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:20.674771 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1365/2746] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:35:20 2022] DELETE /identity/v3/users/82afe3648cb14595820e94902d2c0d46 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:20.679748 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8709b-418a-49cb-95dc-dec2ff70ffc0 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:20.680060 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8709b-418a-49cb-95dc-dec2ff70ffc0 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:20.680401 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8709b-418a-49cb-95dc-dec2ff70ffc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:20.698492 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-92a8709b-418a-49cb-95dc-dec2ff70ffc0 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:20.699699 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-92a8709b-418a-49cb-95dc-dec2ff70ffc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:20.763423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1382/2747] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:35:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:35:20.774857 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327ecd2-e942-4377-8347-b7e47cc99dec admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:20.776435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-1327ecd2-e942-4377-8347-b7e47cc99dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:20.833869 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327ecd2-e942-4377-8347-b7e47cc99dec admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:20.838218 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a252153-aa4e-4bd3-8ca7-4d09ae1356ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:20.838851 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a252153-aa4e-4bd3-8ca7-4d09ae1356ed service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:20.839137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a252153-aa4e-4bd3-8ca7-4d09ae1356ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:20.839410 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a252153-aa4e-4bd3-8ca7-4d09ae1356ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:20.848849 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a252153-aa4e-4bd3-8ca7-4d09ae1356ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:20.850537 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a252153-aa4e-4bd3-8ca7-4d09ae1356ed service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:20.859952 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1366/2748] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:35:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:35:21.349182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8709b-418a-49cb-95dc-dec2ff70ffc0 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:21.350983 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-92a8709b-418a-49cb-95dc-dec2ff70ffc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:21.364060 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8709b-418a-49cb-95dc-dec2ff70ffc0 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:21.369955 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa504d34-48d7-4c8a-9f17-7a2e32310a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:21.371109 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa504d34-48d7-4c8a-9f17-7a2e32310a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:21.371414 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa504d34-48d7-4c8a-9f17-7a2e32310a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:21.372224 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa504d34-48d7-4c8a-9f17-7a2e32310a05 admin admin] PATH_INFO: `/v3/projects/806a4a1291964e02ada8b9d9db972e4f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:21.373798 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa504d34-48d7-4c8a-9f17-7a2e32310a05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=806a4a1291964e02ada8b9d9db972e4f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:21.379469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa504d34-48d7-4c8a-9f17-7a2e32310a05 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:21.507065 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-aa504d34-48d7-4c8a-9f17-7a2e32310a05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '806a4a1291964e02ada8b9d9db972e4f', 'request_id': 'req-aa504d34-48d7-4c8a-9f17-7a2e32310a05'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:21.579799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-aa504d34-48d7-4c8a-9f17-7a2e32310a05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '806a4a1291964e02ada8b9d9db972e4f', 'request_id': 'req-aa504d34-48d7-4c8a-9f17-7a2e32310a05'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:21.585948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-aa504d34-48d7-4c8a-9f17-7a2e32310a05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '806a4a1291964e02ada8b9d9db972e4f', 'request_id': 'req-aa504d34-48d7-4c8a-9f17-7a2e32310a05'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:21.597825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-aa504d34-48d7-4c8a-9f17-7a2e32310a05 admin admin] The token cache is being invalidate because project 806a4a1291964e02ada8b9d9db972e4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:35:21.597825 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-aa504d34-48d7-4c8a-9f17-7a2e32310a05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:21.598292 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-aa504d34-48d7-4c8a-9f17-7a2e32310a05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:21.600458 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1383/2749] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:35:21 2022] DELETE /identity/v3/projects/806a4a1291964e02ada8b9d9db972e4f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:21.604446 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a252153-aa4e-4bd3-8ca7-4d09ae1356ed service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:21.614928 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a252153-aa4e-4bd3-8ca7-4d09ae1356ed service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:21.674548 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168945cb-e24b-4e04-81be-3c29b05d9219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:21.675417 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168945cb-e24b-4e04-81be-3c29b05d9219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:21.675841 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168945cb-e24b-4e04-81be-3c29b05d9219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:21.676082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168945cb-e24b-4e04-81be-3c29b05d9219 admin admin] PATH_INFO: `/v3/users/d708421c536d48f99bc29fc6c97b51c0` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:21.677271 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168945cb-e24b-4e04-81be-3c29b05d9219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d708421c536d48f99bc29fc6c97b51c0)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:21.679986 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168945cb-e24b-4e04-81be-3c29b05d9219 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:21.695705 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:21.876959 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-168945cb-e24b-4e04-81be-3c29b05d9219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd708421c536d48f99bc29fc6c97b51c0'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:21.884080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-168945cb-e24b-4e04-81be-3c29b05d9219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd708421c536d48f99bc29fc6c97b51c0'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:21.895990 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-168945cb-e24b-4e04-81be-3c29b05d9219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd708421c536d48f99bc29fc6c97b51c0'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:21.897062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-168945cb-e24b-4e04-81be-3c29b05d9219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd708421c536d48f99bc29fc6c97b51c0'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:21.962324 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-168945cb-e24b-4e04-81be-3c29b05d9219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd708421c536d48f99bc29fc6c97b51c0'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:21.972738 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1367/2750] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:35:21 2022] DELETE /identity/v3/users/d708421c536d48f99bc29fc6c97b51c0 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:22.444684 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa504d34-48d7-4c8a-9f17-7a2e32310a05 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:22.446289 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-aa504d34-48d7-4c8a-9f17-7a2e32310a05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:22.465084 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa504d34-48d7-4c8a-9f17-7a2e32310a05 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:22.503995 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:22.523556 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7a2d0-13f9-4cd4-afcf-fec022924239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:22.524414 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7a2d0-13f9-4cd4-afcf-fec022924239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:22.524718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7a2d0-13f9-4cd4-afcf-fec022924239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:22.525028 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7a2d0-13f9-4cd4-afcf-fec022924239 admin admin] PATH_INFO: `/v3/projects/f0ec8f4510ec4559b70d3deec84f3aa2` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:22.526227 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7a2d0-13f9-4cd4-afcf-fec022924239 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0ec8f4510ec4559b70d3deec84f3aa2)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:22.528142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7a2d0-13f9-4cd4-afcf-fec022924239 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:22.668424 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d4c7a2d0-13f9-4cd4-afcf-fec022924239 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0ec8f4510ec4559b70d3deec84f3aa2', 'request_id': 'req-d4c7a2d0-13f9-4cd4-afcf-fec022924239'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:22.753184 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d4c7a2d0-13f9-4cd4-afcf-fec022924239 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0ec8f4510ec4559b70d3deec84f3aa2', 'request_id': 'req-d4c7a2d0-13f9-4cd4-afcf-fec022924239'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:22.760216 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d4c7a2d0-13f9-4cd4-afcf-fec022924239 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0ec8f4510ec4559b70d3deec84f3aa2', 'request_id': 'req-d4c7a2d0-13f9-4cd4-afcf-fec022924239'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:22.772620 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d4c7a2d0-13f9-4cd4-afcf-fec022924239 admin admin] The token cache is being invalidate because project f0ec8f4510ec4559b70d3deec84f3aa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:35:22.772918 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d4c7a2d0-13f9-4cd4-afcf-fec022924239 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:22.773596 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-d4c7a2d0-13f9-4cd4-afcf-fec022924239 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:22.775232 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1384/2751] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:35:22 2022] DELETE /identity/v3/projects/f0ec8f4510ec4559b70d3deec84f3aa2 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:22.780538 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085750c3-b7c6-4817-bb3e-ba9a261c03c7 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:22.780898 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085750c3-b7c6-4817-bb3e-ba9a261c03c7 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:22.781274 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085750c3-b7c6-4817-bb3e-ba9a261c03c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:22.800346 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-085750c3-b7c6-4817-bb3e-ba9a261c03c7 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:22.801550 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-085750c3-b7c6-4817-bb3e-ba9a261c03c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:22.868719 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1368/2752] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:35:22.932445 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fb5cd-4d3f-43f9-9658-0ced08517b22 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:22.932774 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fb5cd-4d3f-43f9-9658-0ced08517b22 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:22.933062 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fb5cd-4d3f-43f9-9658-0ced08517b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:22.952219 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-3f6fb5cd-4d3f-43f9-9658-0ced08517b22 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:22.953748 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3f6fb5cd-4d3f-43f9-9658-0ced08517b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:22.963044 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1385/2753] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:35:22.967522 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085750c3-b7c6-4817-bb3e-ba9a261c03c7 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:22.978772 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085750c3-b7c6-4817-bb3e-ba9a261c03c7 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:22.983683 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193c418-e7c5-4ef4-b4dd-d5e50d719931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:22.984369 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193c418-e7c5-4ef4-b4dd-d5e50d719931 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:22.988914 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193c418-e7c5-4ef4-b4dd-d5e50d719931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:22.988914 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193c418-e7c5-4ef4-b4dd-d5e50d719931 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:22.988914 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193c418-e7c5-4ef4-b4dd-d5e50d719931 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:35:22.988914 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193c418-e7c5-4ef4-b4dd-d5e50d719931 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:22.988914 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193c418-e7c5-4ef4-b4dd-d5e50d719931 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:23.005643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1369/2754] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:35:23.007039 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6fb5cd-4d3f-43f9-9658-0ced08517b22 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:23.016796 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6fb5cd-4d3f-43f9-9658-0ced08517b22 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:23.022300 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e36dbc-6b80-42f3-834c-7b7a3d92aa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:23.023029 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e36dbc-6b80-42f3-834c-7b7a3d92aa29 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:23.023229 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e36dbc-6b80-42f3-834c-7b7a3d92aa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:23.023504 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e36dbc-6b80-42f3-834c-7b7a3d92aa29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:23.024246 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e36dbc-6b80-42f3-834c-7b7a3d92aa29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:23.026275 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e36dbc-6b80-42f3-834c-7b7a3d92aa29 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:23.150451 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1386/2755] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:35:23 2022] POST /identity/v3/projects => generated 375 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:35:23.159609 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193c418-e7c5-4ef4-b4dd-d5e50d719931 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:23.165745 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193c418-e7c5-4ef4-b4dd-d5e50d719931 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:23.222864 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61105dd3-c3a9-4000-9e56-18aadfb3afbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:23.223537 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61105dd3-c3a9-4000-9e56-18aadfb3afbc admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:23.223822 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61105dd3-c3a9-4000-9e56-18aadfb3afbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:23.224103 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61105dd3-c3a9-4000-9e56-18aadfb3afbc admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:23.224861 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61105dd3-c3a9-4000-9e56-18aadfb3afbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:23.226848 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61105dd3-c3a9-4000-9e56-18aadfb3afbc admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:23.302681 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1370/2756] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:35:23 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:35:23.306855 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e36dbc-6b80-42f3-834c-7b7a3d92aa29 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:23.317580 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e36dbc-6b80-42f3-834c-7b7a3d92aa29 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:23.323102 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b396c81-32de-4ce2-91ff-6e4ac5f136f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:23.323929 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b396c81-32de-4ce2-91ff-6e4ac5f136f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:23.324275 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b396c81-32de-4ce2-91ff-6e4ac5f136f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:23.324873 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b396c81-32de-4ce2-91ff-6e4ac5f136f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:23.325478 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b396c81-32de-4ce2-91ff-6e4ac5f136f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:23.327405 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b396c81-32de-4ce2-91ff-6e4ac5f136f0 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:23.342147 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1387/2757] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:35:23.343887 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61105dd3-c3a9-4000-9e56-18aadfb3afbc admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:23.355379 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61105dd3-c3a9-4000-9e56-18aadfb3afbc admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:23.360154 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715d43c-e890-4710-8f1d-9ecc12d0942c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:23.360819 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715d43c-e890-4710-8f1d-9ecc12d0942c admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:23.361137 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715d43c-e890-4710-8f1d-9ecc12d0942c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:23.361484 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715d43c-e890-4710-8f1d-9ecc12d0942c admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:23.362497 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715d43c-e890-4710-8f1d-9ecc12d0942c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:23.364121 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715d43c-e890-4710-8f1d-9ecc12d0942c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:23.371271 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:23.377670 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1371/2758] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:35:23.382655 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b396c81-32de-4ce2-91ff-6e4ac5f136f0 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:23.392970 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b396c81-32de-4ce2-91ff-6e4ac5f136f0 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:23.398384 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63475d4b-59b7-4af8-bf73-7169c34ef419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:23.399256 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63475d4b-59b7-4af8-bf73-7169c34ef419 admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:23.399563 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63475d4b-59b7-4af8-bf73-7169c34ef419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:23.399851 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63475d4b-59b7-4af8-bf73-7169c34ef419 admin admin] PATH_INFO: `/v3/projects/12afa10482754eb8a10aeabb9aa18e63/users/9c79a7e210594f33b42910c398ceac63/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:23.414769 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63475d4b-59b7-4af8-bf73-7169c34ef419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12afa10482754eb8a10aeabb9aa18e63, user_id=9c79a7e210594f33b42910c398ceac63, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:23.417465 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63475d4b-59b7-4af8-bf73-7169c34ef419 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:23.501794 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1388/2759] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:35:23 2022] PUT /identity/v3/projects/12afa10482754eb8a10aeabb9aa18e63/users/9c79a7e210594f33b42910c398ceac63/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:23.512893 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70886c5-6f57-4e58-ad83-a93701651209 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:23.513120 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70886c5-6f57-4e58-ad83-a93701651209 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:23.513401 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70886c5-6f57-4e58-ad83-a93701651209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:23.539677 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-b70886c5-6f57-4e58-ad83-a93701651209 None None] MFA Rules not processed for user `9c79a7e210594f33b42910c398ceac63`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:23.540877 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b70886c5-6f57-4e58-ad83-a93701651209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:23.605552 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1372/2760] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:35:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:35:23.610057 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63475d4b-59b7-4af8-bf73-7169c34ef419 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:23.674285 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63475d4b-59b7-4af8-bf73-7169c34ef419 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:23.679865 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b1830-4990-4efb-9e1a-927270ab68a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:23.680641 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b1830-4990-4efb-9e1a-927270ab68a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:23.680996 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b1830-4990-4efb-9e1a-927270ab68a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:23.681338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b1830-4990-4efb-9e1a-927270ab68a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:23.682132 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b1830-4990-4efb-9e1a-927270ab68a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:23.684187 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b1830-4990-4efb-9e1a-927270ab68a5 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:23.695087 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:23.761670 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996bead-16f2-4159-ae2e-628e95d5ddce None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:23.761983 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996bead-16f2-4159-ae2e-628e95d5ddce None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:23.762283 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996bead-16f2-4159-ae2e-628e95d5ddce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:23.782253 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-8996bead-16f2-4159-ae2e-628e95d5ddce None None] MFA Rules not processed for user `063ce3b820a74d648d709ab6ac4d7be2`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:23.783536 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8996bead-16f2-4159-ae2e-628e95d5ddce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:23.808042 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1389/2761] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:35:23 2022] POST /identity/v3/projects => generated 373 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:35:23.812314 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b1830-4990-4efb-9e1a-927270ab68a5 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:23.846176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1373/2762] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Jul 5 21:35:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:35:23.859212 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996bead-16f2-4159-ae2e-628e95d5ddce None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:23.860929 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-8996bead-16f2-4159-ae2e-628e95d5ddce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:23.885150 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b1830-4990-4efb-9e1a-927270ab68a5 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:23.890610 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944fff3-d036-468f-99fc-8b3fbbf332e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:23.891797 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944fff3-d036-468f-99fc-8b3fbbf332e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:23.892084 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944fff3-d036-468f-99fc-8b3fbbf332e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:23.892364 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944fff3-d036-468f-99fc-8b3fbbf332e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:23.893058 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944fff3-d036-468f-99fc-8b3fbbf332e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:23.895051 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944fff3-d036-468f-99fc-8b3fbbf332e1 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:23.937785 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996bead-16f2-4159-ae2e-628e95d5ddce None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:23.970306 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:23.982491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1390/2763] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:35:23 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:35:23.986456 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944fff3-d036-468f-99fc-8b3fbbf332e1 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:23.997455 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944fff3-d036-468f-99fc-8b3fbbf332e1 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:24.002404 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74261a-bd5b-4484-ad97-1681379b792b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '441be62a077444b9b9f78714e24a760a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:24.002774 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d9994-d276-4810-95d7-06ee8f6eee1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:24.003189 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74261a-bd5b-4484-ad97-1681379b792b service swift] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:24.003446 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74261a-bd5b-4484-ad97-1681379b792b service swift] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:24.003590 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d9994-d276-4810-95d7-06ee8f6eee1c admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:24.003730 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74261a-bd5b-4484-ad97-1681379b792b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:24.003869 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d9994-d276-4810-95d7-06ee8f6eee1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:24.004006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d9994-d276-4810-95d7-06ee8f6eee1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:24.004740 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d9994-d276-4810-95d7-06ee8f6eee1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:24.006626 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d9994-d276-4810-95d7-06ee8f6eee1c admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:24.017408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1391/2764] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:35:24.021850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d9994-d276-4810-95d7-06ee8f6eee1c admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:24.031876 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d9994-d276-4810-95d7-06ee8f6eee1c admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:24.036700 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6beab05-fd87-4bff-90cf-7e41dfd4b57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:24.038297 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6beab05-fd87-4bff-90cf-7e41dfd4b57b admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:24.038589 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6beab05-fd87-4bff-90cf-7e41dfd4b57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:24.038873 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6beab05-fd87-4bff-90cf-7e41dfd4b57b admin admin] PATH_INFO: `/v3/projects/81cc2ed4495d4012aaceba4b21a982ed/users/191cf5ef632143bc8c7ec39218e14c00/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:24.055307 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6beab05-fd87-4bff-90cf-7e41dfd4b57b admin admin] RBAC: Authorizing `identity:create_grant(project_id=81cc2ed4495d4012aaceba4b21a982ed, user_id=191cf5ef632143bc8c7ec39218e14c00, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:24.057996 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6beab05-fd87-4bff-90cf-7e41dfd4b57b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:24.066441 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74261a-bd5b-4484-ad97-1681379b792b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:24.068275 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74261a-bd5b-4484-ad97-1681379b792b service swift] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:24.076694 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1374/2765] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Jul 5 21:35:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 21:35:24.130860 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1392/2766] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:35:24 2022] PUT /identity/v3/projects/81cc2ed4495d4012aaceba4b21a982ed/users/191cf5ef632143bc8c7ec39218e14c00/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:35:24.135020 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74261a-bd5b-4484-ad97-1681379b792b service swift] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:24.145753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74261a-bd5b-4484-ad97-1681379b792b service swift] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:24.206625 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4dd63-f11c-4632-84e2-7bb2dc2818fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:24.207372 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4dd63-f11c-4632-84e2-7bb2dc2818fd admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:24.207725 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4dd63-f11c-4632-84e2-7bb2dc2818fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:24.208007 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4dd63-f11c-4632-84e2-7bb2dc2818fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:24.209329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4dd63-f11c-4632-84e2-7bb2dc2818fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:24.211062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4dd63-f11c-4632-84e2-7bb2dc2818fd admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:24.222690 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1375/2767] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:35:24.227705 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6beab05-fd87-4bff-90cf-7e41dfd4b57b admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:24.252719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6beab05-fd87-4bff-90cf-7e41dfd4b57b admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:24.264295 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbfed8-1bb8-489b-b5de-0ac87e0d35cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:24.266198 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbfed8-1bb8-489b-b5de-0ac87e0d35cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:24.266646 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbfed8-1bb8-489b-b5de-0ac87e0d35cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:24.267254 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbfed8-1bb8-489b-b5de-0ac87e0d35cd admin admin] PATH_INFO: `/v3/projects/81cc2ed4495d4012aaceba4b21a982ed/users/191cf5ef632143bc8c7ec39218e14c00/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:24.272009 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbfed8-1bb8-489b-b5de-0ac87e0d35cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=81cc2ed4495d4012aaceba4b21a982ed, user_id=191cf5ef632143bc8c7ec39218e14c00, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:24.275923 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbfed8-1bb8-489b-b5de-0ac87e0d35cd admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:24.297923 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1393/2768] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:35:24 2022] PUT /identity/v3/projects/81cc2ed4495d4012aaceba4b21a982ed/users/191cf5ef632143bc8c7ec39218e14c00/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:35:24.308837 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb64f7-9d05-4a9e-9a46-db2eba164bab None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:24.309267 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb64f7-9d05-4a9e-9a46-db2eba164bab None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:24.309550 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb64f7-9d05-4a9e-9a46-db2eba164bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:24.353491 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-88cb64f7-9d05-4a9e-9a46-db2eba164bab None None] MFA Rules not processed for user `191cf5ef632143bc8c7ec39218e14c00`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:24.354824 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-88cb64f7-9d05-4a9e-9a46-db2eba164bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:24.465514 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=100 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:24.477007 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1376/2769] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:35:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:35:24.487667 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbfed8-1bb8-489b-b5de-0ac87e0d35cd admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:24.489592 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-68fbfed8-1bb8-489b-b5de-0ac87e0d35cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:24.600981 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbfed8-1bb8-489b-b5de-0ac87e0d35cd admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:24.604959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a572d-e611-4d11-b098-bc6accfd8902 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:24.605803 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a572d-e611-4d11-b098-bc6accfd8902 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:24.606018 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a572d-e611-4d11-b098-bc6accfd8902 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:24.606321 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a572d-e611-4d11-b098-bc6accfd8902 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:24.658443 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:24.673697 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a572d-e611-4d11-b098-bc6accfd8902 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:24.675385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a572d-e611-4d11-b098-bc6accfd8902 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:24.685607 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1394/2770] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:35:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:35:27.950569 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb64f7-9d05-4a9e-9a46-db2eba164bab None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:28.062416 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb64f7-9d05-4a9e-9a46-db2eba164bab None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:28.067437 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d02c1-05a5-4f26-ab27-50bcfcb76c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:28.068942 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d02c1-05a5-4f26-ab27-50bcfcb76c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:28.069859 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d02c1-05a5-4f26-ab27-50bcfcb76c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:28.070163 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d02c1-05a5-4f26-ab27-50bcfcb76c65 admin admin] PATH_INFO: `/v3/users/9c79a7e210594f33b42910c398ceac63` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:28.071613 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d02c1-05a5-4f26-ab27-50bcfcb76c65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c79a7e210594f33b42910c398ceac63)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:28.073761 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d02c1-05a5-4f26-ab27-50bcfcb76c65 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:28.296482 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-263d02c1-05a5-4f26-ab27-50bcfcb76c65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c79a7e210594f33b42910c398ceac63'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:28.313143 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-263d02c1-05a5-4f26-ab27-50bcfcb76c65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c79a7e210594f33b42910c398ceac63'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:28.331331 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-263d02c1-05a5-4f26-ab27-50bcfcb76c65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c79a7e210594f33b42910c398ceac63'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:28.332068 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-263d02c1-05a5-4f26-ab27-50bcfcb76c65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c79a7e210594f33b42910c398ceac63'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:28.444497 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-263d02c1-05a5-4f26-ab27-50bcfcb76c65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c79a7e210594f33b42910c398ceac63'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:28.450959 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1377/2771] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:35:27 2022] DELETE /identity/v3/users/9c79a7e210594f33b42910c398ceac63 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:28.456901 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db897767-772e-43eb-818c-d347269948d0 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:28.457414 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db897767-772e-43eb-818c-d347269948d0 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:28.457514 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db897767-772e-43eb-818c-d347269948d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:28.479537 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-db897767-772e-43eb-818c-d347269948d0 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:28.482982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-db897767-772e-43eb-818c-d347269948d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:28.562387 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1395/2772] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:35:28.571610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d02c1-05a5-4f26-ab27-50bcfcb76c65 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:28.573556 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-263d02c1-05a5-4f26-ab27-50bcfcb76c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:28.652484 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d02c1-05a5-4f26-ab27-50bcfcb76c65 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:28.656584 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf99a9-9ba5-4138-8e9f-7127748001fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:28.657334 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf99a9-9ba5-4138-8e9f-7127748001fd service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:28.657684 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf99a9-9ba5-4138-8e9f-7127748001fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:28.657967 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf99a9-9ba5-4138-8e9f-7127748001fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:28.668783 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf99a9-9ba5-4138-8e9f-7127748001fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:28.670278 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf99a9-9ba5-4138-8e9f-7127748001fd service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:28.682637 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1378/2773] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:35:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:35:29.179419 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db897767-772e-43eb-818c-d347269948d0 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:29.180876 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-db897767-772e-43eb-818c-d347269948d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:29.197007 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db897767-772e-43eb-818c-d347269948d0 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:29.212256 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c9ba4-e977-46f4-bfed-b4409216cab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:29.213218 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c9ba4-e977-46f4-bfed-b4409216cab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:29.221697 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c9ba4-e977-46f4-bfed-b4409216cab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:29.221697 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c9ba4-e977-46f4-bfed-b4409216cab6 admin admin] PATH_INFO: `/v3/projects/12afa10482754eb8a10aeabb9aa18e63` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:29.221697 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c9ba4-e977-46f4-bfed-b4409216cab6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12afa10482754eb8a10aeabb9aa18e63)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:29.221697 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c9ba4-e977-46f4-bfed-b4409216cab6 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:29.354158 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-cc0c9ba4-e977-46f4-bfed-b4409216cab6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12afa10482754eb8a10aeabb9aa18e63', 'request_id': 'req-cc0c9ba4-e977-46f4-bfed-b4409216cab6'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:29.442572 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-cc0c9ba4-e977-46f4-bfed-b4409216cab6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12afa10482754eb8a10aeabb9aa18e63', 'request_id': 'req-cc0c9ba4-e977-46f4-bfed-b4409216cab6'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:29.449931 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-cc0c9ba4-e977-46f4-bfed-b4409216cab6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12afa10482754eb8a10aeabb9aa18e63', 'request_id': 'req-cc0c9ba4-e977-46f4-bfed-b4409216cab6'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:29.464033 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-cc0c9ba4-e977-46f4-bfed-b4409216cab6 admin admin] The token cache is being invalidate because project 12afa10482754eb8a10aeabb9aa18e63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:35:29.465046 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-cc0c9ba4-e977-46f4-bfed-b4409216cab6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:29.465362 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-cc0c9ba4-e977-46f4-bfed-b4409216cab6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:29.467250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1396/2774] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:35:29 2022] DELETE /identity/v3/projects/12afa10482754eb8a10aeabb9aa18e63 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:29.471427 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf99a9-9ba5-4138-8e9f-7127748001fd service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:29.482380 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf99a9-9ba5-4138-8e9f-7127748001fd service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:29.508019 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:29.551716 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d1435-88e5-4c68-97ee-b62ed3edb01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:29.552966 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d1435-88e5-4c68-97ee-b62ed3edb01b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:29.553291 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d1435-88e5-4c68-97ee-b62ed3edb01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:29.553580 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d1435-88e5-4c68-97ee-b62ed3edb01b admin admin] PATH_INFO: `/v3/users/191cf5ef632143bc8c7ec39218e14c00` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:29.559394 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d1435-88e5-4c68-97ee-b62ed3edb01b admin admin] RBAC: Authorizing `identity:delete_user(user_id=191cf5ef632143bc8c7ec39218e14c00)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:29.562713 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d1435-88e5-4c68-97ee-b62ed3edb01b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:29.737008 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-316d1435-88e5-4c68-97ee-b62ed3edb01b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '191cf5ef632143bc8c7ec39218e14c00'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:29.745754 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-316d1435-88e5-4c68-97ee-b62ed3edb01b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '191cf5ef632143bc8c7ec39218e14c00'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:29.760843 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-316d1435-88e5-4c68-97ee-b62ed3edb01b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '191cf5ef632143bc8c7ec39218e14c00'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:29.761548 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-316d1435-88e5-4c68-97ee-b62ed3edb01b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '191cf5ef632143bc8c7ec39218e14c00'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:30.998563 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-316d1435-88e5-4c68-97ee-b62ed3edb01b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '191cf5ef632143bc8c7ec39218e14c00'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:31.005650 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1379/2775] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:35:29 2022] DELETE /identity/v3/users/191cf5ef632143bc8c7ec39218e14c00 => generated 0 bytes in 1535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:31.558886 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c9ba4-e977-46f4-bfed-b4409216cab6 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:31.565947 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-cc0c9ba4-e977-46f4-bfed-b4409216cab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:31.583836 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c9ba4-e977-46f4-bfed-b4409216cab6 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:31.693805 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6b850-8883-4f78-a2cf-f591a18a4e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:31.694793 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6b850-8883-4f78-a2cf-f591a18a4e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:31.695082 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6b850-8883-4f78-a2cf-f591a18a4e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:31.695368 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6b850-8883-4f78-a2cf-f591a18a4e12 admin admin] PATH_INFO: `/v3/projects/81cc2ed4495d4012aaceba4b21a982ed` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:31.696670 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6b850-8883-4f78-a2cf-f591a18a4e12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81cc2ed4495d4012aaceba4b21a982ed)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:31.698664 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6b850-8883-4f78-a2cf-f591a18a4e12 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:31.710972 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:31.853511 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-23f6b850-8883-4f78-a2cf-f591a18a4e12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81cc2ed4495d4012aaceba4b21a982ed', 'request_id': 'req-23f6b850-8883-4f78-a2cf-f591a18a4e12'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:31.981319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-23f6b850-8883-4f78-a2cf-f591a18a4e12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81cc2ed4495d4012aaceba4b21a982ed', 'request_id': 'req-23f6b850-8883-4f78-a2cf-f591a18a4e12'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:31.988701 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-23f6b850-8883-4f78-a2cf-f591a18a4e12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81cc2ed4495d4012aaceba4b21a982ed', 'request_id': 'req-23f6b850-8883-4f78-a2cf-f591a18a4e12'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:32.001970 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-23f6b850-8883-4f78-a2cf-f591a18a4e12 admin admin] The token cache is being invalidate because project 81cc2ed4495d4012aaceba4b21a982ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:35:32.001970 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-23f6b850-8883-4f78-a2cf-f591a18a4e12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:32.002411 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-23f6b850-8883-4f78-a2cf-f591a18a4e12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:32.004176 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1397/2776] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:35:31 2022] DELETE /identity/v3/projects/81cc2ed4495d4012aaceba4b21a982ed => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:33.034950 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d1435-88e5-4c68-97ee-b62ed3edb01b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:33.036436 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-316d1435-88e5-4c68-97ee-b62ed3edb01b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:33.049315 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d1435-88e5-4c68-97ee-b62ed3edb01b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:33.105656 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4693c6-3bbc-4127-b88f-b6337902d5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:33.106548 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4693c6-3bbc-4127-b88f-b6337902d5f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:33.106826 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4693c6-3bbc-4127-b88f-b6337902d5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:33.107093 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4693c6-3bbc-4127-b88f-b6337902d5f0 admin admin] PATH_INFO: `/v3/users/c08ea7f7721644cbbace664438047322` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:33.108252 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4693c6-3bbc-4127-b88f-b6337902d5f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c08ea7f7721644cbbace664438047322)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:33.110281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4693c6-3bbc-4127-b88f-b6337902d5f0 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:33.281399 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:33.283735 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9c4693c6-3bbc-4127-b88f-b6337902d5f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c08ea7f7721644cbbace664438047322'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:33.290451 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9c4693c6-3bbc-4127-b88f-b6337902d5f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c08ea7f7721644cbbace664438047322'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:33.303400 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9c4693c6-3bbc-4127-b88f-b6337902d5f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c08ea7f7721644cbbace664438047322'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:33.304075 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9c4693c6-3bbc-4127-b88f-b6337902d5f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c08ea7f7721644cbbace664438047322'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:33.380935 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-9c4693c6-3bbc-4127-b88f-b6337902d5f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c08ea7f7721644cbbace664438047322'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:33.387124 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1380/2777] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:35:33 2022] DELETE /identity/v3/users/c08ea7f7721644cbbace664438047322 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:33.391567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034118d-70e5-410a-8edc-34f73ec50c3d None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:33.392058 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034118d-70e5-410a-8edc-34f73ec50c3d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:33.392164 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034118d-70e5-410a-8edc-34f73ec50c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:33.409522 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-6034118d-70e5-410a-8edc-34f73ec50c3d None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:33.410761 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6034118d-70e5-410a-8edc-34f73ec50c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:33.470734 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1398/2778] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:35:33.480460 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4693c6-3bbc-4127-b88f-b6337902d5f0 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:33.481845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9c4693c6-3bbc-4127-b88f-b6337902d5f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:33.541381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4693c6-3bbc-4127-b88f-b6337902d5f0 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:33.544934 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1be9c-2613-4c03-bd4c-5fd4469349ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:33.545605 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1be9c-2613-4c03-bd4c-5fd4469349ad service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:33.545883 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1be9c-2613-4c03-bd4c-5fd4469349ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:33.546184 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1be9c-2613-4c03-bd4c-5fd4469349ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:33.556301 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1be9c-2613-4c03-bd4c-5fd4469349ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:33.557743 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1be9c-2613-4c03-bd4c-5fd4469349ad service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:33.568753 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1381/2779] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:35:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:35:33.982044 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034118d-70e5-410a-8edc-34f73ec50c3d None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:33.983494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-6034118d-70e5-410a-8edc-34f73ec50c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:34.009147 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034118d-70e5-410a-8edc-34f73ec50c3d None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:34.014069 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce86363-f13d-4b88-87c0-d42fb16d9559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:34.014951 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce86363-f13d-4b88-87c0-d42fb16d9559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:34.015232 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce86363-f13d-4b88-87c0-d42fb16d9559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:34.015507 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce86363-f13d-4b88-87c0-d42fb16d9559 admin admin] PATH_INFO: `/v3/projects/7e603588700b4ad7959e53ea4d03f673` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:34.016703 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce86363-f13d-4b88-87c0-d42fb16d9559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e603588700b4ad7959e53ea4d03f673)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:34.018698 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce86363-f13d-4b88-87c0-d42fb16d9559 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:34.163717 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6ce86363-f13d-4b88-87c0-d42fb16d9559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e603588700b4ad7959e53ea4d03f673', 'request_id': 'req-6ce86363-f13d-4b88-87c0-d42fb16d9559'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:34.249066 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6ce86363-f13d-4b88-87c0-d42fb16d9559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e603588700b4ad7959e53ea4d03f673', 'request_id': 'req-6ce86363-f13d-4b88-87c0-d42fb16d9559'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:34.255652 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6ce86363-f13d-4b88-87c0-d42fb16d9559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e603588700b4ad7959e53ea4d03f673', 'request_id': 'req-6ce86363-f13d-4b88-87c0-d42fb16d9559'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:34.267187 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6ce86363-f13d-4b88-87c0-d42fb16d9559 admin admin] The token cache is being invalidate because project 7e603588700b4ad7959e53ea4d03f673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:35:34.267478 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6ce86363-f13d-4b88-87c0-d42fb16d9559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:34.268163 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-6ce86363-f13d-4b88-87c0-d42fb16d9559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:35:34.269698 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1399/2780] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:35:33 2022] DELETE /identity/v3/projects/7e603588700b4ad7959e53ea4d03f673 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:34.275592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c6a05-4a00-42bf-8aac-095c3fbcdc59 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:34.276085 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c6a05-4a00-42bf-8aac-095c3fbcdc59 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:34.276194 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c6a05-4a00-42bf-8aac-095c3fbcdc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:34.293843 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-243c6a05-4a00-42bf-8aac-095c3fbcdc59 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:34.295092 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-243c6a05-4a00-42bf-8aac-095c3fbcdc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:34.355592 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1382/2781] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:35:34.363399 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb4696-470b-4f68-b3c8-5975083d5550 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:34.363635 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb4696-470b-4f68-b3c8-5975083d5550 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:34.363926 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb4696-470b-4f68-b3c8-5975083d5550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:34.383813 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-dedb4696-470b-4f68-b3c8-5975083d5550 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:34.385098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-dedb4696-470b-4f68-b3c8-5975083d5550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:34.393254 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1400/2782] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:35:34.397535 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c6a05-4a00-42bf-8aac-095c3fbcdc59 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:34.407289 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c6a05-4a00-42bf-8aac-095c3fbcdc59 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:34.412702 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c63ffe-81a9-4354-aa70-e8d2fbddb4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:34.413344 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c63ffe-81a9-4354-aa70-e8d2fbddb4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:34.413623 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c63ffe-81a9-4354-aa70-e8d2fbddb4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:34.413896 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c63ffe-81a9-4354-aa70-e8d2fbddb4e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:34.414654 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c63ffe-81a9-4354-aa70-e8d2fbddb4e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:35:34.414956 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c63ffe-81a9-4354-aa70-e8d2fbddb4e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:34.416533 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c63ffe-81a9-4354-aa70-e8d2fbddb4e4 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:34.428925 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1383/2783] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:35:34.433047 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb4696-470b-4f68-b3c8-5975083d5550 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:34.442022 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb4696-470b-4f68-b3c8-5975083d5550 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:34.447207 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4af5b-7fc0-4cdd-8fb2-1a5a7fc364e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:34.447889 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4af5b-7fc0-4cdd-8fb2-1a5a7fc364e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:34.448174 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4af5b-7fc0-4cdd-8fb2-1a5a7fc364e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:34.448449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4af5b-7fc0-4cdd-8fb2-1a5a7fc364e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:34.449139 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d4af5b-7fc0-4cdd-8fb2-1a5a7fc364e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:34.451175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d4af5b-7fc0-4cdd-8fb2-1a5a7fc364e5 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:34.464866 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:34.582245 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1401/2784] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:35:34 2022] POST /identity/v3/projects => generated 369 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:35:34.586517 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c63ffe-81a9-4354-aa70-e8d2fbddb4e4 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:34.596696 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c63ffe-81a9-4354-aa70-e8d2fbddb4e4 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:34.644876 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:34.655203 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04ccab-ae3c-4330-8c78-b8018a7f8d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:34.655869 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04ccab-ae3c-4330-8c78-b8018a7f8d3c admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:34.656154 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04ccab-ae3c-4330-8c78-b8018a7f8d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:34.656431 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04ccab-ae3c-4330-8c78-b8018a7f8d3c admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:34.657129 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04ccab-ae3c-4330-8c78-b8018a7f8d3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:34.659112 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04ccab-ae3c-4330-8c78-b8018a7f8d3c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:34.720881 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1384/2785] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:35:34 2022] POST /identity/v3/users => generated 285 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:35:34.722330 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4af5b-7fc0-4cdd-8fb2-1a5a7fc364e5 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:34.733334 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4af5b-7fc0-4cdd-8fb2-1a5a7fc364e5 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:34.738297 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c99a1-47c3-45fb-b845-f9eec20d2b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:34.739496 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c99a1-47c3-45fb-b845-f9eec20d2b1a admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:34.739881 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c99a1-47c3-45fb-b845-f9eec20d2b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:34.740153 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c99a1-47c3-45fb-b845-f9eec20d2b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:34.740881 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c99a1-47c3-45fb-b845-f9eec20d2b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:34.742572 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c99a1-47c3-45fb-b845-f9eec20d2b1a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:34.757059 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1402/2786] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:35:34.758892 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04ccab-ae3c-4330-8c78-b8018a7f8d3c admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:34.768580 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04ccab-ae3c-4330-8c78-b8018a7f8d3c admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:34.773598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ee4d9-1420-4892-ae33-d1c5c1ce4b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:34.774365 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ee4d9-1420-4892-ae33-d1c5c1ce4b1c admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:34.776076 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ee4d9-1420-4892-ae33-d1c5c1ce4b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:34.776076 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ee4d9-1420-4892-ae33-d1c5c1ce4b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:34.776545 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ee4d9-1420-4892-ae33-d1c5c1ce4b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:34.778228 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ee4d9-1420-4892-ae33-d1c5c1ce4b1c admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:34.790660 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1385/2787] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:35:34.796267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c99a1-47c3-45fb-b845-f9eec20d2b1a admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:34.807192 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c99a1-47c3-45fb-b845-f9eec20d2b1a admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:34.811949 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86086ef6-af36-46b2-b511-68a32bac16eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:34.812827 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86086ef6-af36-46b2-b511-68a32bac16eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:34.813110 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86086ef6-af36-46b2-b511-68a32bac16eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:34.813427 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86086ef6-af36-46b2-b511-68a32bac16eb admin admin] PATH_INFO: `/v3/projects/ca088d9eb2d04009a901b94e6cc9628c/users/553946e822b149099f0ae557208c0571/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:34.828663 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86086ef6-af36-46b2-b511-68a32bac16eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca088d9eb2d04009a901b94e6cc9628c, user_id=553946e822b149099f0ae557208c0571, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:34.837788 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86086ef6-af36-46b2-b511-68a32bac16eb admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:34.929104 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1403/2788] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:35:34 2022] PUT /identity/v3/projects/ca088d9eb2d04009a901b94e6cc9628c/users/553946e822b149099f0ae557208c0571/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:35:34.939398 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7c8ac-c4f9-4722-a5eb-c9f6708e6e5c None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:34.943031 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7c8ac-c4f9-4722-a5eb-c9f6708e6e5c None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:34.943031 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7c8ac-c4f9-4722-a5eb-c9f6708e6e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:34.967588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-5cb7c8ac-c4f9-4722-a5eb-c9f6708e6e5c None None] MFA Rules not processed for user `553946e822b149099f0ae557208c0571`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:34.971524 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-5cb7c8ac-c4f9-4722-a5eb-c9f6708e6e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:35.033019 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1386/2789] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:35:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:35:35.044567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86086ef6-af36-46b2-b511-68a32bac16eb admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:35.046359 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-86086ef6-af36-46b2-b511-68a32bac16eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:35.104824 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86086ef6-af36-46b2-b511-68a32bac16eb admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:35.108485 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8c639-38cb-4354-a1f0-79415648c148 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '436d7cc587bc4b2a8a3242fc39876ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:35.109166 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8c639-38cb-4354-a1f0-79415648c148 service glance] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:35.109447 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8c639-38cb-4354-a1f0-79415648c148 service glance] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:35.109725 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8c639-38cb-4354-a1f0-79415648c148 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:35.118836 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8c639-38cb-4354-a1f0-79415648c148 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:35.120262 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8c639-38cb-4354-a1f0-79415648c148 service glance] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:35.129172 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1404/2790] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:35:35 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:35:40.224580 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546dad79-fed1-46a7-9ec9-cb0f9197eb11 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:40.225057 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546dad79-fed1-46a7-9ec9-cb0f9197eb11 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:40.225175 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546dad79-fed1-46a7-9ec9-cb0f9197eb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:40.243961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-546dad79-fed1-46a7-9ec9-cb0f9197eb11 None None] MFA Rules not processed for user `063ce3b820a74d648d709ab6ac4d7be2`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:35:40.245176 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-546dad79-fed1-46a7-9ec9-cb0f9197eb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:40.303354 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1387/2791] 10.222.0.13 () {58 vars in 967 bytes} [Tue Jul 5 21:35:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:35:40.315982 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8c639-38cb-4354-a1f0-79415648c148 service glance] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:40.317400 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-92e8c639-38cb-4354-a1f0-79415648c148 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:35:40.391027 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8c639-38cb-4354-a1f0-79415648c148 service glance] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:40.396915 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d6776-d470-4a51-9cb7-c5efc16de8c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '441be62a077444b9b9f78714e24a760a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:40.396915 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d6776-d470-4a51-9cb7-c5efc16de8c5 service swift] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:40.397221 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d6776-d470-4a51-9cb7-c5efc16de8c5 service swift] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:40.397319 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d6776-d470-4a51-9cb7-c5efc16de8c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:40.406006 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d6776-d470-4a51-9cb7-c5efc16de8c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:40.407626 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d6776-d470-4a51-9cb7-c5efc16de8c5 service swift] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:35:40.417081 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1405/2792] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Jul 5 21:35:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 21:35:50.295529 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=68,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:50.413409 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=75,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:35:59.833505 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546dad79-fed1-46a7-9ec9-cb0f9197eb11 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:35:59.895333 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546dad79-fed1-46a7-9ec9-cb0f9197eb11 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:35:59.900852 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f05194-8688-40b3-bbb1-f927db039b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:35:59.901767 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f05194-8688-40b3-bbb1-f927db039b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:35:59.902048 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f05194-8688-40b3-bbb1-f927db039b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:35:59.902352 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f05194-8688-40b3-bbb1-f927db039b1e admin admin] PATH_INFO: `/v3/users/553946e822b149099f0ae557208c0571` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:35:59.903600 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f05194-8688-40b3-bbb1-f927db039b1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=553946e822b149099f0ae557208c0571)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:35:59.905529 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f05194-8688-40b3-bbb1-f927db039b1e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:36:00.119197 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-60f05194-8688-40b3-bbb1-f927db039b1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '553946e822b149099f0ae557208c0571'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:36:00.125855 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-60f05194-8688-40b3-bbb1-f927db039b1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '553946e822b149099f0ae557208c0571'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:36:00.138078 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-60f05194-8688-40b3-bbb1-f927db039b1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '553946e822b149099f0ae557208c0571'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:36:00.138773 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-60f05194-8688-40b3-bbb1-f927db039b1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '553946e822b149099f0ae557208c0571'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:36:00.302826 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-60f05194-8688-40b3-bbb1-f927db039b1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '553946e822b149099f0ae557208c0571'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:36:00.309277 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1388/2793] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:35:59 2022] DELETE /identity/v3/users/553946e822b149099f0ae557208c0571 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:36:00.313855 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95e326-4c02-4f2a-bcaa-a2e3e9122cd3 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:36:00.314382 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95e326-4c02-4f2a-bcaa-a2e3e9122cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:36:00.314482 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95e326-4c02-4f2a-bcaa-a2e3e9122cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:36:00.331185 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-7b95e326-4c02-4f2a-bcaa-a2e3e9122cd3 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:36:00.332385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7b95e326-4c02-4f2a-bcaa-a2e3e9122cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:36:00.391659 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1406/2794] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:36:00.401888 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f05194-8688-40b3-bbb1-f927db039b1e admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:36:00.403376 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-60f05194-8688-40b3-bbb1-f927db039b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:36:00.462379 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f05194-8688-40b3-bbb1-f927db039b1e admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:36:00.466020 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ce678-bf80-444f-9fac-20b3a04db21c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:36:00.466689 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ce678-bf80-444f-9fac-20b3a04db21c service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:36:00.466974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ce678-bf80-444f-9fac-20b3a04db21c service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:36:00.467252 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ce678-bf80-444f-9fac-20b3a04db21c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:36:00.476277 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ce678-bf80-444f-9fac-20b3a04db21c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:36:00.477792 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ce678-bf80-444f-9fac-20b3a04db21c service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:36:00.488037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1389/2795] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:36:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:36:00.917449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95e326-4c02-4f2a-bcaa-a2e3e9122cd3 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:36:00.919045 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-7b95e326-4c02-4f2a-bcaa-a2e3e9122cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:36:00.931885 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95e326-4c02-4f2a-bcaa-a2e3e9122cd3 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:36:00.936596 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3fd6f-7d4a-43a6-96b1-e44949248f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:36:00.937467 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3fd6f-7d4a-43a6-96b1-e44949248f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:36:00.937751 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3fd6f-7d4a-43a6-96b1-e44949248f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:36:00.938034 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3fd6f-7d4a-43a6-96b1-e44949248f75 admin admin] PATH_INFO: `/v3/projects/ca088d9eb2d04009a901b94e6cc9628c` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:36:00.939297 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3fd6f-7d4a-43a6-96b1-e44949248f75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca088d9eb2d04009a901b94e6cc9628c)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:36:00.941241 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3fd6f-7d4a-43a6-96b1-e44949248f75 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:36:01.047714 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-08e3fd6f-7d4a-43a6-96b1-e44949248f75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca088d9eb2d04009a901b94e6cc9628c', 'request_id': 'req-08e3fd6f-7d4a-43a6-96b1-e44949248f75'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:36:01.120519 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-08e3fd6f-7d4a-43a6-96b1-e44949248f75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca088d9eb2d04009a901b94e6cc9628c', 'request_id': 'req-08e3fd6f-7d4a-43a6-96b1-e44949248f75'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:36:01.126871 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-08e3fd6f-7d4a-43a6-96b1-e44949248f75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca088d9eb2d04009a901b94e6cc9628c', 'request_id': 'req-08e3fd6f-7d4a-43a6-96b1-e44949248f75'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:36:01.138961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-08e3fd6f-7d4a-43a6-96b1-e44949248f75 admin admin] The token cache is being invalidate because project ca088d9eb2d04009a901b94e6cc9628c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:36:01.139279 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-08e3fd6f-7d4a-43a6-96b1-e44949248f75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:36:01.139939 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-08e3fd6f-7d4a-43a6-96b1-e44949248f75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:36:01.141510 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1407/2796] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:36:00 2022] DELETE /identity/v3/projects/ca088d9eb2d04009a901b94e6cc9628c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:36:10.483516 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:36:11.136051 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:36:20.646819 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ce678-bf80-444f-9fac-20b3a04db21c service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:36:20.648312 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2d4ce678-bf80-444f-9fac-20b3a04db21c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:36:20.718515 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ce678-bf80-444f-9fac-20b3a04db21c service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:36:20.780382 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f94c35-7e1f-4268-ac6c-d52232b4fb22 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992db9dab5944769b192a868d6637a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:36:20.781028 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f94c35-7e1f-4268-ac6c-d52232b4fb22 service placement] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:36:20.781308 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f94c35-7e1f-4268-ac6c-d52232b4fb22 service placement] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:36:20.781579 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f94c35-7e1f-4268-ac6c-d52232b4fb22 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:36:20.783437 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-55f94c35-7e1f-4268-ac6c-d52232b4fb22 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:36:20.795296 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f94c35-7e1f-4268-ac6c-d52232b4fb22 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:36:20.796886 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f94c35-7e1f-4268-ac6c-d52232b4fb22 service placement] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:36:20.807641 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1390/2797] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:36:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:36:25.429728 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c833b-a042-43a4-9795-d338c2be5e9b None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:36:25.430292 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c833b-a042-43a4-9795-d338c2be5e9b None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:36:25.430467 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c833b-a042-43a4-9795-d338c2be5e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:36:25.449586 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-f03c833b-a042-43a4-9795-d338c2be5e9b None None] MFA Rules not processed for user `19a7d575957f44b8abd5dbbb18e75eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:36:25.450835 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f03c833b-a042-43a4-9795-d338c2be5e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:36:25.505328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1408/2798] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:36:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:36:25.806467 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f94c35-7e1f-4268-ac6c-d52232b4fb22 service placement] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:36:25.807896 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-55f94c35-7e1f-4268-ac6c-d52232b4fb22 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:36:25.863794 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f94c35-7e1f-4268-ac6c-d52232b4fb22 service placement] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:36:25.867435 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f2100-70f9-4548-ad1b-1f6a03e1fd27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:36:25.868071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f2100-70f9-4548-ad1b-1f6a03e1fd27 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:36:25.868355 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f2100-70f9-4548-ad1b-1f6a03e1fd27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:36:25.868632 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f2100-70f9-4548-ad1b-1f6a03e1fd27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:36:25.870394 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6a5f2100-70f9-4548-ad1b-1f6a03e1fd27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:36:25.879845 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f2100-70f9-4548-ad1b-1f6a03e1fd27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:36:25.881257 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f2100-70f9-4548-ad1b-1f6a03e1fd27 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:36:25.889314 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1391/2799] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:36:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:36:35.498035 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=25 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:36:35.885622 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=84 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:37:39.712555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48b9e7-9f51-4f7c-86a6-2591a6d4076d None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:39.713192 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48b9e7-9f51-4f7c-86a6-2591a6d4076d None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:39.713314 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48b9e7-9f51-4f7c-86a6-2591a6d4076d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:39.731532 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-3f48b9e7-9f51-4f7c-86a6-2591a6d4076d None None] MFA Rules not processed for user `063ce3b820a74d648d709ab6ac4d7be2`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:37:39.732724 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3f48b9e7-9f51-4f7c-86a6-2591a6d4076d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:39.789171 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1409/2800] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Jul 5 21:37:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:37:39.930551 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f2100-70f9-4548-ad1b-1f6a03e1fd27 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:37:39.932029 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6a5f2100-70f9-4548-ad1b-1f6a03e1fd27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:40.000692 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f2100-70f9-4548-ad1b-1f6a03e1fd27 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:37:40.006361 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a0892-a9f0-4903-b061-e851918e8fd8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '441be62a077444b9b9f78714e24a760a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:37:40.009735 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a0892-a9f0-4903-b061-e851918e8fd8 service swift] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:40.009735 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a0892-a9f0-4903-b061-e851918e8fd8 service swift] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:40.009735 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a0892-a9f0-4903-b061-e851918e8fd8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:40.015577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a0892-a9f0-4903-b061-e851918e8fd8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:37:40.017853 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a0892-a9f0-4903-b061-e851918e8fd8 service swift] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:37:40.025937 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1392/2801] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Jul 5 21:37:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 21:37:49.781559 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=25 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:37:50.022723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=32 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:37:56.584866 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34270f-0a05-4c01-b21f-dd2ee16bf8dc None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:56.585404 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34270f-0a05-4c01-b21f-dd2ee16bf8dc None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:56.585525 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34270f-0a05-4c01-b21f-dd2ee16bf8dc None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:56.587039 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1410/2802] 10.222.0.13 () {54 vars in 921 bytes} [Tue Jul 5 21:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:37:56.592961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6ea40-e456-496e-8897-754854c1e067 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:56.593441 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6ea40-e456-496e-8897-754854c1e067 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:56.593557 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6ea40-e456-496e-8897-754854c1e067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:56.612824 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-3ab6ea40-e456-496e-8897-754854c1e067 None None] MFA Rules not processed for user `910cd341df8943f18af2765e2a30b238`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:37:56.614222 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3ab6ea40-e456-496e-8897-754854c1e067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:56.682992 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1393/2803] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Jul 5 21:37:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:37:56.694365 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34270f-0a05-4c01-b21f-dd2ee16bf8dc None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:37:56.695976 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ed34270f-0a05-4c01-b21f-dd2ee16bf8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:56.754136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34270f-0a05-4c01-b21f-dd2ee16bf8dc None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:37:56.757640 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b70fe6-3a01-438f-93e7-8cae0594de54 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '436d7cc587bc4b2a8a3242fc39876ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:37:56.758312 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b70fe6-3a01-438f-93e7-8cae0594de54 service glance] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:56.758599 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b70fe6-3a01-438f-93e7-8cae0594de54 service glance] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:56.758880 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b70fe6-3a01-438f-93e7-8cae0594de54 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:56.768882 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b70fe6-3a01-438f-93e7-8cae0594de54 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:37:56.770856 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b70fe6-3a01-438f-93e7-8cae0594de54 service glance] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:37:56.781408 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1411/2804] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:37:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:37:56.983484 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3901c29-c5f7-4c54-95e6-84e93abced4f None None] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:56.983693 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3901c29-c5f7-4c54-95e6-84e93abced4f None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:56.983962 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3901c29-c5f7-4c54-95e6-84e93abced4f None None] PATH_INFO: `/` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:56.985348 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1394/2805] 10.222.0.13 () {54 vars in 921 bytes} [Tue Jul 5 21:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:37:56.990440 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71df961-163c-49e6-9647-6c77c7c25465 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:56.995806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71df961-163c-49e6-9647-6c77c7c25465 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:56.995806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71df961-163c-49e6-9647-6c77c7c25465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:57.010306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b71df961-163c-49e6-9647-6c77c7c25465 None None] MFA Rules not processed for user `97b6b7c15770400cad4e2b52b13ad354`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:37:57.011498 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b71df961-163c-49e6-9647-6c77c7c25465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:57.017905 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1412/2806] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Jul 5 21:37:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:37:57.030631 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3901c29-c5f7-4c54-95e6-84e93abced4f None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:37:57.042281 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3901c29-c5f7-4c54-95e6-84e93abced4f None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:37:57.045718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df4c12-52c7-47c2-8942-8bc3165c593d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:37:57.046426 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df4c12-52c7-47c2-8942-8bc3165c593d service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:57.046709 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df4c12-52c7-47c2-8942-8bc3165c593d service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:57.046984 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df4c12-52c7-47c2-8942-8bc3165c593d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:57.054736 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df4c12-52c7-47c2-8942-8bc3165c593d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:37:57.056243 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df4c12-52c7-47c2-8942-8bc3165c593d service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:37:57.064750 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1395/2807] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:37:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:37:57.147028 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed186b1-abd7-44cf-8f0e-7182c438e055 None None] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:57.147322 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed186b1-abd7-44cf-8f0e-7182c438e055 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:57.147608 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed186b1-abd7-44cf-8f0e-7182c438e055 None None] PATH_INFO: `/` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:57.149001 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1413/2808] 10.222.0.13 () {54 vars in 921 bytes} [Tue Jul 5 21:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:37:57.154566 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1728e2-9897-47a4-ac33-fcf23ab45a4d None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:57.155013 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1728e2-9897-47a4-ac33-fcf23ab45a4d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:57.155136 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1728e2-9897-47a4-ac33-fcf23ab45a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:57.173302 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-2d1728e2-9897-47a4-ac33-fcf23ab45a4d None None] MFA Rules not processed for user `910cd341df8943f18af2765e2a30b238`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:37:57.174541 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2d1728e2-9897-47a4-ac33-fcf23ab45a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:57.184019 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1396/2809] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Jul 5 21:37:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:37:57.195803 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed186b1-abd7-44cf-8f0e-7182c438e055 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:37:57.197534 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-2ed186b1-abd7-44cf-8f0e-7182c438e055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:57.211790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed186b1-abd7-44cf-8f0e-7182c438e055 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:37:57.215437 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588bb71-71d4-4340-859f-8025fcff29aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:37:57.216097 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588bb71-71d4-4340-859f-8025fcff29aa service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:57.216383 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588bb71-71d4-4340-859f-8025fcff29aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:57.216661 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588bb71-71d4-4340-859f-8025fcff29aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:57.226862 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588bb71-71d4-4340-859f-8025fcff29aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:37:57.228294 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588bb71-71d4-4340-859f-8025fcff29aa service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:37:57.239665 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1414/2810] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:37:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:37:59.959792 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d82b6-9cc2-4744-80bf-b2bbba7ac6ee None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:59.960270 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d82b6-9cc2-4744-80bf-b2bbba7ac6ee None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:59.960381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d82b6-9cc2-4744-80bf-b2bbba7ac6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:59.978109 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-9d6d82b6-9cc2-4744-80bf-b2bbba7ac6ee None None] MFA Rules not processed for user `063ce3b820a74d648d709ab6ac4d7be2`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:37:59.979324 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9d6d82b6-9cc2-4744-80bf-b2bbba7ac6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:59.986673 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1397/2811] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Jul 5 21:37:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:37:59.998938 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588bb71-71d4-4340-859f-8025fcff29aa service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:38:00.010083 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588bb71-71d4-4340-859f-8025fcff29aa service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:38:00.015040 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ae72c-6a17-4a4d-9970-f7f7bbd5a9bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '441be62a077444b9b9f78714e24a760a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:38:00.015696 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ae72c-6a17-4a4d-9970-f7f7bbd5a9bc service swift] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:38:00.015980 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ae72c-6a17-4a4d-9970-f7f7bbd5a9bc service swift] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:38:00.016259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ae72c-6a17-4a4d-9970-f7f7bbd5a9bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:38:00.024243 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ae72c-6a17-4a4d-9970-f7f7bbd5a9bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:38:00.029218 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ae72c-6a17-4a4d-9970-f7f7bbd5a9bc service swift] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:38:00.033740 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1415/2812] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Jul 5 21:37:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 21:38:07.537970 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d82b6-9cc2-4744-80bf-b2bbba7ac6ee None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:38:07.547578 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d82b6-9cc2-4744-80bf-b2bbba7ac6ee None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:38:07.551443 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a7792-73ca-44bd-8c8c-5154e9b28f08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:38:07.552082 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a7792-73ca-44bd-8c8c-5154e9b28f08 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:38:07.552366 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a7792-73ca-44bd-8c8c-5154e9b28f08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:38:07.552645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a7792-73ca-44bd-8c8c-5154e9b28f08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:38:07.554427 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-116a7792-73ca-44bd-8c8c-5154e9b28f08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:38:07.568282 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a7792-73ca-44bd-8c8c-5154e9b28f08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:38:07.569715 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a7792-73ca-44bd-8c8c-5154e9b28f08 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:38:07.580624 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1398/2813] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:38:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:38:08.758987 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ae72c-6a17-4a4d-9970-f7f7bbd5a9bc service swift] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:38:08.768286 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ae72c-6a17-4a4d-9970-f7f7bbd5a9bc service swift] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:38:08.772367 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc14f7b-68c5-43cb-8a85-e4e2b3930536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:38:08.772994 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc14f7b-68c5-43cb-8a85-e4e2b3930536 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:38:08.773276 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc14f7b-68c5-43cb-8a85-e4e2b3930536 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:38:08.773553 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc14f7b-68c5-43cb-8a85-e4e2b3930536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:38:08.775349 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-cdc14f7b-68c5-43cb-8a85-e4e2b3930536 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:38:08.789063 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc14f7b-68c5-43cb-8a85-e4e2b3930536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:38:08.790574 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc14f7b-68c5-43cb-8a85-e4e2b3930536 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:38:08.801652 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1416/2814] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:38:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:38:14.152576 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15a5df-3b78-4662-b5a6-d09402d9a055 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:38:14.153064 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15a5df-3b78-4662-b5a6-d09402d9a055 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:38:14.153201 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15a5df-3b78-4662-b5a6-d09402d9a055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:38:14.171573 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-af15a5df-3b78-4662-b5a6-d09402d9a055 None None] MFA Rules not processed for user `063ce3b820a74d648d709ab6ac4d7be2`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:38:14.172831 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-af15a5df-3b78-4662-b5a6-d09402d9a055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:38:14.182206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1399/2815] 10.222.0.13 () {58 vars in 967 bytes} [Tue Jul 5 21:38:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:38:14.195049 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc14f7b-68c5-43cb-8a85-e4e2b3930536 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:38:14.206326 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc14f7b-68c5-43cb-8a85-e4e2b3930536 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:38:14.211822 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db7369-d2bd-4d0e-b305-c3a267120370 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '441be62a077444b9b9f78714e24a760a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:38:14.212479 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db7369-d2bd-4d0e-b305-c3a267120370 service swift] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:38:14.212762 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db7369-d2bd-4d0e-b305-c3a267120370 service swift] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:38:14.213039 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db7369-d2bd-4d0e-b305-c3a267120370 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:38:14.221160 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db7369-d2bd-4d0e-b305-c3a267120370 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:38:14.222761 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db7369-d2bd-4d0e-b305-c3a267120370 service swift] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:38:14.231820 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1417/2816] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Jul 5 21:38:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 21:38:24.166133 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=52 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:38:24.228171 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=53 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:38:28.686503 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15a5df-3b78-4662-b5a6-d09402d9a055 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:38:28.687923 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-af15a5df-3b78-4662-b5a6-d09402d9a055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:38:28.703068 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15a5df-3b78-4662-b5a6-d09402d9a055 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:38:28.707966 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3354afe-88df-45f5-8ff4-15084845784e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992db9dab5944769b192a868d6637a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:38:28.708634 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3354afe-88df-45f5-8ff4-15084845784e service placement] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:38:28.708912 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3354afe-88df-45f5-8ff4-15084845784e service placement] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:38:28.709188 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3354afe-88df-45f5-8ff4-15084845784e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:38:28.710974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-b3354afe-88df-45f5-8ff4-15084845784e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:38:28.724738 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3354afe-88df-45f5-8ff4-15084845784e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:38:28.726413 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3354afe-88df-45f5-8ff4-15084845784e service placement] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:38:28.736940 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1400/2817] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:38:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:38:32.351464 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db7369-d2bd-4d0e-b305-c3a267120370 service swift] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:38:32.354317 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c8db7369-d2bd-4d0e-b305-c3a267120370 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:38:32.420226 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db7369-d2bd-4d0e-b305-c3a267120370 service swift] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:38:32.424593 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86055c53-5382-43f3-8bf0-e822a8f098d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:38:32.425444 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86055c53-5382-43f3-8bf0-e822a8f098d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:38:32.425719 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86055c53-5382-43f3-8bf0-e822a8f098d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:38:32.425986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86055c53-5382-43f3-8bf0-e822a8f098d7 admin admin] PATH_INFO: `/v3/users/bc1026f8fa6e4f118062f618cce875f2` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:38:32.427314 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86055c53-5382-43f3-8bf0-e822a8f098d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc1026f8fa6e4f118062f618cce875f2)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:38:32.429226 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86055c53-5382-43f3-8bf0-e822a8f098d7 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:38:32.587598 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-86055c53-5382-43f3-8bf0-e822a8f098d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc1026f8fa6e4f118062f618cce875f2'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:38:32.659686 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-86055c53-5382-43f3-8bf0-e822a8f098d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc1026f8fa6e4f118062f618cce875f2'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:38:32.672502 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-86055c53-5382-43f3-8bf0-e822a8f098d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc1026f8fa6e4f118062f618cce875f2'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:38:32.679311 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-86055c53-5382-43f3-8bf0-e822a8f098d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc1026f8fa6e4f118062f618cce875f2'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:38:32.679966 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-86055c53-5382-43f3-8bf0-e822a8f098d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc1026f8fa6e4f118062f618cce875f2'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:38:32.686255 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1418/2818] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:38:32 2022] DELETE /identity/v3/users/bc1026f8fa6e4f118062f618cce875f2 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:38:32.923976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3354afe-88df-45f5-8ff4-15084845784e service placement] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:38:32.936621 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3354afe-88df-45f5-8ff4-15084845784e service placement] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:38:32.998747 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924768df-2156-4b89-8890-1fe78baf1393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:38:32.999598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924768df-2156-4b89-8890-1fe78baf1393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:38:32.999875 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924768df-2156-4b89-8890-1fe78baf1393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:38:33.000144 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924768df-2156-4b89-8890-1fe78baf1393 admin admin] PATH_INFO: `/v3/projects/c35dc9956a7344e29a171d1094bb00e0` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:38:33.001346 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924768df-2156-4b89-8890-1fe78baf1393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c35dc9956a7344e29a171d1094bb00e0)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:38:33.003306 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924768df-2156-4b89-8890-1fe78baf1393 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:38:33.139594 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-924768df-2156-4b89-8890-1fe78baf1393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c35dc9956a7344e29a171d1094bb00e0', 'request_id': 'req-924768df-2156-4b89-8890-1fe78baf1393'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:38:33.145131 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-924768df-2156-4b89-8890-1fe78baf1393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c35dc9956a7344e29a171d1094bb00e0', 'request_id': 'req-924768df-2156-4b89-8890-1fe78baf1393'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:38:33.196072 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-924768df-2156-4b89-8890-1fe78baf1393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c35dc9956a7344e29a171d1094bb00e0', 'request_id': 'req-924768df-2156-4b89-8890-1fe78baf1393'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:38:33.207124 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-924768df-2156-4b89-8890-1fe78baf1393 admin admin] The token cache is being invalidate because project c35dc9956a7344e29a171d1094bb00e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:38:33.212764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-924768df-2156-4b89-8890-1fe78baf1393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:38:33.212764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-924768df-2156-4b89-8890-1fe78baf1393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:38:33.212764 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1401/2819] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:38:32 2022] DELETE /identity/v3/projects/c35dc9956a7344e29a171d1094bb00e0 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:38:33.213630 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86055c53-5382-43f3-8bf0-e822a8f098d7 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:38:33.215098 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-86055c53-5382-43f3-8bf0-e822a8f098d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:38:33.229679 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86055c53-5382-43f3-8bf0-e822a8f098d7 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:38:33.285145 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64687a9-cf36-4b84-acd6-4f74e8887580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:38:33.286003 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64687a9-cf36-4b84-acd6-4f74e8887580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:38:33.286312 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64687a9-cf36-4b84-acd6-4f74e8887580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:38:33.286588 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64687a9-cf36-4b84-acd6-4f74e8887580 admin admin] PATH_INFO: `/v3/users/a103297647614fd390ed26acbbba5465` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:38:33.287752 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64687a9-cf36-4b84-acd6-4f74e8887580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a103297647614fd390ed26acbbba5465)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:38:33.289659 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64687a9-cf36-4b84-acd6-4f74e8887580 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:38:33.311499 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:38:33.475936 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b64687a9-cf36-4b84-acd6-4f74e8887580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a103297647614fd390ed26acbbba5465'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:38:33.545106 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b64687a9-cf36-4b84-acd6-4f74e8887580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a103297647614fd390ed26acbbba5465'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:38:33.557916 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b64687a9-cf36-4b84-acd6-4f74e8887580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a103297647614fd390ed26acbbba5465'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:38:33.565230 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b64687a9-cf36-4b84-acd6-4f74e8887580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a103297647614fd390ed26acbbba5465'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:38:33.565886 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b64687a9-cf36-4b84-acd6-4f74e8887580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a103297647614fd390ed26acbbba5465'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:38:33.571898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1419/2820] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:38:33 2022] DELETE /identity/v3/users/a103297647614fd390ed26acbbba5465 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:38:33.823105 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924768df-2156-4b89-8890-1fe78baf1393 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:38:33.824566 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-924768df-2156-4b89-8890-1fe78baf1393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:38:33.841862 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924768df-2156-4b89-8890-1fe78baf1393 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:38:33.901337 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c04501-9648-47f8-8650-bdef1285bf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:38:33.902230 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c04501-9648-47f8-8650-bdef1285bf1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:38:33.902512 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c04501-9648-47f8-8650-bdef1285bf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:38:33.902785 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c04501-9648-47f8-8650-bdef1285bf1f admin admin] PATH_INFO: `/v3/projects/540833e57abc4502bd96cb16ca20eede` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:38:33.903963 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c04501-9648-47f8-8650-bdef1285bf1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=540833e57abc4502bd96cb16ca20eede)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:38:33.905880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c04501-9648-47f8-8650-bdef1285bf1f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:38:33.926126 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:38:34.014296 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e8c04501-9648-47f8-8650-bdef1285bf1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '540833e57abc4502bd96cb16ca20eede', 'request_id': 'req-e8c04501-9648-47f8-8650-bdef1285bf1f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:38:34.019947 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e8c04501-9648-47f8-8650-bdef1285bf1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '540833e57abc4502bd96cb16ca20eede', 'request_id': 'req-e8c04501-9648-47f8-8650-bdef1285bf1f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:38:34.127740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e8c04501-9648-47f8-8650-bdef1285bf1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '540833e57abc4502bd96cb16ca20eede', 'request_id': 'req-e8c04501-9648-47f8-8650-bdef1285bf1f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:38:34.140025 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e8c04501-9648-47f8-8650-bdef1285bf1f admin admin] The token cache is being invalidate because project 540833e57abc4502bd96cb16ca20eede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:38:34.140312 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e8c04501-9648-47f8-8650-bdef1285bf1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:38:34.140937 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-e8c04501-9648-47f8-8650-bdef1285bf1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:38:34.142539 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1402/2821] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:38:33 2022] DELETE /identity/v3/projects/540833e57abc4502bd96cb16ca20eede => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:38:43.568250 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:38:44.136937 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:38:48.809371 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64687a9-cf36-4b84-acd6-4f74e8887580 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:38:48.810803 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b64687a9-cf36-4b84-acd6-4f74e8887580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:38:48.868213 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64687a9-cf36-4b84-acd6-4f74e8887580 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:38:48.915547 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5cdde-4771-4fb1-a963-c45b61b3b9e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:38:48.916182 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5cdde-4771-4fb1-a963-c45b61b3b9e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:38:48.916468 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5cdde-4771-4fb1-a963-c45b61b3b9e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:38:48.916746 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5cdde-4771-4fb1-a963-c45b61b3b9e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:38:48.918544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-cfb5cdde-4771-4fb1-a963-c45b61b3b9e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:38:48.975908 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5cdde-4771-4fb1-a963-c45b61b3b9e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:38:48.977469 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5cdde-4771-4fb1-a963-c45b61b3b9e0 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:38:48.986948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1420/2822] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:38:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:38:52.093525 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c04501-9648-47f8-8650-bdef1285bf1f admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:38:52.095210 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-e8c04501-9648-47f8-8650-bdef1285bf1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:38:52.178884 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c04501-9648-47f8-8650-bdef1285bf1f admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:38:52.187689 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba1d48-f570-4925-9e0b-8a588480756c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910cd341df8943f18af2765e2a30b238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:38:52.192670 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba1d48-f570-4925-9e0b-8a588480756c service nova] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:38:52.192670 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba1d48-f570-4925-9e0b-8a588480756c service nova] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:38:52.192670 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba1d48-f570-4925-9e0b-8a588480756c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:38:52.192670 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-95ba1d48-f570-4925-9e0b-8a588480756c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:38:52.204512 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba1d48-f570-4925-9e0b-8a588480756c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:38:52.206251 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba1d48-f570-4925-9e0b-8a588480756c service nova] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:38:52.219202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1403/2823] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:38:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:38:56.445591 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5cdde-4771-4fb1-a963-c45b61b3b9e0 service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:38:56.447697 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-cfb5cdde-4771-4fb1-a963-c45b61b3b9e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:38:56.504764 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5cdde-4771-4fb1-a963-c45b61b3b9e0 service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:38:56.508843 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72148e-1fe0-496c-89de-62796a4be677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:38:56.509560 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72148e-1fe0-496c-89de-62796a4be677 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:38:56.509842 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72148e-1fe0-496c-89de-62796a4be677 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:38:56.510134 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72148e-1fe0-496c-89de-62796a4be677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:38:56.511875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-4c72148e-1fe0-496c-89de-62796a4be677 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:38:56.536787 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=100 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:38:56.576320 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72148e-1fe0-496c-89de-62796a4be677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:38:56.577765 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72148e-1fe0-496c-89de-62796a4be677 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:38:56.589435 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1421/2824] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:38:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:39:00.259010 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba1d48-f570-4925-9e0b-8a588480756c service nova] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:00.259485 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-95ba1d48-f570-4925-9e0b-8a588480756c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:00.273122 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba1d48-f570-4925-9e0b-8a588480756c service nova] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:00.278535 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbb3ef-8bec-434d-84c7-64a5f8039f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:00.279558 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbb3ef-8bec-434d-84c7-64a5f8039f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:00.279841 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbb3ef-8bec-434d-84c7-64a5f8039f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:00.280222 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbb3ef-8bec-434d-84c7-64a5f8039f6a admin admin] PATH_INFO: `/v3/users/19a7d575957f44b8abd5dbbb18e75eb3` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:00.281393 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cbb3ef-8bec-434d-84c7-64a5f8039f6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=19a7d575957f44b8abd5dbbb18e75eb3)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:00.283339 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cbb3ef-8bec-434d-84c7-64a5f8039f6a admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:00.489324 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-98cbb3ef-8bec-434d-84c7-64a5f8039f6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19a7d575957f44b8abd5dbbb18e75eb3'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:00.496758 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-98cbb3ef-8bec-434d-84c7-64a5f8039f6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19a7d575957f44b8abd5dbbb18e75eb3'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:00.508743 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-98cbb3ef-8bec-434d-84c7-64a5f8039f6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19a7d575957f44b8abd5dbbb18e75eb3'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:00.516566 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-98cbb3ef-8bec-434d-84c7-64a5f8039f6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19a7d575957f44b8abd5dbbb18e75eb3'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:00.589240 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-98cbb3ef-8bec-434d-84c7-64a5f8039f6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19a7d575957f44b8abd5dbbb18e75eb3'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:00.596224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1404/2825] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:39:00 2022] DELETE /identity/v3/users/19a7d575957f44b8abd5dbbb18e75eb3 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:39:00.858275 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72148e-1fe0-496c-89de-62796a4be677 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:00.868533 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72148e-1fe0-496c-89de-62796a4be677 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:00.925933 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83bef9-31b5-49a9-8c77-2bbdfb72db45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:00.926827 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83bef9-31b5-49a9-8c77-2bbdfb72db45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:00.927121 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83bef9-31b5-49a9-8c77-2bbdfb72db45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:00.927401 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83bef9-31b5-49a9-8c77-2bbdfb72db45 admin admin] PATH_INFO: `/v3/projects/70f599a604c74db9a850bd1051d4508f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:00.928588 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83bef9-31b5-49a9-8c77-2bbdfb72db45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70f599a604c74db9a850bd1051d4508f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:00.930552 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83bef9-31b5-49a9-8c77-2bbdfb72db45 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:01.068178 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-be83bef9-31b5-49a9-8c77-2bbdfb72db45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70f599a604c74db9a850bd1051d4508f', 'request_id': 'req-be83bef9-31b5-49a9-8c77-2bbdfb72db45'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:01.141983 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-be83bef9-31b5-49a9-8c77-2bbdfb72db45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70f599a604c74db9a850bd1051d4508f', 'request_id': 'req-be83bef9-31b5-49a9-8c77-2bbdfb72db45'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:01.147801 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-be83bef9-31b5-49a9-8c77-2bbdfb72db45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70f599a604c74db9a850bd1051d4508f', 'request_id': 'req-be83bef9-31b5-49a9-8c77-2bbdfb72db45'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:01.159508 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-be83bef9-31b5-49a9-8c77-2bbdfb72db45 admin admin] The token cache is being invalidate because project 70f599a604c74db9a850bd1051d4508f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:39:01.159801 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-be83bef9-31b5-49a9-8c77-2bbdfb72db45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:01.160471 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-be83bef9-31b5-49a9-8c77-2bbdfb72db45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:01.162013 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1422/2826] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:39:00 2022] DELETE /identity/v3/projects/70f599a604c74db9a850bd1051d4508f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:39:01.167262 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0f6f5-7f39-48a2-bf60-f0a9da471cca None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:01.167549 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0f6f5-7f39-48a2-bf60-f0a9da471cca None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:01.167853 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0f6f5-7f39-48a2-bf60-f0a9da471cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:01.186972 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-edf0f6f5-7f39-48a2-bf60-f0a9da471cca None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:39:01.188186 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-edf0f6f5-7f39-48a2-bf60-f0a9da471cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:01.238393 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:39:01.248127 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1405/2827] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:39:01.256124 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ed9ed-a881-4f10-98b9-a1775ac60833 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:01.256423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ed9ed-a881-4f10-98b9-a1775ac60833 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:01.256709 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ed9ed-a881-4f10-98b9-a1775ac60833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:01.277055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-758ed9ed-a881-4f10-98b9-a1775ac60833 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:39:01.278341 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-758ed9ed-a881-4f10-98b9-a1775ac60833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:01.286711 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1423/2828] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:39:01.290978 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0f6f5-7f39-48a2-bf60-f0a9da471cca None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:01.300833 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0f6f5-7f39-48a2-bf60-f0a9da471cca None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:01.307069 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3abd61-2294-408d-a8ea-43d816701d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:01.307724 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3abd61-2294-408d-a8ea-43d816701d93 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:01.308009 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3abd61-2294-408d-a8ea-43d816701d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:01.308286 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3abd61-2294-408d-a8ea-43d816701d93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:01.309009 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3abd61-2294-408d-a8ea-43d816701d93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:39:01.309318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3abd61-2294-408d-a8ea-43d816701d93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:01.310943 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3abd61-2294-408d-a8ea-43d816701d93 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:01.323351 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1406/2829] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:39:01.327621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ed9ed-a881-4f10-98b9-a1775ac60833 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:01.337608 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ed9ed-a881-4f10-98b9-a1775ac60833 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:01.342301 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fffa15-3f1f-4af4-9d80-802ae2b16f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:01.342943 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fffa15-3f1f-4af4-9d80-802ae2b16f71 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:01.343227 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fffa15-3f1f-4af4-9d80-802ae2b16f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:01.343499 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fffa15-3f1f-4af4-9d80-802ae2b16f71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:01.344180 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fffa15-3f1f-4af4-9d80-802ae2b16f71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:01.346085 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fffa15-3f1f-4af4-9d80-802ae2b16f71 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:01.442194 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1424/2830] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:39:01 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:39:01.446245 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3abd61-2294-408d-a8ea-43d816701d93 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:01.456810 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3abd61-2294-408d-a8ea-43d816701d93 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:01.515454 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca0787-357d-4ac0-85cd-c80bfa3ebb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:01.516128 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca0787-357d-4ac0-85cd-c80bfa3ebb55 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:01.516443 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca0787-357d-4ac0-85cd-c80bfa3ebb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:01.516723 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca0787-357d-4ac0-85cd-c80bfa3ebb55 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:01.517432 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca0787-357d-4ac0-85cd-c80bfa3ebb55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:01.519377 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca0787-357d-4ac0-85cd-c80bfa3ebb55 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:01.591094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1407/2831] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:39:01 2022] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:39:01.594956 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fffa15-3f1f-4af4-9d80-802ae2b16f71 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:01.607647 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fffa15-3f1f-4af4-9d80-802ae2b16f71 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:01.612547 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85acb26-73d2-4901-a537-ab218388de90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:01.613207 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85acb26-73d2-4901-a537-ab218388de90 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:01.613493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85acb26-73d2-4901-a537-ab218388de90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:01.613770 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85acb26-73d2-4901-a537-ab218388de90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:01.614544 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85acb26-73d2-4901-a537-ab218388de90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:01.616138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85acb26-73d2-4901-a537-ab218388de90 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:01.626549 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1425/2832] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:39:01.631962 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca0787-357d-4ac0-85cd-c80bfa3ebb55 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:01.642874 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca0787-357d-4ac0-85cd-c80bfa3ebb55 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:01.647555 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ab811-7d61-4e89-ae88-b989d1e69304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:01.648207 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ab811-7d61-4e89-ae88-b989d1e69304 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:01.649130 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ab811-7d61-4e89-ae88-b989d1e69304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:01.649548 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ab811-7d61-4e89-ae88-b989d1e69304 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:01.650329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ab811-7d61-4e89-ae88-b989d1e69304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:01.651917 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ab811-7d61-4e89-ae88-b989d1e69304 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:01.661904 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1408/2833] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:39:01.666716 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85acb26-73d2-4901-a537-ab218388de90 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:01.676548 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85acb26-73d2-4901-a537-ab218388de90 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:01.681464 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8800c-4595-4e68-a4d0-cd704d43f58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:01.682365 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8800c-4595-4e68-a4d0-cd704d43f58a admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:01.682648 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8800c-4595-4e68-a4d0-cd704d43f58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:01.682920 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8800c-4595-4e68-a4d0-cd704d43f58a admin admin] PATH_INFO: `/v3/projects/11a6bd52421546e0a627cd5fb71218ca/users/e252705f8b064770909667aca751e03f/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:01.690616 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:39:01.697948 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa8800c-4595-4e68-a4d0-cd704d43f58a admin admin] RBAC: Authorizing `identity:create_grant(project_id=11a6bd52421546e0a627cd5fb71218ca, user_id=e252705f8b064770909667aca751e03f, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:01.700639 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa8800c-4595-4e68-a4d0-cd704d43f58a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:01.760879 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1426/2834] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:39:01 2022] PUT /identity/v3/projects/11a6bd52421546e0a627cd5fb71218ca/users/e252705f8b064770909667aca751e03f/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:39:01.770762 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09596726-67cb-4c15-8d1c-670956e5ac67 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:01.771069 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09596726-67cb-4c15-8d1c-670956e5ac67 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:01.774380 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09596726-67cb-4c15-8d1c-670956e5ac67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:01.798734 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-09596726-67cb-4c15-8d1c-670956e5ac67 None None] MFA Rules not processed for user `e252705f8b064770909667aca751e03f`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:39:01.803856 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-09596726-67cb-4c15-8d1c-670956e5ac67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:01.863589 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1409/2835] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:39:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:39:01.868208 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8800c-4595-4e68-a4d0-cd704d43f58a admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:01.928945 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8800c-4595-4e68-a4d0-cd704d43f58a admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:01.934639 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75deb5e1-b14e-45ef-8ca0-5199feaa1e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:01.935287 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75deb5e1-b14e-45ef-8ca0-5199feaa1e68 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:01.935569 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75deb5e1-b14e-45ef-8ca0-5199feaa1e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:01.935845 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75deb5e1-b14e-45ef-8ca0-5199feaa1e68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:01.936517 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75deb5e1-b14e-45ef-8ca0-5199feaa1e68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:01.938423 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75deb5e1-b14e-45ef-8ca0-5199feaa1e68 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:02.053378 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1427/2836] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:39:01 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:39:02.057668 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09596726-67cb-4c15-8d1c-670956e5ac67 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:02.068610 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09596726-67cb-4c15-8d1c-670956e5ac67 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:02.115538 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:39:02.124463 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b533a-364b-4c47-b703-c16382aa649e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:02.125123 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b533a-364b-4c47-b703-c16382aa649e admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:02.129955 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b533a-364b-4c47-b703-c16382aa649e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:02.129955 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b533a-364b-4c47-b703-c16382aa649e admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:02.129955 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b533a-364b-4c47-b703-c16382aa649e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:02.129955 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b533a-364b-4c47-b703-c16382aa649e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:02.206066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1410/2837] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:39:02 2022] POST /identity/v3/users => generated 299 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:39:02.209899 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75deb5e1-b14e-45ef-8ca0-5199feaa1e68 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:02.220328 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75deb5e1-b14e-45ef-8ca0-5199feaa1e68 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:02.225223 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11769092-3746-42d1-8cf2-7c8a5d7ef21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:02.225882 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11769092-3746-42d1-8cf2-7c8a5d7ef21e admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:02.226201 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11769092-3746-42d1-8cf2-7c8a5d7ef21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:02.226500 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11769092-3746-42d1-8cf2-7c8a5d7ef21e admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:02.227222 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11769092-3746-42d1-8cf2-7c8a5d7ef21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:02.229105 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11769092-3746-42d1-8cf2-7c8a5d7ef21e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:02.239820 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1428/2838] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:39:02.244385 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b533a-364b-4c47-b703-c16382aa649e admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:02.254544 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b533a-364b-4c47-b703-c16382aa649e admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:02.259969 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a31212-4302-4524-8fdc-35c721746582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:02.260838 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a31212-4302-4524-8fdc-35c721746582 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:02.261124 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a31212-4302-4524-8fdc-35c721746582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:02.261407 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a31212-4302-4524-8fdc-35c721746582 admin admin] PATH_INFO: `/v3/projects/e1c01fbb268f49f18c7cb7edaa5e5a74/users/8d2b74252b9a48ac8a9f5375123a53d1/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:02.275894 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a31212-4302-4524-8fdc-35c721746582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1c01fbb268f49f18c7cb7edaa5e5a74, user_id=8d2b74252b9a48ac8a9f5375123a53d1, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:02.278598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a31212-4302-4524-8fdc-35c721746582 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:02.343455 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1411/2839] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:39:02 2022] PUT /identity/v3/projects/e1c01fbb268f49f18c7cb7edaa5e5a74/users/8d2b74252b9a48ac8a9f5375123a53d1/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:39:02.347402 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11769092-3746-42d1-8cf2-7c8a5d7ef21e admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:02.358698 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11769092-3746-42d1-8cf2-7c8a5d7ef21e admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:02.415637 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24baa0-37a5-4636-99e4-102de95f4f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:02.416225 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24baa0-37a5-4636-99e4-102de95f4f3f admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:02.416528 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24baa0-37a5-4636-99e4-102de95f4f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:02.416787 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24baa0-37a5-4636-99e4-102de95f4f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:02.417506 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24baa0-37a5-4636-99e4-102de95f4f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:02.419128 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24baa0-37a5-4636-99e4-102de95f4f3f admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:02.429017 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1429/2840] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:39:02.434372 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a31212-4302-4524-8fdc-35c721746582 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:02.444225 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a31212-4302-4524-8fdc-35c721746582 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:02.449206 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6f5a6-fe82-4464-8d87-35c2549a96ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:02.450155 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6f5a6-fe82-4464-8d87-35c2549a96ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:02.450445 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6f5a6-fe82-4464-8d87-35c2549a96ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:02.450741 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6f5a6-fe82-4464-8d87-35c2549a96ae admin admin] PATH_INFO: `/v3/projects/e1c01fbb268f49f18c7cb7edaa5e5a74/users/8d2b74252b9a48ac8a9f5375123a53d1/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:02.452948 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6f5a6-fe82-4464-8d87-35c2549a96ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1c01fbb268f49f18c7cb7edaa5e5a74, user_id=8d2b74252b9a48ac8a9f5375123a53d1, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:02.456302 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6f5a6-fe82-4464-8d87-35c2549a96ae admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:02.466683 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1412/2841] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:39:02 2022] PUT /identity/v3/projects/e1c01fbb268f49f18c7cb7edaa5e5a74/users/8d2b74252b9a48ac8a9f5375123a53d1/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:39:02.478540 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf75cb-0a0c-4060-ace1-20baf876b32e None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:02.478834 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf75cb-0a0c-4060-ace1-20baf876b32e None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:02.479116 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf75cb-0a0c-4060-ace1-20baf876b32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:02.505667 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-5bcf75cb-0a0c-4060-ace1-20baf876b32e None None] MFA Rules not processed for user `8d2b74252b9a48ac8a9f5375123a53d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:39:02.506906 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5bcf75cb-0a0c-4060-ace1-20baf876b32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:02.550788 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:39:02.574530 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1430/2842] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:39:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:39:02.585041 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6f5a6-fe82-4464-8d87-35c2549a96ae admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:02.587384 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-82d6f5a6-fe82-4464-8d87-35c2549a96ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:02.647859 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6f5a6-fe82-4464-8d87-35c2549a96ae admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:02.652105 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfae8e1-308d-4e4a-892f-10ed072d4f4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:02.652738 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfae8e1-308d-4e4a-892f-10ed072d4f4e service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:02.653025 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfae8e1-308d-4e4a-892f-10ed072d4f4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:02.653304 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfae8e1-308d-4e4a-892f-10ed072d4f4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:02.709918 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfae8e1-308d-4e4a-892f-10ed072d4f4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:02.711824 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfae8e1-308d-4e4a-892f-10ed072d4f4e service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:02.720673 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1413/2843] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:39:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:39:07.800071 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf75cb-0a0c-4060-ace1-20baf876b32e None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:07.801503 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-5bcf75cb-0a0c-4060-ace1-20baf876b32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:07.814011 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf75cb-0a0c-4060-ace1-20baf876b32e None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:07.817674 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff467b-78a1-418f-8496-e07cd844a443 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:07.818340 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff467b-78a1-418f-8496-e07cd844a443 service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:07.818621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff467b-78a1-418f-8496-e07cd844a443 service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:07.818894 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff467b-78a1-418f-8496-e07cd844a443 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:07.828224 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff467b-78a1-418f-8496-e07cd844a443 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:07.829639 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff467b-78a1-418f-8496-e07cd844a443 service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:07.838894 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1431/2844] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:39:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:39:12.716714 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=68,keystone:INSERT=5 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:39:13.639284 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfae8e1-308d-4e4a-892f-10ed072d4f4e service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:13.702629 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfae8e1-308d-4e4a-892f-10ed072d4f4e service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:13.707608 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b8b06-9096-4d9c-a95f-e34ccea2036b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:13.708459 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b8b06-9096-4d9c-a95f-e34ccea2036b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:13.708738 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b8b06-9096-4d9c-a95f-e34ccea2036b admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:13.709009 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b8b06-9096-4d9c-a95f-e34ccea2036b admin admin] PATH_INFO: `/v3/users/e252705f8b064770909667aca751e03f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:13.710203 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b8b06-9096-4d9c-a95f-e34ccea2036b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e252705f8b064770909667aca751e03f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:13.712141 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b8b06-9096-4d9c-a95f-e34ccea2036b admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:13.887353 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-bf9b8b06-9096-4d9c-a95f-e34ccea2036b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e252705f8b064770909667aca751e03f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:13.894917 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-bf9b8b06-9096-4d9c-a95f-e34ccea2036b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e252705f8b064770909667aca751e03f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:13.907887 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-bf9b8b06-9096-4d9c-a95f-e34ccea2036b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e252705f8b064770909667aca751e03f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:13.908583 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-bf9b8b06-9096-4d9c-a95f-e34ccea2036b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e252705f8b064770909667aca751e03f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:13.964710 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-bf9b8b06-9096-4d9c-a95f-e34ccea2036b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e252705f8b064770909667aca751e03f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:13.971437 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1414/2845] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:39:13 2022] DELETE /identity/v3/users/e252705f8b064770909667aca751e03f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:39:13.976100 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d4305-2b49-4b9a-b7d9-96414c1f0591 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:13.976569 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d4305-2b49-4b9a-b7d9-96414c1f0591 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:13.976697 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d4305-2b49-4b9a-b7d9-96414c1f0591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:13.994576 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-306d4305-2b49-4b9a-b7d9-96414c1f0591 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:39:13.999382 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-306d4305-2b49-4b9a-b7d9-96414c1f0591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:14.054967 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1432/2846] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:39:14.064811 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b8b06-9096-4d9c-a95f-e34ccea2036b admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:14.066248 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-bf9b8b06-9096-4d9c-a95f-e34ccea2036b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:14.123480 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b8b06-9096-4d9c-a95f-e34ccea2036b admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:14.127718 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46a571-4c9c-4efc-bcce-2b80d69ba141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:14.128379 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46a571-4c9c-4efc-bcce-2b80d69ba141 service neutron] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:14.128660 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46a571-4c9c-4efc-bcce-2b80d69ba141 service neutron] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:14.128934 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46a571-4c9c-4efc-bcce-2b80d69ba141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:14.137806 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46a571-4c9c-4efc-bcce-2b80d69ba141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:14.139258 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46a571-4c9c-4efc-bcce-2b80d69ba141 service neutron] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:14.149103 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1415/2847] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:39:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:39:14.515498 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d4305-2b49-4b9a-b7d9-96414c1f0591 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:14.517269 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-306d4305-2b49-4b9a-b7d9-96414c1f0591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:14.530799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d4305-2b49-4b9a-b7d9-96414c1f0591 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:14.535795 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958d525-cfe7-460f-953a-58dcbf14063d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:14.536667 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958d525-cfe7-460f-953a-58dcbf14063d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:14.537914 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958d525-cfe7-460f-953a-58dcbf14063d admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:14.537914 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958d525-cfe7-460f-953a-58dcbf14063d admin admin] PATH_INFO: `/v3/projects/11a6bd52421546e0a627cd5fb71218ca` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:14.538435 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958d525-cfe7-460f-953a-58dcbf14063d admin admin] RBAC: Authorizing `identity:delete_project(project_id=11a6bd52421546e0a627cd5fb71218ca)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:14.540370 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958d525-cfe7-460f-953a-58dcbf14063d admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:14.668292 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f958d525-cfe7-460f-953a-58dcbf14063d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11a6bd52421546e0a627cd5fb71218ca', 'request_id': 'req-f958d525-cfe7-460f-953a-58dcbf14063d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:14.741841 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f958d525-cfe7-460f-953a-58dcbf14063d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11a6bd52421546e0a627cd5fb71218ca', 'request_id': 'req-f958d525-cfe7-460f-953a-58dcbf14063d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:14.747811 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f958d525-cfe7-460f-953a-58dcbf14063d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11a6bd52421546e0a627cd5fb71218ca', 'request_id': 'req-f958d525-cfe7-460f-953a-58dcbf14063d'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:14.759797 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f958d525-cfe7-460f-953a-58dcbf14063d admin admin] The token cache is being invalidate because project 11a6bd52421546e0a627cd5fb71218ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:39:14.760024 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f958d525-cfe7-460f-953a-58dcbf14063d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:14.760657 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-f958d525-cfe7-460f-953a-58dcbf14063d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:14.762218 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1433/2848] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:39:14 2022] DELETE /identity/v3/projects/11a6bd52421546e0a627cd5fb71218ca => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:39:14.766277 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46a571-4c9c-4efc-bcce-2b80d69ba141 service neutron] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:14.775909 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46a571-4c9c-4efc-bcce-2b80d69ba141 service neutron] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:14.793917 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:39:14.832037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0072de-5859-4bbf-9f03-cc160a9425c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:14.832914 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0072de-5859-4bbf-9f03-cc160a9425c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:14.833175 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0072de-5859-4bbf-9f03-cc160a9425c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:14.833449 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0072de-5859-4bbf-9f03-cc160a9425c6 admin admin] PATH_INFO: `/v3/users/8d2b74252b9a48ac8a9f5375123a53d1` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:14.834650 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0072de-5859-4bbf-9f03-cc160a9425c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d2b74252b9a48ac8a9f5375123a53d1)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:14.836566 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0072de-5859-4bbf-9f03-cc160a9425c6 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:15.086880 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8b0072de-5859-4bbf-9f03-cc160a9425c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d2b74252b9a48ac8a9f5375123a53d1'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:15.095197 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8b0072de-5859-4bbf-9f03-cc160a9425c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d2b74252b9a48ac8a9f5375123a53d1'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:15.107453 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8b0072de-5859-4bbf-9f03-cc160a9425c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d2b74252b9a48ac8a9f5375123a53d1'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:15.108145 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8b0072de-5859-4bbf-9f03-cc160a9425c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d2b74252b9a48ac8a9f5375123a53d1'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:15.233492 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-8b0072de-5859-4bbf-9f03-cc160a9425c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d2b74252b9a48ac8a9f5375123a53d1'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:15.240801 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1416/2849] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:39:14 2022] DELETE /identity/v3/users/8d2b74252b9a48ac8a9f5375123a53d1 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:39:15.612359 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958d525-cfe7-460f-953a-58dcbf14063d admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:15.613961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-f958d525-cfe7-460f-953a-58dcbf14063d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:15.628259 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958d525-cfe7-460f-953a-58dcbf14063d admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:15.676331 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:39:15.684999 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c56a81-66fc-472e-8ff0-d0602591db38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:15.687306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c56a81-66fc-472e-8ff0-d0602591db38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:15.687306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c56a81-66fc-472e-8ff0-d0602591db38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:15.687306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c56a81-66fc-472e-8ff0-d0602591db38 admin admin] PATH_INFO: `/v3/projects/e1c01fbb268f49f18c7cb7edaa5e5a74` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:15.688230 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c56a81-66fc-472e-8ff0-d0602591db38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1c01fbb268f49f18c7cb7edaa5e5a74)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:15.690209 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c56a81-66fc-472e-8ff0-d0602591db38 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:15.827280 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-45c56a81-66fc-472e-8ff0-d0602591db38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1c01fbb268f49f18c7cb7edaa5e5a74', 'request_id': 'req-45c56a81-66fc-472e-8ff0-d0602591db38'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:15.895654 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-45c56a81-66fc-472e-8ff0-d0602591db38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1c01fbb268f49f18c7cb7edaa5e5a74', 'request_id': 'req-45c56a81-66fc-472e-8ff0-d0602591db38'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:15.901618 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-45c56a81-66fc-472e-8ff0-d0602591db38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1c01fbb268f49f18c7cb7edaa5e5a74', 'request_id': 'req-45c56a81-66fc-472e-8ff0-d0602591db38'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:15.913175 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-45c56a81-66fc-472e-8ff0-d0602591db38 admin admin] The token cache is being invalidate because project e1c01fbb268f49f18c7cb7edaa5e5a74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:39:15.913464 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-45c56a81-66fc-472e-8ff0-d0602591db38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:15.914136 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-45c56a81-66fc-472e-8ff0-d0602591db38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:15.915704 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1434/2850] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:39:15 2022] DELETE /identity/v3/projects/e1c01fbb268f49f18c7cb7edaa5e5a74 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:39:15.921751 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8cdd2-6d7f-4e97-9c70-b1d8903c1df8 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:15.922252 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8cdd2-6d7f-4e97-9c70-b1d8903c1df8 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:15.922542 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8cdd2-6d7f-4e97-9c70-b1d8903c1df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:15.941081 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-d2f8cdd2-6d7f-4e97-9c70-b1d8903c1df8 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:39:15.942321 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-d2f8cdd2-6d7f-4e97-9c70-b1d8903c1df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:16.002011 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1417/2851] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:39:16.010306 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d8440-6bad-415f-b386-e5e6dd6b1a44 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:16.010696 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d8440-6bad-415f-b386-e5e6dd6b1a44 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:16.010983 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d8440-6bad-415f-b386-e5e6dd6b1a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:16.029013 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-b23d8440-6bad-415f-b386-e5e6dd6b1a44 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:39:16.030236 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b23d8440-6bad-415f-b386-e5e6dd6b1a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:16.038067 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1435/2852] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:39:16.042219 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8cdd2-6d7f-4e97-9c70-b1d8903c1df8 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:16.052381 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8cdd2-6d7f-4e97-9c70-b1d8903c1df8 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:16.057250 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254277b-db8d-480c-aaad-b181ebe79c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:16.057976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254277b-db8d-480c-aaad-b181ebe79c48 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:16.058298 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254277b-db8d-480c-aaad-b181ebe79c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:16.058577 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254277b-db8d-480c-aaad-b181ebe79c48 admin admin] PATH_INFO: `/v3/domains` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:16.059331 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254277b-db8d-480c-aaad-b181ebe79c48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80246) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:39:16.059639 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254277b-db8d-480c-aaad-b181ebe79c48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:16.061240 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254277b-db8d-480c-aaad-b181ebe79c48 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:16.073627 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1418/2853] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:39:16.077862 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d8440-6bad-415f-b386-e5e6dd6b1a44 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:16.087815 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d8440-6bad-415f-b386-e5e6dd6b1a44 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:16.092834 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198b867-c386-4d1d-a2b9-04ba7fcf5bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:16.093541 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198b867-c386-4d1d-a2b9-04ba7fcf5bcf admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:16.093880 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198b867-c386-4d1d-a2b9-04ba7fcf5bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:16.094188 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198b867-c386-4d1d-a2b9-04ba7fcf5bcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:16.094885 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198b867-c386-4d1d-a2b9-04ba7fcf5bcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:16.096779 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198b867-c386-4d1d-a2b9-04ba7fcf5bcf admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:16.171391 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1436/2854] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:39:16 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:39:16.176139 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254277b-db8d-480c-aaad-b181ebe79c48 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:16.186609 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254277b-db8d-480c-aaad-b181ebe79c48 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:16.214343 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:39:16.244666 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6a0a3-a265-4cd1-8834-3c05ea5d5d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:16.245538 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6a0a3-a265-4cd1-8834-3c05ea5d5d89 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:16.246258 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6a0a3-a265-4cd1-8834-3c05ea5d5d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:16.246594 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6a0a3-a265-4cd1-8834-3c05ea5d5d89 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:16.247290 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6a0a3-a265-4cd1-8834-3c05ea5d5d89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:16.249196 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6a0a3-a265-4cd1-8834-3c05ea5d5d89 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:16.330490 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1419/2855] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:39:16 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:39:16.334631 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198b867-c386-4d1d-a2b9-04ba7fcf5bcf admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:16.344875 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198b867-c386-4d1d-a2b9-04ba7fcf5bcf admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:16.349528 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b2d76-8496-48d5-9c25-114625d22300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:16.350209 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b2d76-8496-48d5-9c25-114625d22300 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:16.350493 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b2d76-8496-48d5-9c25-114625d22300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:16.350767 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b2d76-8496-48d5-9c25-114625d22300 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:16.351484 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b2d76-8496-48d5-9c25-114625d22300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:16.353418 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b2d76-8496-48d5-9c25-114625d22300 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:16.364567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1437/2856] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:39:16.368265 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6a0a3-a265-4cd1-8834-3c05ea5d5d89 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:16.378843 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6a0a3-a265-4cd1-8834-3c05ea5d5d89 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:16.383466 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54831978-20d9-4c7b-a0c4-b0ecef5a167e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:16.384114 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54831978-20d9-4c7b-a0c4-b0ecef5a167e admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:16.384397 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54831978-20d9-4c7b-a0c4-b0ecef5a167e admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:16.384676 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54831978-20d9-4c7b-a0c4-b0ecef5a167e admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:16.385395 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54831978-20d9-4c7b-a0c4-b0ecef5a167e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:16.387017 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54831978-20d9-4c7b-a0c4-b0ecef5a167e admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:16.397259 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1420/2857] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:39:16.401171 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b2d76-8496-48d5-9c25-114625d22300 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:16.411564 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b2d76-8496-48d5-9c25-114625d22300 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:16.416066 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f601133-b566-4179-8b09-06a20cfdd87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:16.416929 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f601133-b566-4179-8b09-06a20cfdd87b admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:16.417212 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f601133-b566-4179-8b09-06a20cfdd87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:16.417487 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f601133-b566-4179-8b09-06a20cfdd87b admin admin] PATH_INFO: `/v3/projects/bbe41b1e7191483abed322c8ab4138ff/users/887e294ee6754d4285543aff7dd8acab/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:16.431606 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f601133-b566-4179-8b09-06a20cfdd87b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbe41b1e7191483abed322c8ab4138ff, user_id=887e294ee6754d4285543aff7dd8acab, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:16.434200 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f601133-b566-4179-8b09-06a20cfdd87b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:16.507576 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1438/2858] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:39:16 2022] PUT /identity/v3/projects/bbe41b1e7191483abed322c8ab4138ff/users/887e294ee6754d4285543aff7dd8acab/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:39:16.520062 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ff9e0-daf7-4cb1-b837-b109fe04da71 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:16.520355 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ff9e0-daf7-4cb1-b837-b109fe04da71 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:16.520646 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ff9e0-daf7-4cb1-b837-b109fe04da71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:16.548169 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-328ff9e0-daf7-4cb1-b837-b109fe04da71 None None] MFA Rules not processed for user `887e294ee6754d4285543aff7dd8acab`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:39:16.549378 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-328ff9e0-daf7-4cb1-b837-b109fe04da71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:16.615132 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1421/2859] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:39:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:39:16.619727 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f601133-b566-4179-8b09-06a20cfdd87b admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:16.681350 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f601133-b566-4179-8b09-06a20cfdd87b admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:16.686011 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0af47d-63fe-47e9-84e7-587edfa93370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:16.686639 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0af47d-63fe-47e9-84e7-587edfa93370 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:16.686921 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0af47d-63fe-47e9-84e7-587edfa93370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:16.687196 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0af47d-63fe-47e9-84e7-587edfa93370 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:16.688701 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0af47d-63fe-47e9-84e7-587edfa93370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:16.690738 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0af47d-63fe-47e9-84e7-587edfa93370 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:16.765712 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1439/2860] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:39:16 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:39:16.769842 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ff9e0-daf7-4cb1-b837-b109fe04da71 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:16.780537 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ff9e0-daf7-4cb1-b837-b109fe04da71 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:16.837077 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98761603-06b7-486b-8c8f-33001d390fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:16.837740 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98761603-06b7-486b-8c8f-33001d390fdf admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:16.838026 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98761603-06b7-486b-8c8f-33001d390fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:16.838335 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98761603-06b7-486b-8c8f-33001d390fdf admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:16.839043 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98761603-06b7-486b-8c8f-33001d390fdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:16.840957 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98761603-06b7-486b-8c8f-33001d390fdf admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:16.907015 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1422/2861] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:39:16 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:39:16.910953 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0af47d-63fe-47e9-84e7-587edfa93370 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:16.917522 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:39:16.921282 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0af47d-63fe-47e9-84e7-587edfa93370 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:16.926628 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bffa8e-2695-4e3b-b6f2-df3fac731d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:16.927285 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bffa8e-2695-4e3b-b6f2-df3fac731d21 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:16.927571 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bffa8e-2695-4e3b-b6f2-df3fac731d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:16.927850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bffa8e-2695-4e3b-b6f2-df3fac731d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:16.928577 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bffa8e-2695-4e3b-b6f2-df3fac731d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:16.930299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bffa8e-2695-4e3b-b6f2-df3fac731d21 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:16.947125 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1440/2862] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:39:16.947300 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98761603-06b7-486b-8c8f-33001d390fdf admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:16.955202 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98761603-06b7-486b-8c8f-33001d390fdf admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:16.959902 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c88c84-4b0d-457e-a40e-90ff5f18db20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:16.960554 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c88c84-4b0d-457e-a40e-90ff5f18db20 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:16.960838 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c88c84-4b0d-457e-a40e-90ff5f18db20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:16.961121 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c88c84-4b0d-457e-a40e-90ff5f18db20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:16.961843 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c88c84-4b0d-457e-a40e-90ff5f18db20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:16.963468 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c88c84-4b0d-457e-a40e-90ff5f18db20 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:16.973394 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1423/2863] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:39:16.983072 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bffa8e-2695-4e3b-b6f2-df3fac731d21 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:16.993352 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bffa8e-2695-4e3b-b6f2-df3fac731d21 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:16.998133 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfdd41-a6bb-465e-b34a-0de94a2803bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:16.999210 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfdd41-a6bb-465e-b34a-0de94a2803bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:16.999818 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfdd41-a6bb-465e-b34a-0de94a2803bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:17.001120 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfdd41-a6bb-465e-b34a-0de94a2803bd admin admin] PATH_INFO: `/v3/projects/8a194f3e5e0c45eeb04915443500e284/users/5aae6b57b79a43d785cb78f198391c08/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:17.015964 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfdd41-a6bb-465e-b34a-0de94a2803bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a194f3e5e0c45eeb04915443500e284, user_id=5aae6b57b79a43d785cb78f198391c08, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:17.018650 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfdd41-a6bb-465e-b34a-0de94a2803bd admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:17.090394 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1441/2864] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:39:16 2022] PUT /identity/v3/projects/8a194f3e5e0c45eeb04915443500e284/users/5aae6b57b79a43d785cb78f198391c08/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:39:17.101653 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c1e1c-5c60-48c9-ae2e-39d0cba48544 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:17.102253 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c1e1c-5c60-48c9-ae2e-39d0cba48544 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:17.102534 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c1e1c-5c60-48c9-ae2e-39d0cba48544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:17.129550 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-831c1e1c-5c60-48c9-ae2e-39d0cba48544 None None] MFA Rules not processed for user `5aae6b57b79a43d785cb78f198391c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:39:17.130811 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-831c1e1c-5c60-48c9-ae2e-39d0cba48544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:17.134741 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:39:17.195700 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1424/2865] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:39:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:39:17.200355 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfdd41-a6bb-465e-b34a-0de94a2803bd admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:17.267392 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfdd41-a6bb-465e-b34a-0de94a2803bd admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:17.272199 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967d011-b7e9-4475-9b48-ce3cfec759a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:17.272886 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967d011-b7e9-4475-9b48-ce3cfec759a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:17.273170 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967d011-b7e9-4475-9b48-ce3cfec759a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:17.273450 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967d011-b7e9-4475-9b48-ce3cfec759a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:17.274167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967d011-b7e9-4475-9b48-ce3cfec759a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:17.276109 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967d011-b7e9-4475-9b48-ce3cfec759a7 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:17.354783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1442/2866] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:39:17 2022] POST /identity/v3/projects => generated 379 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:39:17.358886 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c1e1c-5c60-48c9-ae2e-39d0cba48544 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:17.370607 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c1e1c-5c60-48c9-ae2e-39d0cba48544 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:17.426588 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d7d63-0554-483a-875d-c83695e3ba30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:17.427253 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d7d63-0554-483a-875d-c83695e3ba30 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:17.427531 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d7d63-0554-483a-875d-c83695e3ba30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:17.427803 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d7d63-0554-483a-875d-c83695e3ba30 admin admin] PATH_INFO: `/v3/users` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:17.428474 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d7d63-0554-483a-875d-c83695e3ba30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:17.430387 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d7d63-0554-483a-875d-c83695e3ba30 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:17.530904 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1425/2867] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:39:17 2022] POST /identity/v3/users => generated 296 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:39:17.536595 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967d011-b7e9-4475-9b48-ce3cfec759a7 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:17.548050 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967d011-b7e9-4475-9b48-ce3cfec759a7 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:17.552850 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01656d9f-9aa1-4cea-b3fa-8dc8258fa6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:17.553502 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01656d9f-9aa1-4cea-b3fa-8dc8258fa6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:17.553783 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01656d9f-9aa1-4cea-b3fa-8dc8258fa6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:17.554060 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01656d9f-9aa1-4cea-b3fa-8dc8258fa6d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:17.554807 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01656d9f-9aa1-4cea-b3fa-8dc8258fa6d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:17.556385 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01656d9f-9aa1-4cea-b3fa-8dc8258fa6d8 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:17.567280 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1443/2868] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:39:17.571251 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d7d63-0554-483a-875d-c83695e3ba30 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:17.581709 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d7d63-0554-483a-875d-c83695e3ba30 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:17.586339 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6893b8-7983-4e8b-a349-73e5f3ff193f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:17.587245 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6893b8-7983-4e8b-a349-73e5f3ff193f admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:17.587525 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6893b8-7983-4e8b-a349-73e5f3ff193f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:17.587797 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6893b8-7983-4e8b-a349-73e5f3ff193f admin admin] PATH_INFO: `/v3/projects/dbf9ea928911444fb4dab96044b5bf4a/users/b1db50cf6ad44c54bd276ee737de40fa/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:17.604098 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6893b8-7983-4e8b-a349-73e5f3ff193f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbf9ea928911444fb4dab96044b5bf4a, user_id=b1db50cf6ad44c54bd276ee737de40fa, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:17.606933 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6893b8-7983-4e8b-a349-73e5f3ff193f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:17.678750 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1426/2869] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:39:17 2022] PUT /identity/v3/projects/dbf9ea928911444fb4dab96044b5bf4a/users/b1db50cf6ad44c54bd276ee737de40fa/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:39:17.682713 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01656d9f-9aa1-4cea-b3fa-8dc8258fa6d8 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:17.692790 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01656d9f-9aa1-4cea-b3fa-8dc8258fa6d8 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:17.749207 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7dfc6-3382-4a0f-a521-29b4e44fd21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:17.749799 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7dfc6-3382-4a0f-a521-29b4e44fd21b admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:17.750084 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7dfc6-3382-4a0f-a521-29b4e44fd21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:17.750397 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7dfc6-3382-4a0f-a521-29b4e44fd21b admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:17.751119 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7dfc6-3382-4a0f-a521-29b4e44fd21b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:17.752707 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7dfc6-3382-4a0f-a521-29b4e44fd21b admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:17.762301 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1444/2870] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:39:17.767035 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6893b8-7983-4e8b-a349-73e5f3ff193f admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:17.777280 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6893b8-7983-4e8b-a349-73e5f3ff193f admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:17.782231 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fe385-49ce-42af-b040-a550db986241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:17.783103 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fe385-49ce-42af-b040-a550db986241 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:17.783382 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fe385-49ce-42af-b040-a550db986241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:17.783659 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fe385-49ce-42af-b040-a550db986241 admin admin] PATH_INFO: `/v3/projects/dbf9ea928911444fb4dab96044b5bf4a/users/b1db50cf6ad44c54bd276ee737de40fa/roles/15cf04fec8c6477088a33bf286f1bbdb` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:17.785615 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27fe385-49ce-42af-b040-a550db986241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbf9ea928911444fb4dab96044b5bf4a, user_id=b1db50cf6ad44c54bd276ee737de40fa, role_id=15cf04fec8c6477088a33bf286f1bbdb)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:17.788267 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27fe385-49ce-42af-b040-a550db986241 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:17.799047 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1427/2871] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:39:17 2022] PUT /identity/v3/projects/dbf9ea928911444fb4dab96044b5bf4a/users/b1db50cf6ad44c54bd276ee737de40fa/roles/15cf04fec8c6477088a33bf286f1bbdb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:39:17.809031 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f4aa4-d337-4b5f-b564-04238f9b9bfa None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:17.812927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f4aa4-d337-4b5f-b564-04238f9b9bfa None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:17.812927 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f4aa4-d337-4b5f-b564-04238f9b9bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:17.836628 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-241f4aa4-d337-4b5f-b564-04238f9b9bfa None None] MFA Rules not processed for user `b1db50cf6ad44c54bd276ee737de40fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:39:17.837842 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-241f4aa4-d337-4b5f-b564-04238f9b9bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:17.866751 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:39:17.905453 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1445/2872] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:39:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:39:17.917447 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fe385-49ce-42af-b040-a550db986241 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:17.919180 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-a27fe385-49ce-42af-b040-a550db986241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:17.974936 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fe385-49ce-42af-b040-a550db986241 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:17.978837 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933f7dc-03c9-4d6c-af20-7ee0d5c3db77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:17.979465 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933f7dc-03c9-4d6c-af20-7ee0d5c3db77 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:17.979749 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933f7dc-03c9-4d6c-af20-7ee0d5c3db77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:17.980023 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933f7dc-03c9-4d6c-af20-7ee0d5c3db77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:17.989261 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:39:18.036686 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933f7dc-03c9-4d6c-af20-7ee0d5c3db77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:18.038237 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933f7dc-03c9-4d6c-af20-7ee0d5c3db77 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:18.047755 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1428/2873] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:39:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:39:19.957892 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f4aa4-d337-4b5f-b564-04238f9b9bfa None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:19.959374 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-241f4aa4-d337-4b5f-b564-04238f9b9bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:19.971379 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f4aa4-d337-4b5f-b564-04238f9b9bfa None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:19.974977 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f8a23-fa4f-43c4-8667-02a2a250dd3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:19.975621 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f8a23-fa4f-43c4-8667-02a2a250dd3f service cinder] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:19.975906 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f8a23-fa4f-43c4-8667-02a2a250dd3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:19.976188 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f8a23-fa4f-43c4-8667-02a2a250dd3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:20.034189 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f8a23-fa4f-43c4-8667-02a2a250dd3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:20.035625 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f8a23-fa4f-43c4-8667-02a2a250dd3f service cinder] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:20.044603 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1446/2874] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:39:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:39:21.158324 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933f7dc-03c9-4d6c-af20-7ee0d5c3db77 service cinder] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:21.167071 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933f7dc-03c9-4d6c-af20-7ee0d5c3db77 service cinder] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:21.170707 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c50592-1075-4feb-a8b2-09b4d4a9b140 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:21.171374 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c50592-1075-4feb-a8b2-09b4d4a9b140 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:21.171659 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c50592-1075-4feb-a8b2-09b4d4a9b140 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:21.171939 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c50592-1075-4feb-a8b2-09b4d4a9b140 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:21.181854 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c50592-1075-4feb-a8b2-09b4d4a9b140 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:21.183392 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c50592-1075-4feb-a8b2-09b4d4a9b140 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:21.194081 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1429/2875] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:39:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:39:25.634768 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f8a23-fa4f-43c4-8667-02a2a250dd3f service cinder] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:25.697413 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f8a23-fa4f-43c4-8667-02a2a250dd3f service cinder] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:25.702082 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cd023-ab09-4e05-83b4-7315e5ed6ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:25.703694 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cd023-ab09-4e05-83b4-7315e5ed6ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:25.703983 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cd023-ab09-4e05-83b4-7315e5ed6ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:25.704267 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cd023-ab09-4e05-83b4-7315e5ed6ccd admin admin] PATH_INFO: `/v3/users/887e294ee6754d4285543aff7dd8acab` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:25.705478 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49cd023-ab09-4e05-83b4-7315e5ed6ccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=887e294ee6754d4285543aff7dd8acab)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:25.707480 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49cd023-ab09-4e05-83b4-7315e5ed6ccd admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:25.869679 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c49cd023-ab09-4e05-83b4-7315e5ed6ccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '887e294ee6754d4285543aff7dd8acab'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:25.947370 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c49cd023-ab09-4e05-83b4-7315e5ed6ccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '887e294ee6754d4285543aff7dd8acab'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:25.955616 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:39:25.959960 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c49cd023-ab09-4e05-83b4-7315e5ed6ccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '887e294ee6754d4285543aff7dd8acab'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:25.966567 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c49cd023-ab09-4e05-83b4-7315e5ed6ccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '887e294ee6754d4285543aff7dd8acab'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:25.967201 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-c49cd023-ab09-4e05-83b4-7315e5ed6ccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '887e294ee6754d4285543aff7dd8acab'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:25.973122 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1447/2876] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:39:25 2022] DELETE /identity/v3/users/887e294ee6754d4285543aff7dd8acab => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:39:25.978263 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbaac0b-0378-4061-a120-31ce57ea988d None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:25.978742 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbaac0b-0378-4061-a120-31ce57ea988d None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:25.978956 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbaac0b-0378-4061-a120-31ce57ea988d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:25.996884 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-3cbaac0b-0378-4061-a120-31ce57ea988d None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:39:25.998211 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3cbaac0b-0378-4061-a120-31ce57ea988d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:26.058250 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1430/2877] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:39:26.068897 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cd023-ab09-4e05-83b4-7315e5ed6ccd admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:26.070443 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-c49cd023-ab09-4e05-83b4-7315e5ed6ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:26.128226 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cd023-ab09-4e05-83b4-7315e5ed6ccd admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:26.131886 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b06df-a8ed-4602-8883-13140c612738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:26.132546 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b06df-a8ed-4602-8883-13140c612738 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:26.132831 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b06df-a8ed-4602-8883-13140c612738 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:26.133113 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b06df-a8ed-4602-8883-13140c612738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:26.142477 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b06df-a8ed-4602-8883-13140c612738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:26.143908 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b06df-a8ed-4602-8883-13140c612738 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:26.153216 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1448/2878] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:39:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:39:26.538064 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbaac0b-0378-4061-a120-31ce57ea988d None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:26.539598 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-3cbaac0b-0378-4061-a120-31ce57ea988d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:26.552507 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbaac0b-0378-4061-a120-31ce57ea988d None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:26.558404 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd128873-b557-4ff4-b844-bac818787607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:26.559488 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd128873-b557-4ff4-b844-bac818787607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:26.559587 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd128873-b557-4ff4-b844-bac818787607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:26.559968 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd128873-b557-4ff4-b844-bac818787607 admin admin] PATH_INFO: `/v3/projects/bbe41b1e7191483abed322c8ab4138ff` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:26.561820 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd128873-b557-4ff4-b844-bac818787607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbe41b1e7191483abed322c8ab4138ff)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:26.564116 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd128873-b557-4ff4-b844-bac818787607 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:26.737741 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-bd128873-b557-4ff4-b844-bac818787607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbe41b1e7191483abed322c8ab4138ff', 'request_id': 'req-bd128873-b557-4ff4-b844-bac818787607'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:26.743262 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-bd128873-b557-4ff4-b844-bac818787607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbe41b1e7191483abed322c8ab4138ff', 'request_id': 'req-bd128873-b557-4ff4-b844-bac818787607'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:26.827707 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-bd128873-b557-4ff4-b844-bac818787607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbe41b1e7191483abed322c8ab4138ff', 'request_id': 'req-bd128873-b557-4ff4-b844-bac818787607'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:26.839294 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-bd128873-b557-4ff4-b844-bac818787607 admin admin] The token cache is being invalidate because project bbe41b1e7191483abed322c8ab4138ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:39:26.839578 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-bd128873-b557-4ff4-b844-bac818787607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:26.840203 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-bd128873-b557-4ff4-b844-bac818787607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:26.841739 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1431/2879] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:39:26 2022] DELETE /identity/v3/projects/bbe41b1e7191483abed322c8ab4138ff => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:39:26.846615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b06df-a8ed-4602-8883-13140c612738 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:26.856511 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b06df-a8ed-4602-8883-13140c612738 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:26.912068 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a42a7-79d6-44a2-90c9-6c3bb4137b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:26.912932 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a42a7-79d6-44a2-90c9-6c3bb4137b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:26.913214 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a42a7-79d6-44a2-90c9-6c3bb4137b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:26.913491 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a42a7-79d6-44a2-90c9-6c3bb4137b64 admin admin] PATH_INFO: `/v3/users/5aae6b57b79a43d785cb78f198391c08` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:26.914701 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a42a7-79d6-44a2-90c9-6c3bb4137b64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aae6b57b79a43d785cb78f198391c08)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:26.916610 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a42a7-79d6-44a2-90c9-6c3bb4137b64 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:27.145069 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-9d9a42a7-79d6-44a2-90c9-6c3bb4137b64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aae6b57b79a43d785cb78f198391c08'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:27.238322 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-9d9a42a7-79d6-44a2-90c9-6c3bb4137b64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aae6b57b79a43d785cb78f198391c08'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:27.251854 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-9d9a42a7-79d6-44a2-90c9-6c3bb4137b64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aae6b57b79a43d785cb78f198391c08'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:27.258726 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-9d9a42a7-79d6-44a2-90c9-6c3bb4137b64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aae6b57b79a43d785cb78f198391c08'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:27.259380 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-9d9a42a7-79d6-44a2-90c9-6c3bb4137b64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aae6b57b79a43d785cb78f198391c08'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:27.265658 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1449/2880] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:39:26 2022] DELETE /identity/v3/users/5aae6b57b79a43d785cb78f198391c08 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:39:27.680432 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd128873-b557-4ff4-b844-bac818787607 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:27.681932 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-bd128873-b557-4ff4-b844-bac818787607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:27.695601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd128873-b557-4ff4-b844-bac818787607 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:27.714398 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:39:27.753293 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9155c3-04fb-4f45-b4ac-1b38717c7258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:27.754411 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9155c3-04fb-4f45-b4ac-1b38717c7258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:27.754686 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9155c3-04fb-4f45-b4ac-1b38717c7258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:27.754961 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9155c3-04fb-4f45-b4ac-1b38717c7258 admin admin] PATH_INFO: `/v3/projects/8a194f3e5e0c45eeb04915443500e284` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:27.756136 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9155c3-04fb-4f45-b4ac-1b38717c7258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a194f3e5e0c45eeb04915443500e284)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:27.758018 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9155c3-04fb-4f45-b4ac-1b38717c7258 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:27.867494 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2a9155c3-04fb-4f45-b4ac-1b38717c7258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a194f3e5e0c45eeb04915443500e284', 'request_id': 'req-2a9155c3-04fb-4f45-b4ac-1b38717c7258'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:27.873000 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2a9155c3-04fb-4f45-b4ac-1b38717c7258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a194f3e5e0c45eeb04915443500e284', 'request_id': 'req-2a9155c3-04fb-4f45-b4ac-1b38717c7258'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:27.935080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2a9155c3-04fb-4f45-b4ac-1b38717c7258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a194f3e5e0c45eeb04915443500e284', 'request_id': 'req-2a9155c3-04fb-4f45-b4ac-1b38717c7258'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:27.946270 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2a9155c3-04fb-4f45-b4ac-1b38717c7258 admin admin] The token cache is being invalidate because project 8a194f3e5e0c45eeb04915443500e284 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:39:27.946558 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2a9155c3-04fb-4f45-b4ac-1b38717c7258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:27.947193 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-2a9155c3-04fb-4f45-b4ac-1b38717c7258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:27.948741 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1432/2881] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:39:27 2022] DELETE /identity/v3/projects/8a194f3e5e0c45eeb04915443500e284 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:39:27.953228 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a42a7-79d6-44a2-90c9-6c3bb4137b64 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:27.954706 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-9d9a42a7-79d6-44a2-90c9-6c3bb4137b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:27.963852 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:39:27.968366 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a42a7-79d6-44a2-90c9-6c3bb4137b64 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:28.025149 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f598e8-57dd-4f5a-93de-957cdc201e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:28.026055 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f598e8-57dd-4f5a-93de-957cdc201e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:28.026365 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f598e8-57dd-4f5a-93de-957cdc201e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:28.026642 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f598e8-57dd-4f5a-93de-957cdc201e27 admin admin] PATH_INFO: `/v3/users/b1db50cf6ad44c54bd276ee737de40fa` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:28.027806 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f598e8-57dd-4f5a-93de-957cdc201e27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1db50cf6ad44c54bd276ee737de40fa)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:28.029705 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f598e8-57dd-4f5a-93de-957cdc201e27 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:28.281477 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-83f598e8-57dd-4f5a-93de-957cdc201e27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1db50cf6ad44c54bd276ee737de40fa'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:28.352728 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-83f598e8-57dd-4f5a-93de-957cdc201e27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1db50cf6ad44c54bd276ee737de40fa'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:28.365500 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-83f598e8-57dd-4f5a-93de-957cdc201e27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1db50cf6ad44c54bd276ee737de40fa'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:28.372296 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-83f598e8-57dd-4f5a-93de-957cdc201e27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1db50cf6ad44c54bd276ee737de40fa'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:28.372969 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-83f598e8-57dd-4f5a-93de-957cdc201e27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1db50cf6ad44c54bd276ee737de40fa'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:28.379507 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1450/2882] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:39:27 2022] DELETE /identity/v3/users/b1db50cf6ad44c54bd276ee737de40fa => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:39:28.806037 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9155c3-04fb-4f45-b4ac-1b38717c7258 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:28.810992 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-2a9155c3-04fb-4f45-b4ac-1b38717c7258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:28.821750 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9155c3-04fb-4f45-b4ac-1b38717c7258 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:28.880126 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b390d-a7c9-484c-8362-747d27bd241f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:28.880974 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b390d-a7c9-484c-8362-747d27bd241f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:28.881255 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b390d-a7c9-484c-8362-747d27bd241f admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:28.881533 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b390d-a7c9-484c-8362-747d27bd241f admin admin] PATH_INFO: `/v3/projects/dbf9ea928911444fb4dab96044b5bf4a` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:28.882722 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b390d-a7c9-484c-8362-747d27bd241f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbf9ea928911444fb4dab96044b5bf4a)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:28.884643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b390d-a7c9-484c-8362-747d27bd241f admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:29.010336 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6c8b390d-a7c9-484c-8362-747d27bd241f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbf9ea928911444fb4dab96044b5bf4a', 'request_id': 'req-6c8b390d-a7c9-484c-8362-747d27bd241f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:29.014029 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:39:29.016913 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6c8b390d-a7c9-484c-8362-747d27bd241f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbf9ea928911444fb4dab96044b5bf4a', 'request_id': 'req-6c8b390d-a7c9-484c-8362-747d27bd241f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:29.089781 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6c8b390d-a7c9-484c-8362-747d27bd241f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbf9ea928911444fb4dab96044b5bf4a', 'request_id': 'req-6c8b390d-a7c9-484c-8362-747d27bd241f'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:29.102501 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6c8b390d-a7c9-484c-8362-747d27bd241f admin admin] The token cache is being invalidate because project dbf9ea928911444fb4dab96044b5bf4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:39:29.102828 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6c8b390d-a7c9-484c-8362-747d27bd241f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:29.103461 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-6c8b390d-a7c9-484c-8362-747d27bd241f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:29.105068 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1433/2883] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:39:28 2022] DELETE /identity/v3/projects/dbf9ea928911444fb4dab96044b5bf4a => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:39:29.113080 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40a713-a9d9-4f35-819b-394b306e5fce None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:29.113080 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40a713-a9d9-4f35-819b-394b306e5fce None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:29.113080 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40a713-a9d9-4f35-819b-394b306e5fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:29.130895 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-ea40a713-a9d9-4f35-819b-394b306e5fce None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:39:29.132299 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-ea40a713-a9d9-4f35-819b-394b306e5fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:29.191810 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1451/2884] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:39:29.251131 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d9d2f-7550-4a25-8226-97c6fa3f6ff1 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:29.251400 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d9d2f-7550-4a25-8226-97c6fa3f6ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:29.251686 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d9d2f-7550-4a25-8226-97c6fa3f6ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:29.269824 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-469d9d2f-7550-4a25-8226-97c6fa3f6ff1 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:39:29.271058 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-469d9d2f-7550-4a25-8226-97c6fa3f6ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:29.278948 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1434/2885] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:39:29.283922 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40a713-a9d9-4f35-819b-394b306e5fce None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:29.293759 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40a713-a9d9-4f35-819b-394b306e5fce None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:29.299062 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f282a83-ea8d-4dfe-8824-56788cedbadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:29.299713 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f282a83-ea8d-4dfe-8824-56788cedbadc admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:29.300002 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f282a83-ea8d-4dfe-8824-56788cedbadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:29.300282 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f282a83-ea8d-4dfe-8824-56788cedbadc admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:29.301023 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f282a83-ea8d-4dfe-8824-56788cedbadc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:39:29.301311 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f282a83-ea8d-4dfe-8824-56788cedbadc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:29.302959 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f282a83-ea8d-4dfe-8824-56788cedbadc admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:29.314677 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1452/2886] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:39:29.318749 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d9d2f-7550-4a25-8226-97c6fa3f6ff1 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:29.328242 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d9d2f-7550-4a25-8226-97c6fa3f6ff1 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:29.332879 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b8a08f-04f6-4476-a0c7-9d653199c76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:29.333514 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8a08f-04f6-4476-a0c7-9d653199c76d admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:29.333790 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8a08f-04f6-4476-a0c7-9d653199c76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:29.334060 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8a08f-04f6-4476-a0c7-9d653199c76d admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:29.334797 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b8a08f-04f6-4476-a0c7-9d653199c76d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:29.336700 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b8a08f-04f6-4476-a0c7-9d653199c76d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:29.423115 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1435/2887] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:39:29 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:39:29.426926 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f282a83-ea8d-4dfe-8824-56788cedbadc admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:29.436866 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f282a83-ea8d-4dfe-8824-56788cedbadc admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:29.444726 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:39:29.494242 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b133a0-dc10-4cc7-9ab2-eafdb5ee3907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:29.495338 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b133a0-dc10-4cc7-9ab2-eafdb5ee3907 admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:29.495456 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b133a0-dc10-4cc7-9ab2-eafdb5ee3907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:29.495708 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b133a0-dc10-4cc7-9ab2-eafdb5ee3907 admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:29.496405 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b133a0-dc10-4cc7-9ab2-eafdb5ee3907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:29.498359 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b133a0-dc10-4cc7-9ab2-eafdb5ee3907 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:29.581729 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1453/2888] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:39:29 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:39:29.585927 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b8a08f-04f6-4476-a0c7-9d653199c76d admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:29.598094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b8a08f-04f6-4476-a0c7-9d653199c76d admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:29.603178 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27665b17-bffc-444d-a6dc-27a80d9b4dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:29.603832 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27665b17-bffc-444d-a6dc-27a80d9b4dab admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:29.604110 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27665b17-bffc-444d-a6dc-27a80d9b4dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:29.604423 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27665b17-bffc-444d-a6dc-27a80d9b4dab admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:29.605148 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27665b17-bffc-444d-a6dc-27a80d9b4dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:29.606779 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27665b17-bffc-444d-a6dc-27a80d9b4dab admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:29.618177 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1436/2889] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:39:29.622526 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b133a0-dc10-4cc7-9ab2-eafdb5ee3907 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:29.632681 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b133a0-dc10-4cc7-9ab2-eafdb5ee3907 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:29.637378 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7b404-1966-49e9-892d-66953403120a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:29.638029 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7b404-1966-49e9-892d-66953403120a admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:29.638348 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7b404-1966-49e9-892d-66953403120a admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:29.638634 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7b404-1966-49e9-892d-66953403120a admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:29.639892 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7b404-1966-49e9-892d-66953403120a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:29.641487 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7b404-1966-49e9-892d-66953403120a admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:29.651914 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1454/2890] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:39:29.656393 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27665b17-bffc-444d-a6dc-27a80d9b4dab admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:29.666311 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27665b17-bffc-444d-a6dc-27a80d9b4dab admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:29.671650 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d0641-24d2-4693-b789-bcf10b6af584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:29.672510 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d0641-24d2-4693-b789-bcf10b6af584 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:29.672792 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d0641-24d2-4693-b789-bcf10b6af584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:29.673070 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d0641-24d2-4693-b789-bcf10b6af584 admin admin] PATH_INFO: `/v3/projects/93d5a1d86ea44b519fe394a6c975928f/users/428581c695584ea299c1738f3468ea37/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:29.687555 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d0641-24d2-4693-b789-bcf10b6af584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93d5a1d86ea44b519fe394a6c975928f, user_id=428581c695584ea299c1738f3468ea37, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:29.690150 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d0641-24d2-4693-b789-bcf10b6af584 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:29.775248 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1437/2891] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:39:29 2022] PUT /identity/v3/projects/93d5a1d86ea44b519fe394a6c975928f/users/428581c695584ea299c1738f3468ea37/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:39:29.785986 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46844c97-d892-4a33-bdc3-eebaab43b462 None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:29.786326 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46844c97-d892-4a33-bdc3-eebaab43b462 None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:29.786614 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46844c97-d892-4a33-bdc3-eebaab43b462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:29.812685 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-46844c97-d892-4a33-bdc3-eebaab43b462 None None] MFA Rules not processed for user `428581c695584ea299c1738f3468ea37`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:39:29.813904 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-46844c97-d892-4a33-bdc3-eebaab43b462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:29.877268 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1455/2892] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:39:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:39:29.887643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d0641-24d2-4693-b789-bcf10b6af584 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:29.889986 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-f14d0641-24d2-4693-b789-bcf10b6af584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:29.946601 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d0641-24d2-4693-b789-bcf10b6af584 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:29.950270 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae9a13-4e24-4cf2-8859-f1a586a398cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:29.950909 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae9a13-4e24-4cf2-8859-f1a586a398cc service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:29.951192 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae9a13-4e24-4cf2-8859-f1a586a398cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:29.951468 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae9a13-4e24-4cf2-8859-f1a586a398cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:29.960523 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae9a13-4e24-4cf2-8859-f1a586a398cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:29.961937 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae9a13-4e24-4cf2-8859-f1a586a398cc service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:29.971100 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1438/2893] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:39:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:39:39.873735 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=61,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:39:39.966653 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:DELETE=2,keystone:SELECT=58,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:39:41.224907 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46844c97-d892-4a33-bdc3-eebaab43b462 None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:41.289193 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46844c97-d892-4a33-bdc3-eebaab43b462 None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:41.293604 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b01dd-bb4d-4849-b913-fa3683d59766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:41.295045 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b01dd-bb4d-4849-b913-fa3683d59766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:41.295335 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b01dd-bb4d-4849-b913-fa3683d59766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:41.295611 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b01dd-bb4d-4849-b913-fa3683d59766 admin admin] PATH_INFO: `/v3/users/428581c695584ea299c1738f3468ea37` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:41.296791 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b01dd-bb4d-4849-b913-fa3683d59766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=428581c695584ea299c1738f3468ea37)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:41.298742 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b01dd-bb4d-4849-b913-fa3683d59766 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:41.513752 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3d9b01dd-bb4d-4849-b913-fa3683d59766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '428581c695584ea299c1738f3468ea37'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:41.609556 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3d9b01dd-bb4d-4849-b913-fa3683d59766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '428581c695584ea299c1738f3468ea37'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:41.622494 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3d9b01dd-bb4d-4849-b913-fa3683d59766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '428581c695584ea299c1738f3468ea37'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:41.630072 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3d9b01dd-bb4d-4849-b913-fa3683d59766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '428581c695584ea299c1738f3468ea37'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:41.630847 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-3d9b01dd-bb4d-4849-b913-fa3683d59766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '428581c695584ea299c1738f3468ea37'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:41.636748 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1456/2894] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:39:41 2022] DELETE /identity/v3/users/428581c695584ea299c1738f3468ea37 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:39:41.641924 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64fe2a-8989-44d3-8450-77e07e158b31 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:41.641924 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64fe2a-8989-44d3-8450-77e07e158b31 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:41.641924 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64fe2a-8989-44d3-8450-77e07e158b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:41.659083 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-9d64fe2a-8989-44d3-8450-77e07e158b31 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:39:41.664886 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9d64fe2a-8989-44d3-8450-77e07e158b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:41.718619 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1439/2895] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:39:41.729698 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b01dd-bb4d-4849-b913-fa3683d59766 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:41.730037 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-3d9b01dd-bb4d-4849-b913-fa3683d59766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:41.787891 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b01dd-bb4d-4849-b913-fa3683d59766 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:41.791495 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16593a7-226a-49a8-a9fa-e94699fae032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:41.792138 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16593a7-226a-49a8-a9fa-e94699fae032 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:41.792449 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16593a7-226a-49a8-a9fa-e94699fae032 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:41.792728 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16593a7-226a-49a8-a9fa-e94699fae032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:41.802311 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16593a7-226a-49a8-a9fa-e94699fae032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:41.803747 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16593a7-226a-49a8-a9fa-e94699fae032 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:41.813895 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1457/2896] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:39:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:39:42.199056 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64fe2a-8989-44d3-8450-77e07e158b31 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:42.200536 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-9d64fe2a-8989-44d3-8450-77e07e158b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:42.212809 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64fe2a-8989-44d3-8450-77e07e158b31 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:42.218139 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd717c-a9b0-4917-b3da-f42d94a5466d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:42.219026 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd717c-a9b0-4917-b3da-f42d94a5466d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:42.219314 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd717c-a9b0-4917-b3da-f42d94a5466d admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:42.219665 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd717c-a9b0-4917-b3da-f42d94a5466d admin admin] PATH_INFO: `/v3/projects/93d5a1d86ea44b519fe394a6c975928f` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:42.221325 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd717c-a9b0-4917-b3da-f42d94a5466d admin admin] RBAC: Authorizing `identity:delete_project(project_id=93d5a1d86ea44b519fe394a6c975928f)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:42.223519 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd717c-a9b0-4917-b3da-f42d94a5466d admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:42.334664 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-08bd717c-a9b0-4917-b3da-f42d94a5466d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93d5a1d86ea44b519fe394a6c975928f', 'request_id': 'req-08bd717c-a9b0-4917-b3da-f42d94a5466d'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:42.340407 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-08bd717c-a9b0-4917-b3da-f42d94a5466d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93d5a1d86ea44b519fe394a6c975928f', 'request_id': 'req-08bd717c-a9b0-4917-b3da-f42d94a5466d'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:42.448851 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-08bd717c-a9b0-4917-b3da-f42d94a5466d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93d5a1d86ea44b519fe394a6c975928f', 'request_id': 'req-08bd717c-a9b0-4917-b3da-f42d94a5466d'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:42.460976 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-08bd717c-a9b0-4917-b3da-f42d94a5466d admin admin] The token cache is being invalidate because project 93d5a1d86ea44b519fe394a6c975928f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:39:42.461262 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-08bd717c-a9b0-4917-b3da-f42d94a5466d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:42.461885 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-08bd717c-a9b0-4917-b3da-f42d94a5466d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:42.463433 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1440/2897] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:39:42 2022] DELETE /identity/v3/projects/93d5a1d86ea44b519fe394a6c975928f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:39:42.469040 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a7193-6b3d-4b55-9a60-cceb5b354a0f None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:42.469521 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a7193-6b3d-4b55-9a60-cceb5b354a0f None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:42.469676 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a7193-6b3d-4b55-9a60-cceb5b354a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:42.487862 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-224a7193-6b3d-4b55-9a60-cceb5b354a0f None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:39:42.489268 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-224a7193-6b3d-4b55-9a60-cceb5b354a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:42.506380 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:39:42.548039 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1458/2898] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:39:42.555777 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a146304-8a0b-4e87-944e-a84ad595eb83 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:42.556080 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a146304-8a0b-4e87-944e-a84ad595eb83 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:42.556362 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a146304-8a0b-4e87-944e-a84ad595eb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:42.574370 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-6a146304-8a0b-4e87-944e-a84ad595eb83 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:39:42.576227 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-6a146304-8a0b-4e87-944e-a84ad595eb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:42.584401 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1441/2899] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:39:42.588677 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a7193-6b3d-4b55-9a60-cceb5b354a0f None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:42.599721 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a7193-6b3d-4b55-9a60-cceb5b354a0f None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:42.604601 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a009e02-172d-412b-bfb2-0517bd0cdd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:42.607536 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a009e02-172d-412b-bfb2-0517bd0cdd90 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:42.607536 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a009e02-172d-412b-bfb2-0517bd0cdd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:42.607536 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a009e02-172d-412b-bfb2-0517bd0cdd90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:42.607536 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a009e02-172d-412b-bfb2-0517bd0cdd90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:39:42.607536 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a009e02-172d-412b-bfb2-0517bd0cdd90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:42.608743 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a009e02-172d-412b-bfb2-0517bd0cdd90 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:42.620693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1459/2900] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 21:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:39:42.625236 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a146304-8a0b-4e87-944e-a84ad595eb83 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:42.634529 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a146304-8a0b-4e87-944e-a84ad595eb83 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:42.639900 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a3597-610d-4225-922f-8eb6cd793313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:42.640543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a3597-610d-4225-922f-8eb6cd793313 admin admin] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:42.640827 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a3597-610d-4225-922f-8eb6cd793313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:42.641104 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a3597-610d-4225-922f-8eb6cd793313 admin admin] PATH_INFO: `/v3/projects` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:42.641802 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a3597-610d-4225-922f-8eb6cd793313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:42.643732 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a3597-610d-4225-922f-8eb6cd793313 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:42.741437 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1442/2901] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 21:39:42 2022] POST /identity/v3/projects => generated 389 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:39:42.745675 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a009e02-172d-412b-bfb2-0517bd0cdd90 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:42.756547 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a009e02-172d-412b-bfb2-0517bd0cdd90 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:42.811273 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80625c3a-5a76-479b-a153-91bbda65144e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:42.811928 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80625c3a-5a76-479b-a153-91bbda65144e admin admin] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:42.812207 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80625c3a-5a76-479b-a153-91bbda65144e admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:42.812481 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80625c3a-5a76-479b-a153-91bbda65144e admin admin] PATH_INFO: `/v3/users` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:42.813164 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80625c3a-5a76-479b-a153-91bbda65144e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:42.815095 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80625c3a-5a76-479b-a153-91bbda65144e admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:42.882898 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1460/2902] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 21:39:42 2022] POST /identity/v3/users => generated 295 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:39:42.886893 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a3597-610d-4225-922f-8eb6cd793313 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:42.898052 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a3597-610d-4225-922f-8eb6cd793313 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:42.902883 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b7b36-5d65-4bff-8775-ca5cd5692406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:42.903543 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b7b36-5d65-4bff-8775-ca5cd5692406 admin admin] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:42.903886 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b7b36-5d65-4bff-8775-ca5cd5692406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:42.904196 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b7b36-5d65-4bff-8775-ca5cd5692406 admin admin] PATH_INFO: `/v3/roles` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:42.904918 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b7b36-5d65-4bff-8775-ca5cd5692406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:42.906578 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b7b36-5d65-4bff-8775-ca5cd5692406 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:42.916926 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1443/2903] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:39:42.920722 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80625c3a-5a76-479b-a153-91bbda65144e admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:42.930477 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80625c3a-5a76-479b-a153-91bbda65144e admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:42.935772 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671a6ea-324f-4152-93ba-2428306be8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:42.936411 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671a6ea-324f-4152-93ba-2428306be8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:42.936693 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671a6ea-324f-4152-93ba-2428306be8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:42.936967 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671a6ea-324f-4152-93ba-2428306be8b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:42.937687 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671a6ea-324f-4152-93ba-2428306be8b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:42.939415 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671a6ea-324f-4152-93ba-2428306be8b0 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:42.949260 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1461/2904] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 21:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:39:42.955086 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b7b36-5d65-4bff-8775-ca5cd5692406 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:42.965052 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b7b36-5d65-4bff-8775-ca5cd5692406 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:42.969643 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d323e-dd37-4dff-a98a-dba0491ba1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:42.970607 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d323e-dd37-4dff-a98a-dba0491ba1a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:42.970894 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d323e-dd37-4dff-a98a-dba0491ba1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:42.971170 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d323e-dd37-4dff-a98a-dba0491ba1a9 admin admin] PATH_INFO: `/v3/projects/8ad54c410f9944f09eed4e3e2b23525a/users/e4b43d7e813f45e38723fc1e0424c42f/roles/a93b63d74444489ebd7f92fd096f7eaf` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:42.986268 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d323e-dd37-4dff-a98a-dba0491ba1a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad54c410f9944f09eed4e3e2b23525a, user_id=e4b43d7e813f45e38723fc1e0424c42f, role_id=a93b63d74444489ebd7f92fd096f7eaf)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:42.988899 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d323e-dd37-4dff-a98a-dba0491ba1a9 admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:43.054242 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1444/2905] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 21:39:42 2022] PUT /identity/v3/projects/8ad54c410f9944f09eed4e3e2b23525a/users/e4b43d7e813f45e38723fc1e0424c42f/roles/a93b63d74444489ebd7f92fd096f7eaf => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:39:43.065108 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c53593-80d5-4051-b260-1c61308e76ae None None] REQUEST_METHOD: `POST` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:43.065414 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c53593-80d5-4051-b260-1c61308e76ae None None] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:43.065718 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c53593-80d5-4051-b260-1c61308e76ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:43.091518 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.auth.core [None req-58c53593-80d5-4051-b260-1c61308e76ae None None] MFA Rules not processed for user `e4b43d7e813f45e38723fc1e0424c42f`. Rule list: `[]` (Enabled: `True`). {{(pid=80247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:39:43.092711 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-58c53593-80d5-4051-b260-1c61308e76ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:43.154988 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1462/2906] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:39:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:39:43.165493 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d323e-dd37-4dff-a98a-dba0491ba1a9 admin admin] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:43.167201 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-506d323e-dd37-4dff-a98a-dba0491ba1a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:43.190066 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:39:43.225629 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d323e-dd37-4dff-a98a-dba0491ba1a9 admin admin] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:43.229609 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141cae7-e02c-44ba-be89-c50b92784760 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d59037633db47efa1ed340055bf520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:43.230318 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141cae7-e02c-44ba-be89-c50b92784760 service cinder] REQUEST_METHOD: `GET` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:43.230600 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141cae7-e02c-44ba-be89-c50b92784760 service cinder] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:43.230870 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141cae7-e02c-44ba-be89-c50b92784760 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:43.240646 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141cae7-e02c-44ba-be89-c50b92784760 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:43.242093 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141cae7-e02c-44ba-be89-c50b92784760 service cinder] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:43.252094 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1445/2907] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:39:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:39:53.151911 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:39:53.259805 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=17 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:39:54.976085 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c53593-80d5-4051-b260-1c61308e76ae None None] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:55.038633 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c53593-80d5-4051-b260-1c61308e76ae None None] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:55.043071 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ce0ad-9002-4998-bbbb-5305fe57eb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:55.044047 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ce0ad-9002-4998-bbbb-5305fe57eb76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:55.044332 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ce0ad-9002-4998-bbbb-5305fe57eb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:55.044607 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ce0ad-9002-4998-bbbb-5305fe57eb76 admin admin] PATH_INFO: `/v3/users/e4b43d7e813f45e38723fc1e0424c42f` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:55.045787 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ce0ad-9002-4998-bbbb-5305fe57eb76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4b43d7e813f45e38723fc1e0424c42f)` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:55.047720 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ce0ad-9002-4998-bbbb-5305fe57eb76 admin admin] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:55.192154 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b15ce0ad-9002-4998-bbbb-5305fe57eb76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4b43d7e813f45e38723fc1e0424c42f'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:55.264956 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b15ce0ad-9002-4998-bbbb-5305fe57eb76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4b43d7e813f45e38723fc1e0424c42f'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:55.277167 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b15ce0ad-9002-4998-bbbb-5305fe57eb76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4b43d7e813f45e38723fc1e0424c42f'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:55.284794 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b15ce0ad-9002-4998-bbbb-5305fe57eb76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4b43d7e813f45e38723fc1e0424c42f'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:55.285555 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.notifications [None req-b15ce0ad-9002-4998-bbbb-5305fe57eb76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4b43d7e813f45e38723fc1e0424c42f'} {{(pid=80247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:55.291535 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1463/2908] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 21:39:54 2022] DELETE /identity/v3/users/e4b43d7e813f45e38723fc1e0424c42f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:39:55.296178 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1158e-9721-4678-b55f-54ea94bfe1d9 None None] REQUEST_METHOD: `POST` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:55.296645 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1158e-9721-4678-b55f-54ea94bfe1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:55.296785 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1158e-9721-4678-b55f-54ea94bfe1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:55.313406 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.auth.core [None req-53e1158e-9721-4678-b55f-54ea94bfe1d9 None None] MFA Rules not processed for user `01e24880ba10472b96df6cd13c234ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80246) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:39:55.314637 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-53e1158e-9721-4678-b55f-54ea94bfe1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:55.375014 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1446/2909] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:39:55.384594 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ce0ad-9002-4998-bbbb-5305fe57eb76 admin admin] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:55.386000 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b15ce0ad-9002-4998-bbbb-5305fe57eb76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:55.442481 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ce0ad-9002-4998-bbbb-5305fe57eb76 admin admin] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:55.446139 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a01d0e-9b62-45b9-85cc-3c3dba4416d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97b6b7c15770400cad4e2b52b13ad354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:55.446786 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a01d0e-9b62-45b9-85cc-3c3dba4416d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:55.447071 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a01d0e-9b62-45b9-85cc-3c3dba4416d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:55.447349 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a01d0e-9b62-45b9-85cc-3c3dba4416d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:55.456961 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a01d0e-9b62-45b9-85cc-3c3dba4416d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:55.458415 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a01d0e-9b62-45b9-85cc-3c3dba4416d8 service neutron] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:55.468095 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1464/2910] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:39:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:39:55.900714 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1158e-9721-4678-b55f-54ea94bfe1d9 None None] Authenticating user token {{(pid=80246) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:39:55.902460 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.fernet_utils [None req-53e1158e-9721-4678-b55f-54ea94bfe1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80246) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:39:55.917231 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1158e-9721-4678-b55f-54ea94bfe1d9 None None] Validating token access rules against request {{(pid=80246) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:39:55.924033 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdda20-7bae-4aa0-a78a-851dbad42eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e24880ba10472b96df6cd13c234ba0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c475db16707f46ecb5780cbec2330b6e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80246) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:39:55.924939 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdda20-7bae-4aa0-a78a-851dbad42eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:39:55.925224 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdda20-7bae-4aa0-a78a-851dbad42eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:39:55.925502 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdda20-7bae-4aa0-a78a-851dbad42eed admin admin] PATH_INFO: `/v3/projects/8ad54c410f9944f09eed4e3e2b23525a` {{(pid=80246) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:39:55.926825 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacdda20-7bae-4aa0-a78a-851dbad42eed admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ad54c410f9944f09eed4e3e2b23525a)` {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:39:55.928712 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacdda20-7bae-4aa0-a78a-851dbad42eed admin admin] RBAC: Authorization granted {{(pid=80246) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:39:56.060658 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-dacdda20-7bae-4aa0-a78a-851dbad42eed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ad54c410f9944f09eed4e3e2b23525a', 'request_id': 'req-dacdda20-7bae-4aa0-a78a-851dbad42eed'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:56.066387 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-dacdda20-7bae-4aa0-a78a-851dbad42eed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ad54c410f9944f09eed4e3e2b23525a', 'request_id': 'req-dacdda20-7bae-4aa0-a78a-851dbad42eed'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:56.138824 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-dacdda20-7bae-4aa0-a78a-851dbad42eed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ad54c410f9944f09eed4e3e2b23525a', 'request_id': 'req-dacdda20-7bae-4aa0-a78a-851dbad42eed'} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:56.150383 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-dacdda20-7bae-4aa0-a78a-851dbad42eed admin admin] The token cache is being invalidate because project 8ad54c410f9944f09eed4e3e2b23525a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80246) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:39:56.150619 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-dacdda20-7bae-4aa0-a78a-851dbad42eed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:56.151244 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG keystone.notifications [None req-dacdda20-7bae-4aa0-a78a-851dbad42eed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80246) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:39:56.153329 dv-cinder-847335-3-smb devstack@keystone.service[80246]: [pid: 80246|app: 0|req: 1447/2911] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 21:39:55 2022] DELETE /identity/v3/projects/8ad54c410f9944f09eed4e3e2b23525a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:40:05.463660 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:40:06.147234 dv-cinder-847335-3-smb devstack@keystone.service[80246]: DEBUG dbcounter [-] [80246] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:42:13.809077 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a01d0e-9b62-45b9-85cc-3c3dba4416d8 service neutron] Authenticating user token {{(pid=80247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:42:13.810492 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b3a01d0e-9b62-45b9-85cc-3c3dba4416d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:42:13.947696 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a01d0e-9b62-45b9-85cc-3c3dba4416d8 service neutron] Validating token access rules against request {{(pid=80247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:42:14.004975 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f1845-79c7-4867-a854-8119d4451f1b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992db9dab5944769b192a868d6637a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076c94b43b2483eb4fc06173f9204c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:42:14.005615 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f1845-79c7-4867-a854-8119d4451f1b service placement] REQUEST_METHOD: `GET` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:42:14.005899 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f1845-79c7-4867-a854-8119d4451f1b service placement] SCRIPT_NAME: `/identity` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:42:14.006349 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f1845-79c7-4867-a854-8119d4451f1b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:42:14.008142 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.fernet_utils [None req-b56f1845-79c7-4867-a854-8119d4451f1b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:42:14.019032 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f1845-79c7-4867-a854-8119d4451f1b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:42:14.021246 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f1845-79c7-4867-a854-8119d4451f1b service placement] RBAC: Authorization granted {{(pid=80247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:42:14.030942 dv-cinder-847335-3-smb devstack@keystone.service[80247]: [pid: 80247|app: 0|req: 1465/2912] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 21:42:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:42:24.026755 dv-cinder-847335-3-smb devstack@keystone.service[80247]: DEBUG dbcounter [-] [80247] Writing DB stats keystone:SELECT=89 {{(pid=80247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}